2024-10-28 01:51:20,434 - DEBUG - [10.0.0.22]: Running cmd : hostname
2024-10-28 01:51:20,748 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-104-1
2024-10-28 01:51:20,748 - DEBUG - [10.0.0.22]: Running cmd : hostname -f
2024-10-28 01:51:20,901 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-104-1.cluster.local
2024-10-28 01:51:20,901 - DEBUG - [10.0.0.22]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2024-10-28 01:51:21,111 - DEBUG - Output : NAMES
contrail_test_nuVmtajGn
k8s_coredns_coredns-77f7cc69db-6nncw_kube-system_b1573987-fce9-4290-ba26-b1e58b35bb53_0
k8s_autoscaler_dns-autoscaler-595558c478-whwcb_kube-system_0a47354a-98df-4f1d-9f67-9a532a36189d_0
k8s_contrail-controller-config-nodemgr_contrail-controller-config-zpzf6_kube-system_9ac37994-b6ad-4a7b-943d-19fe8e5e1f12_0
k8s_contrail-controller-config-svcmonitor_contrail-controller-config-zpzf6_kube-system_9ac37994-b6ad-4a7b-943d-19fe8e5e1f12_0
k8s_contrail-controller-nodemgr_contrail-controller-control-8qwp5_kube-system_dedb9836-ac8c-4f1f-812f-700011a5750f_0
k8s_contrail-controller-control-named_contrail-controller-control-8qwp5_kube-system_dedb9836-ac8c-4f1f-812f-700011a5750f_0
k8s_contrail-analytics-query-engine_contrail-analyticsdb-gvnkn_kube-system_4a738310-54f4-48e4-8bcc-368bc6639284_0
k8s_contrail-controller-config-schema_contrail-controller-config-zpzf6_kube-system_9ac37994-b6ad-4a7b-943d-19fe8e5e1f12_0
k8s_contrail-analytics-alarm-nodemgr_contrail-analytics-alarm-dlc6t_kube-system_a0fd2cb5-813f-45bf-9fbd-f4a238af9c00_0
k8s_contrail-analytics-alarm-gen_contrail-analytics-alarm-dlc6t_kube-system_a0fd2cb5-813f-45bf-9fbd-f4a238af9c00_0
k8s_contrail-analytics-nodemgr_contrail-analytics-f7pjj_kube-system_fb793b0f-af92-4e42-9712-f71e6c20f5e7_0
k8s_contrail-analytics-collector_contrail-analytics-f7pjj_kube-system_fb793b0f-af92-4e42-9712-f71e6c20f5e7_0
k8s_contrail-controller-control-dns_contrail-controller-control-8qwp5_kube-system_dedb9836-ac8c-4f1f-812f-700011a5750f_0
k8s_contrail-analyticsdb_contrail-analyticsdb-gvnkn_kube-system_4a738310-54f4-48e4-8bcc-368bc6639284_0
k8s_contrail-analytics-snmp-nodemgr_contrail-analytics-snmp-927dc_kube-system_6218cb25-4081-498d-9649-54536796d39d_0
k8s_contrail-controller-webui-web_contrail-controller-webui-vxl48_kube-system_e48ec5b2-f78b-40a2-a452-68033a8a3368_0
k8s_contrail-analytics-snmp-topology_contrail-analytics-snmp-927dc_kube-system_6218cb25-4081-498d-9649-54536796d39d_0
k8s_contrail-controller-config-devicemgr_contrail-controller-config-zpzf6_kube-system_9ac37994-b6ad-4a7b-943d-19fe8e5e1f12_0
k8s_kafka_contrail-analytics-alarm-dlc6t_kube-system_a0fd2cb5-813f-45bf-9fbd-f4a238af9c00_0
k8s_contrail-analytics-api_contrail-analytics-f7pjj_kube-system_fb793b0f-af92-4e42-9712-f71e6c20f5e7_0
k8s_contrail-controller-control_contrail-controller-control-8qwp5_kube-system_dedb9836-ac8c-4f1f-812f-700011a5750f_0
k8s_contrail-controller-webui-job_contrail-controller-webui-vxl48_kube-system_e48ec5b2-f78b-40a2-a452-68033a8a3368_0
k8s_contrail-analytics-snmp-collector_contrail-analytics-snmp-927dc_kube-system_6218cb25-4081-498d-9649-54536796d39d_0
k8s_contrail-analyticsdb-nodemgr_contrail-analyticsdb-gvnkn_kube-system_4a738310-54f4-48e4-8bcc-368bc6639284_0
k8s_contrail-controller-config-api_contrail-controller-config-zpzf6_kube-system_9ac37994-b6ad-4a7b-943d-19fe8e5e1f12_0
k8s_contrail-config-database-nodemgr_contrail-configdb-dhhqn_kube-system_85c9f6e7-024d-4b88-b0aa-9e0891a2e313_0
k8s_contrail-configdb_contrail-configdb-dhhqn_kube-system_85c9f6e7-024d-4b88-b0aa-9e0891a2e313_0
k8s_rabbitmq_rabbitmq-qk5h7_kube-system_45645da1-2732-414d-99ff-7aa62bf3a603_0
k8s_contrail-agent-nodemgr_contrail-agent-8ftck_kube-system_3b4bc57b-b965-4c61-b8a6-f189ec5a48ee_0
k8s_redis_redis-4zz92_kube-system_403b77e1-41a1-414c-8fd4-4b7008ccb421_0
k8s_config-zookeeper_config-zookeeper-p8p9v_kube-system_da85aa06-b66d-4cad-8ee0-21555669c7da_0
k8s_contrail-vrouter-agent_contrail-agent-8ftck_kube-system_3b4bc57b-b965-4c61-b8a6-f189ec5a48ee_0
k8s_contrail-kube-manager_contrail-kube-manager-d7jhw_kube-system_1e8d69b0-4ac2-422d-999a-730ce3994885_0
k8s_kube-proxy_kube-proxy-lb4ts_kube-system_a54719e7-e03d-44c9-9020-300cad19b5f2_0
k8s_kube-controller-manager_kube-controller-manager-cn-jenkins-deploy-platform-k8s-manifests-104-1_kube-system_9267b7d4519f29fcfa292d57fb4d32ac_1
k8s_kube-scheduler_kube-scheduler-cn-jenkins-deploy-platform-k8s-manifests-104-1_kube-system_18a64d1d92d088ff183bd30d7912a77c_1
k8s_kube-apiserver_kube-apiserver-cn-jenkins-deploy-platform-k8s-manifests-104-1_kube-system_84c481f5527003a18beabd38080cde81_0
2024-10-28 01:51:21,112 - DEBUG - [10.0.0.22]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-10-28 01:51:21,264 - DEBUG - Output : 172.17.0.1/16
10.0.0.22/24
2024-10-28 01:51:21,265 - DEBUG - [10.0.0.22]: Running cmd : getent hosts 10.0.0.22 | head -n 1 | awk '{print $2}'
2024-10-28 01:51:21,418 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-104-1.cluster.local
2024-10-28 01:51:21,418 - DEBUG - [10.0.0.22]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-10-28 01:51:21,577 - DEBUG - Output : 10.0.0.22/24
2024-10-28 01:51:21,970 - INFO - Using existing project ['default-domain', 'k8s-default'](a5908ba5-9d71-46bb-83fa-28493f0adc03)
2024-10-28 01:51:22,119 - INFO - Using existing project ['default-domain', 'k8s-default'](a5908ba5-9d71-46bb-83fa-28493f0adc03)
2024-10-28 01:51:22,294 - INFO - ================================================================================
2024-10-28 01:51:22,294 - INFO - STARTING TEST : test_ingress_ip_assignment
2024-10-28 01:51:22,295 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2024-10-28 01:51:22,589 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-28 01:51:22,600 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.22': '2'}} with
2024-10-28 01:51:22,600 - INFO - Initial checks done. Running the testcase now
2024-10-28 01:51:22,600 - INFO -
2024-10-28 01:51:22,605 - INFO - Namespace default already exists
2024-10-28 01:51:22,606 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-d7jhw_kube-system_1e8d69b0-4ac2-422d-999a-730ce3994885_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-10-28 01:51:22,837 - DEBUG - Output : cluster_project={}
2024-10-28 01:51:22,953 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2024-10-28 01:51:22,953 - DEBUG - Project uuid in Contrail is a5908ba5-9d71-46bb-83fa-28493f0adc03
2024-10-28 01:51:22,953 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-d7jhw_kube-system_1e8d69b0-4ac2-422d-999a-730ce3994885_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-10-28 01:51:23,190 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-10-28 01:51:23,190 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=42eadb31-2f40-4a2d-9ce7-e0605cc1149e
2024-10-28 01:51:23,198 - INFO - Namespace default with uuid 42eadb31-2f40-4a2d-9ce7-e0605cc1149e found in kube manager
2024-10-28 01:51:23,198 - INFO - Namespace default verification passed
2024-10-28 01:51:23,202 - DEBUG - Service ctest-nginx-svc-97737417 not present
2024-10-28 01:51:23,203 - INFO - Creating service ctest-nginx-svc-97737417
2024-10-28 01:51:23,225 - INFO - Created Service ctest-nginx-svc-97737417
2024-10-28 01:51:23,233 - DEBUG - Pod ctest-nginx-pod-04851433 not present
2024-10-28 01:51:23,234 - INFO - Creating Pod ctest-nginx-pod-04851433
2024-10-28 01:51:23,269 - DEBUG - Pod : ctest-nginx-pod-04851433 UUID is 63ba5c21-c27b-4569-9bd2-5418005ae833
2024-10-28 01:51:23,279 - DEBUG - Pod ctest-nginx-pod-53169016 not present
2024-10-28 01:51:23,280 - INFO - Creating Pod ctest-nginx-pod-53169016
2024-10-28 01:51:23,313 - DEBUG - Pod : ctest-nginx-pod-53169016 UUID is 37ec0817-88ca-465f-a267-98c20ee03058
2024-10-28 01:51:23,754 - INFO - Created VN __public__, UUID :d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:24,199 - DEBUG - Requesting: http://10.0.0.22:8082/domains
2024-10-28 01:51:24,213 - DEBUG - Requesting: http://10.0.0.22:8082/domain/055fccc2-a3f0-4595-bc81-7ee1b5e7e191
2024-10-28 01:51:24,264 - DEBUG - Requesting: http://10.0.0.22:8082/project/a5908ba5-9d71-46bb-83fa-28493f0adc03
2024-10-28 01:51:24,400 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:24,449 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:24,464 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/539f03e6-fe8d-4561-a557-33986a34b373
2024-10-28 01:51:24,489 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/539f03e6-fe8d-4561-a557-33986a34b373
2024-10-28 01:51:24,505 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/6bd34608-275e-486c-8122-f44d37ce6eeb
2024-10-28 01:51:24,528 - DEBUG - Route Targets: ['target:64512:8000007']
2024-10-28 01:51:24,528 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:24,543 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/539f03e6-fe8d-4561-a557-33986a34b373
2024-10-28 01:51:24,566 - INFO - Verified VN network id 12 for VN d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:24,566 - INFO - Verifications in API Server for VN __public__ passed
2024-10-28 01:51:24,566 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:24,581 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/539f03e6-fe8d-4561-a557-33986a34b373
2024-10-28 01:51:24,591 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/539f03e6-fe8d-4561-a557-33986a34b373
2024-10-28 01:51:24,602 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/6bd34608-275e-486c-8122-f44d37ce6eeb
2024-10-28 01:51:24,612 - DEBUG - Requesting: http://10.0.0.22:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-10-28 01:51:24,622 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15039054647683665526', 'uuid-lslong': '11424579571705216394'}, 'enable': 'true', 'created': '2024-10-28T01:51:23', 'last-modified': '2024-10-28T01:51:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.661582'}
2024-10-28 01:51:24,622 - DEBUG - Requesting: http://10.0.0.22:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-10-28 01:51:24,634 - DEBUG - Route Targets: ['target:64512:8000007']
2024-10-28 01:51:24,634 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2024-10-28 01:51:24,635 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2024-10-28 01:51:24,636 - DEBUG - Requesting: http://10.0.0.22:8082/domains
2024-10-28 01:51:24,657 - DEBUG - Requesting: http://10.0.0.22:8082/domain/055fccc2-a3f0-4595-bc81-7ee1b5e7e191
2024-10-28 01:51:24,682 - DEBUG - Requesting: http://10.0.0.22:8082/project/a5908ba5-9d71-46bb-83fa-28493f0adc03
2024-10-28 01:51:24,841 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:24,858 - DEBUG - =>VN __public__ has no policy to be verified
2024-10-28 01:51:24,858 - DEBUG - Verifying the vn in opserver
2024-10-28 01:51:24,858 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.22
2024-10-28 01:51:24,858 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2024-10-28 01:51:24,865 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2024-10-28 01:51:24,865 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2024-10-28 01:51:24,865 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-28 01:51:24,876 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-28 01:51:24,885 - DEBUG - Do not have enough data to verify VN in agent
2024-10-28 01:51:24,885 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-28 01:51:24,903 - DEBUG - VRF ids for VN __public__: {}
2024-10-28 01:51:25,175 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2024-10-28 01:51:25,441 - DEBUG - Requesting: http://10.0.0.22:8082/domains
2024-10-28 01:51:25,451 - DEBUG - Requesting: http://10.0.0.22:8082/domain/055fccc2-a3f0-4595-bc81-7ee1b5e7e191
2024-10-28 01:51:25,467 - DEBUG - Requesting: http://10.0.0.22:8082/project/a5908ba5-9d71-46bb-83fa-28493f0adc03
2024-10-28 01:51:25,573 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:25,592 - DEBUG - Requesting: http://10.0.0.22:8082/floating-ip-pool/cedb013f-16ea-41ca-bdaf-6d29da602060
2024-10-28 01:51:25,606 - DEBUG - Requesting: http://10.0.0.22:8082/domains
2024-10-28 01:51:25,614 - DEBUG - Requesting: http://10.0.0.22:8082/domain/055fccc2-a3f0-4595-bc81-7ee1b5e7e191
2024-10-28 01:51:25,626 - DEBUG - Requesting: http://10.0.0.22:8082/project/a5908ba5-9d71-46bb-83fa-28493f0adc03
2024-10-28 01:51:25,707 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d0b57485-90df-4e76-9e8c-429727ac7d8a
2024-10-28 01:51:25,727 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2024-10-28 01:51:25,727 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2024-10-28 01:51:25,742 - DEBUG - Requesting: http://10.0.0.22:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-10-28 01:51:25,750 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2024-10-28 01:51:25,750 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2024-10-28 01:51:25,754 - DEBUG - Ingress ctest-nginx-ingress-21366460 not present
2024-10-28 01:51:25,754 - INFO - Creating Ingress ctest-nginx-ingress-21366460
2024-10-28 01:51:25,762 - INFO - Created Ingress ctest-nginx-ingress-21366460
2024-10-28 01:51:25,767 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-21366460
2024-10-28 01:51:28,774 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-21366460
2024-10-28 01:51:31,780 - DEBUG - For Ingress ctest-nginx-ingress-21366460, Cluster IP: 10.47.255.248, External IPs ['181.216.219.188']
2024-10-28 01:51:31,780 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-21366460
2024-10-28 01:51:31,780 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=c7a804f3-e46c-496e-9764-442598cf70e0
2024-10-28 01:51:31,802 - INFO - Ingress ctest-nginx-ingress-21366460 with uuid c7a804f3-e46c-496e-9764-442598cf70e0 found in kube manager
2024-10-28 01:51:31,802 - INFO - Ingress ctest-nginx-ingress-21366460 verification passed
2024-10-28 01:51:31,807 - DEBUG - Pod ctest-busybox-pod-67087247 not present
2024-10-28 01:51:31,807 - INFO - Creating Pod ctest-busybox-pod-67087247
2024-10-28 01:51:31,833 - DEBUG - Pod : ctest-busybox-pod-67087247 UUID is e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:51:31,851 - DEBUG - Pod ctest-nginx-pod-04851433 not in running state.Currently in Pending
2024-10-28 01:51:36,861 - DEBUG - Pod ctest-nginx-pod-04851433 not in running state.Currently in Pending
2024-10-28 01:51:41,870 - INFO - Pod ctest-nginx-pod-04851433 is in running state.Got IP 10.47.255.250
2024-10-28 01:51:41,937 - DEBUG - Pod ctest-nginx-pod-04851433 has vmi 24bdd764-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:51:41,937 - INFO - Verified pod ctest-nginx-pod-04851433 in contrail-api
2024-10-28 01:51:41,937 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:51:41,949 - DEBUG - VMI 24bdd764-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22
2024-10-28 01:51:41,949 - INFO - Verified Pod ctest-nginx-pod-04851433 in agent 10.0.0.22
2024-10-28 01:51:41,950 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=63ba5c21-c27b-4569-9bd2-5418005ae833
2024-10-28 01:51:41,957 - INFO - Pod ctest-nginx-pod-04851433 with uuid 63ba5c21-c27b-4569-9bd2-5418005ae833 found in kube manager
2024-10-28 01:51:41,957 - INFO - Pod ctest-nginx-pod-04851433 verification passed
2024-10-28 01:51:42,114 - DEBUG - [Pod ctest-nginx-pod-04851433] Cmd: echo ctest-nginx-pod-04851433 > /usr/share/nginx/html/index.html, Output:
2024-10-28 01:51:42,123 - INFO - Pod ctest-nginx-pod-53169016 is in running state.Got IP 10.47.255.249
2024-10-28 01:51:42,232 - DEBUG - Pod ctest-nginx-pod-53169016 has vmi 258af2a8-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:51:42,232 - INFO - Verified pod ctest-nginx-pod-53169016 in contrail-api
2024-10-28 01:51:42,232 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:51:42,245 - DEBUG - VMI 258af2a8-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22
2024-10-28 01:51:42,245 - INFO - Verified Pod ctest-nginx-pod-53169016 in agent 10.0.0.22
2024-10-28 01:51:42,246 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=37ec0817-88ca-465f-a267-98c20ee03058
2024-10-28 01:51:42,254 - INFO - Pod ctest-nginx-pod-53169016 with uuid 37ec0817-88ca-465f-a267-98c20ee03058 found in kube manager
2024-10-28 01:51:42,254 - INFO - Pod ctest-nginx-pod-53169016 verification passed
2024-10-28 01:51:42,375 - DEBUG - [Pod ctest-nginx-pod-53169016] Cmd: echo ctest-nginx-pod-53169016 > /usr/share/nginx/html/index.html, Output:
2024-10-28 01:51:42,381 - DEBUG - Pod ctest-busybox-pod-67087247 not in running state.Currently in Pending
2024-10-28 01:51:47,389 - DEBUG - Pod ctest-busybox-pod-67087247 not in running state.Currently in Pending
2024-10-28 01:51:52,398 - INFO - Pod ctest-busybox-pod-67087247 is in running state.Got IP 10.47.255.247
2024-10-28 01:51:52,461 - DEBUG - Pod ctest-busybox-pod-67087247 has vmi 2adbd56a-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:51:52,461 - INFO - Verified pod ctest-busybox-pod-67087247 in contrail-api
2024-10-28 01:51:52,461 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:51:52,477 - DEBUG - VMI 2adbd56a-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22
2024-10-28 01:51:52,477 - INFO - Verified Pod ctest-busybox-pod-67087247 in agent 10.0.0.22
2024-10-28 01:51:52,477 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:51:52,483 - INFO - Pod ctest-busybox-pod-67087247 with uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e found in kube manager
2024-10-28 01:51:52,484 - INFO - Pod ctest-busybox-pod-67087247 verification passed
2024-10-28 01:51:52,589 - DEBUG - [Pod ctest-busybox-pod-67087247] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-53169016
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-10-28 01:51:52,589 - DEBUG - [Pod Pod ctest-busybox-pod-67087247] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2024-10-28 01:51:52,589 - DEBUG - [Pod Pod ctest-busybox-pod-67087247] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-53169016
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-10-28 01:51:52,680 - DEBUG - [Pod ctest-busybox-pod-67087247] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-04851433
2024-10-28 01:51:52,680 - DEBUG - [Pod Pod ctest-busybox-pod-67087247] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2024-10-28 01:51:52,680 - DEBUG - [Pod Pod ctest-busybox-pod-67087247] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-04851433
2024-10-28 01:51:52,681 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-04851433': 1, 'ctest-nginx-pod-53169016': 1}
2024-10-28 01:51:52,681 - WARNING - Nothing to delete parallely
2024-10-28 01:51:52,681 - INFO - Deleting pod default:ctest-busybox-pod-67087247
2024-10-28 01:51:52,698 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:51:52,706 - WARNING - Pod uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e is still seen in agent 10.0.0.22 VM list
2024-10-28 01:51:57,707 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:51:57,714 - WARNING - Pod uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:02,715 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:52:02,724 - WARNING - Pod uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:07,726 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:52:07,733 - WARNING - Pod uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:12,734 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:52:12,741 - WARNING - Pod uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:17,742 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:52:17,749 - WARNING - Pod uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:22,750 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:52:22,759 - WARNING - Pod uuid e139c3b7-a07f-4122-be8d-da5ca290fb9e is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:27,759 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=e139c3b7-a07f-4122-be8d-da5ca290fb9e
2024-10-28 01:52:27,769 - DEBUG - Pod e139c3b7-a07f-4122-be8d-da5ca290fb9e is not in agent 10.0.0.22 VM list
2024-10-28 01:52:27,769 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2adbd56a-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:52:27,780 - DEBUG - VMI 2adbd56a-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22
2024-10-28 01:52:27,780 - INFO - Verified that pod ctest-busybox-pod-67087247 is removed in agent
2024-10-28 01:52:27,781 - INFO - Deleting Ingress : ctest-nginx-ingress-21366460
2024-10-28 01:52:27,788 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=c7a804f3-e46c-496e-9764-442598cf70e0
2024-10-28 01:52:27,794 - ERROR - Ingress ctest-nginx-ingress-21366460 with uuid c7a804f3-e46c-496e-9764-442598cf70e0 still found in kube manager
2024-10-28 01:52:28,794 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=c7a804f3-e46c-496e-9764-442598cf70e0
2024-10-28 01:52:28,801 - ERROR - Ingress ctest-nginx-ingress-21366460 with uuid c7a804f3-e46c-496e-9764-442598cf70e0 still found in kube manager
2024-10-28 01:52:29,802 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=c7a804f3-e46c-496e-9764-442598cf70e0
2024-10-28 01:52:29,807 - INFO - Ingress ctest-nginx-ingress-21366460 with uuid c7a804f3-e46c-496e-9764-442598cf70e0 deleted successfully from kube manager
2024-10-28 01:52:29,807 - INFO - Verifications on Ingress %s cleanup passed
2024-10-28 01:52:29,807 - INFO - Deleting the FIP pool __fip_pool_public__
2024-10-28 01:52:29,985 - DEBUG - Requesting: http://10.0.0.22:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-10-28 01:52:29,992 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2024-10-28 01:52:29,992 - INFO - Deleting VN __public__
2024-10-28 01:52:30,300 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/539f03e6-fe8d-4561-a557-33986a34b373
2024-10-28 01:52:30,307 - DEBUG - Response Code: 404
2024-10-28 01:52:30,307 - DEBUG - Requesting: http://10.0.0.22:8082/domains
2024-10-28 01:52:30,317 - DEBUG - Requesting: http://10.0.0.22:8082/domain/055fccc2-a3f0-4595-bc81-7ee1b5e7e191
2024-10-28 01:52:30,338 - DEBUG - Requesting: http://10.0.0.22:8082/project/a5908ba5-9d71-46bb-83fa-28493f0adc03
2024-10-28 01:52:30,428 - INFO - Validated that VN __public__ is not found in API Server
2024-10-28 01:52:30,428 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2024-10-28 01:52:30,440 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-28 01:52:30,464 - DEBUG - VN __public__ is not present in Agent 10.0.0.22
2024-10-28 01:52:30,464 - INFO - Validated that VN __public__ is not in any agent
2024-10-28 01:52:30,464 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-28 01:52:30,476 - DEBUG - Requesting: http://10.0.0.22:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-10-28 01:52:30,483 - DEBUG - Requesting: http://10.0.0.22:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-10-28 01:52:30,492 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2024-10-28 01:52:30,493 - INFO - Deleting pod default:ctest-nginx-pod-53169016
2024-10-28 01:52:30,504 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=37ec0817-88ca-465f-a267-98c20ee03058
2024-10-28 01:52:30,522 - WARNING - Pod uuid 37ec0817-88ca-465f-a267-98c20ee03058 is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:35,523 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=37ec0817-88ca-465f-a267-98c20ee03058
2024-10-28 01:52:35,530 - DEBUG - Pod 37ec0817-88ca-465f-a267-98c20ee03058 is not in agent 10.0.0.22 VM list
2024-10-28 01:52:35,530 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:258af2a8-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:52:35,538 - DEBUG - VMI 258af2a8-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22
2024-10-28 01:52:35,538 - INFO - Verified that pod ctest-nginx-pod-53169016 is removed in agent
2024-10-28 01:52:35,538 - INFO - Deleting pod default:ctest-nginx-pod-04851433
2024-10-28 01:52:35,573 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=63ba5c21-c27b-4569-9bd2-5418005ae833
2024-10-28 01:52:35,580 - WARNING - Pod uuid 63ba5c21-c27b-4569-9bd2-5418005ae833 is still seen in agent 10.0.0.22 VM list
2024-10-28 01:52:40,581 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=63ba5c21-c27b-4569-9bd2-5418005ae833
2024-10-28 01:52:40,589 - DEBUG - Pod 63ba5c21-c27b-4569-9bd2-5418005ae833 is not in agent 10.0.0.22 VM list
2024-10-28 01:52:40,589 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:24bdd764-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:52:40,596 - DEBUG - VMI 24bdd764-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22
2024-10-28 01:52:40,596 - INFO - Verified that pod ctest-nginx-pod-04851433 is removed in agent
2024-10-28 01:52:40,596 - INFO - Deleting service : ctest-nginx-svc-97737417
2024-10-28 01:52:41,212 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-28 01:52:41,219 - DEBUG - No XMPP flaps were noticed during the test
2024-10-28 01:52:41,219 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:19]
2024-10-28 01:52:41,219 - INFO - --------------------------------------------------------------------------------
2024-10-28 01:52:47,691 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-d7jhw_kube-system_1e8d69b0-4ac2-422d-999a-730ce3994885_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-10-28 01:52:47,945 - DEBUG - Output : cluster_project={}
2024-10-28 01:52:48,077 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-d7jhw_kube-system_1e8d69b0-4ac2-422d-999a-730ce3994885_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-10-28 01:52:48,518 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-10-28 01:52:48,566 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-d7jhw_kube-system_1e8d69b0-4ac2-422d-999a-730ce3994885_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-10-28 01:52:48,939 - DEBUG - Output : cluster_project={}
2024-10-28 01:52:59,265 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:09,397 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:09,530 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:09,668 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:09,799 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:09,907 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:10,021 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:10,153 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-28 01:53:10,451 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-28 01:53:13,682 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_ApplicationPolicySetReq?
2024-10-28 01:53:13,694 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AclReq?
2024-10-28 01:53:13,730 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AclReq?
2024-10-28 01:53:15,764 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AclReq?
2024-10-28 01:53:17,795 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AclReq?
2024-10-28 01:56:20,431 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-28 01:56:20,482 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=61b3affe-b6dc-4726-b8cb-caf70fbc51e5
2024-10-28 01:56:20,572 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=b30c98e0-8ab2-420c-ab3a-922f54552a14
2024-10-28 01:56:20,582 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:20,592 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:20,605 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:20,618 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=d18a029f-b5fd-41b6-bbb7-6bbffe505d3c
2024-10-28 01:56:20,641 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:20,648 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=546198af-85f6-4e9e-a794-06f9170d0539
2024-10-28 01:56:25,659 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=61b3affe-b6dc-4726-b8cb-caf70fbc51e5
2024-10-28 01:56:25,669 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:573d8b08-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:56:25,687 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:25,689 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=546198af-85f6-4e9e-a794-06f9170d0539
2024-10-28 01:56:25,691 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:25,692 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:25,693 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=b30c98e0-8ab2-420c-ab3a-922f54552a14
2024-10-28 01:56:25,695 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=d18a029f-b5fd-41b6-bbb7-6bbffe505d3c
2024-10-28 01:56:25,696 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:25,711 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5937a484-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:56:25,744 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:59fccf7a-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:56:30,714 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:30,741 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:30,744 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:30,746 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=b30c98e0-8ab2-420c-ab3a-922f54552a14
2024-10-28 01:56:30,747 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:35,723 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:35,761 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:35,763 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=b30c98e0-8ab2-420c-ab3a-922f54552a14
2024-10-28 01:56:35,765 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:35,766 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:40,731 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:40,783 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:40,785 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=b30c98e0-8ab2-420c-ab3a-922f54552a14
2024-10-28 01:56:40,786 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:40,788 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:45,739 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:45,805 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:45,807 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:45,808 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:45,809 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=b30c98e0-8ab2-420c-ab3a-922f54552a14
2024-10-28 01:56:50,747 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:50,825 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:50,827 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:50,835 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:50,838 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=b30c98e0-8ab2-420c-ab3a-922f54552a14
2024-10-28 01:56:50,870 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5811a51e-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:56:55,773 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=2339be5e-a2e9-494c-a3a8-13c14fb30df8
2024-10-28 01:56:55,782 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5da75014-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:56:55,873 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=8ed23183-1092-4e5e-834e-018a31680876
2024-10-28 01:56:55,875 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=be871133-df68-4c52-9936-c3040ac2603f
2024-10-28 01:56:55,877 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_VmListReq?uuid=06ff3838-97be-45f9-93a3-ed9c7a05cc33
2024-10-28 01:56:55,888 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5bdf6c3a-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:56:55,892 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5cc6800c-94cf-11ef-bc8e-0242a74f58e7
2024-10-28 01:56:55,894 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5ae26e2c-94cf-11ef-bc8e-0242a74f58e7