2025-04-21 10:50:29,697 - DEBUG - [10.0.0.50]: Running cmd : hostname
2025-04-21 10:50:30,017 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-k8s-339-1.novalocal
2025-04-21 10:50:30,018 - DEBUG - [10.0.0.50]: Running cmd : hostname -f
2025-04-21 10:50:30,163 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-k8s-339-1.novalocal
2025-04-21 10:50:30,164 - DEBUG - [10.0.0.50]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-04-21 10:50:30,412 - DEBUG - Output : NAMES
contrail_test_HYzUquqkQ
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
kubemanager_k8s_kubemanager_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_kafka_1
analytics_collector_1
analytics_nodemgr_1
analytics_api_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_nodemgr_1
control_control_1
control_dns_1
webui_job_1
webui_web_1
config_devicemgr_1
config_dnsmasq_1
config_api_1
config_nodemgr_1
config_svcmonitor_1
config_schema_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
2025-04-21 10:50:30,413 - DEBUG - [10.0.0.50]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-04-21 10:50:30,571 - DEBUG - Output : 172.17.0.1/16
10.0.0.50/24
2025-04-21 10:50:30,571 - DEBUG - [10.0.0.50]: Running cmd : getent hosts 10.0.0.50 | head -n 1 | awk '{print $2}'
2025-04-21 10:50:30,720 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-k8s-339-1.novalocal
2025-04-21 10:50:30,720 - DEBUG - [10.0.0.50]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-04-21 10:50:30,880 - DEBUG - Output : 10.0.0.50/24
2025-04-21 10:50:31,199 - INFO - Using existing project ['default-domain', 'k8s-default'](ad857fae-b4bf-41eb-981d-51e133405d99)
2025-04-21 10:50:31,318 - INFO - Using existing project ['default-domain', 'k8s-default'](ad857fae-b4bf-41eb-981d-51e133405d99)
2025-04-21 10:50:31,481 - INFO - ================================================================================
2025-04-21 10:50:31,482 - INFO - STARTING TEST : test_ingress_ip_assignment
2025-04-21 10:50:31,482 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2025-04-21 10:50:31,752 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-21 10:50:31,762 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.50': '0'}} with
2025-04-21 10:50:31,762 - INFO - Initial checks done. Running the testcase now
2025-04-21 10:50:31,762 - INFO -
2025-04-21 10:50:31,767 - INFO - Namespace default already exists
2025-04-21 10:50:31,767 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-04-21 10:50:31,983 - DEBUG - Output : cluster_project={}
2025-04-21 10:50:32,046 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2025-04-21 10:50:32,046 - DEBUG - Project uuid in Contrail is ad857fae-b4bf-41eb-981d-51e133405d99
2025-04-21 10:50:32,047 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-04-21 10:50:32,247 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-04-21 10:50:32,247 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=0d80d521-beac-4fe8-9cef-3d5b38077346
2025-04-21 10:50:32,252 - INFO - Namespace default with uuid 0d80d521-beac-4fe8-9cef-3d5b38077346 found in kube manager
2025-04-21 10:50:32,253 - INFO - Namespace default verification passed
2025-04-21 10:50:32,257 - DEBUG - Service ctest-nginx-svc-10627377 not present
2025-04-21 10:50:32,257 - INFO - Creating service ctest-nginx-svc-10627377
2025-04-21 10:50:32,278 - INFO - Created Service ctest-nginx-svc-10627377
2025-04-21 10:50:32,288 - DEBUG - Pod ctest-nginx-pod-89444620 not present
2025-04-21 10:50:32,289 - INFO - Creating Pod ctest-nginx-pod-89444620
2025-04-21 10:50:32,352 - DEBUG - Pod : ctest-nginx-pod-89444620 UUID is 3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a
2025-04-21 10:50:32,357 - DEBUG - Pod ctest-nginx-pod-20211068 not present
2025-04-21 10:50:32,357 - INFO - Creating Pod ctest-nginx-pod-20211068
2025-04-21 10:50:32,410 - DEBUG - Pod : ctest-nginx-pod-20211068 UUID is 3f6e9226-f2df-4482-82e9-49f2748ad897
2025-04-21 10:50:32,617 - INFO - Created VN __public__, UUID :39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:32,767 - DEBUG - Requesting: http://10.0.0.50:8082/domains
2025-04-21 10:50:32,775 - DEBUG - Requesting: http://10.0.0.50:8082/domain/730d7f74-bf6f-4ab7-a74f-259518789a81
2025-04-21 10:50:32,791 - DEBUG - Requesting: http://10.0.0.50:8082/project/ad857fae-b4bf-41eb-981d-51e133405d99
2025-04-21 10:50:32,846 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:32,861 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:32,875 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:50:32,889 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:50:32,898 - DEBUG - Route Targets: []
2025-04-21 10:50:32,898 - DEBUG - RT names not yet present for VN __public__
2025-04-21 10:50:37,899 - DEBUG - Requesting: http://10.0.0.50:8082/domains
2025-04-21 10:50:37,906 - DEBUG - Requesting: http://10.0.0.50:8082/domain/730d7f74-bf6f-4ab7-a74f-259518789a81
2025-04-21 10:50:37,918 - DEBUG - Requesting: http://10.0.0.50:8082/project/ad857fae-b4bf-41eb-981d-51e133405d99
2025-04-21 10:50:37,975 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:37,988 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:38,004 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:50:38,013 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:50:38,021 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/b8e9d4d4-1f16-43fd-abdb-69127259bf48
2025-04-21 10:50:38,029 - DEBUG - Route Targets: ['target:64512:8000007']
2025-04-21 10:50:38,029 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:38,040 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:50:38,061 - INFO - Verified VN network id 15 for VN 39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:38,061 - INFO - Verifications in API Server for VN __public__ passed
2025-04-21 10:50:38,061 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:38,074 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:50:38,085 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:50:38,094 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/b8e9d4d4-1f16-43fd-abdb-69127259bf48
2025-04-21 10:50:38,103 - DEBUG - Requesting: http://10.0.0.50:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-04-21 10:50:38,112 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4152560506973339755', 'uuid-lslong': '11533536374705312742'}, 'enable': 'true', 'created': '2025-04-21T10:50:32', 'last-modified': '2025-04-21T10:50:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.418377'}
2025-04-21 10:50:38,112 - DEBUG - Requesting: http://10.0.0.50:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-04-21 10:50:38,124 - DEBUG - Route Targets: ['target:64512:8000007']
2025-04-21 10:50:38,124 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2025-04-21 10:50:38,125 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2025-04-21 10:50:38,125 - DEBUG - Requesting: http://10.0.0.50:8082/domains
2025-04-21 10:50:38,131 - DEBUG - Requesting: http://10.0.0.50:8082/domain/730d7f74-bf6f-4ab7-a74f-259518789a81
2025-04-21 10:50:38,139 - DEBUG - Requesting: http://10.0.0.50:8082/project/ad857fae-b4bf-41eb-981d-51e133405d99
2025-04-21 10:50:38,193 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:38,203 - DEBUG - =>VN __public__ has no policy to be verified
2025-04-21 10:50:38,203 - DEBUG - Verifying the vn in opserver
2025-04-21 10:50:38,203 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.50
2025-04-21 10:50:38,204 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-04-21 10:50:38,209 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2025-04-21 10:50:38,209 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2025-04-21 10:50:38,210 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-21 10:50:38,220 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-21 10:50:38,230 - DEBUG - Do not have enough data to verify VN in agent
2025-04-21 10:50:38,230 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-21 10:50:38,240 - DEBUG - VRF ids for VN __public__: {}
2025-04-21 10:50:38,364 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2025-04-21 10:50:38,461 - DEBUG - Requesting: http://10.0.0.50:8082/domains
2025-04-21 10:50:38,468 - DEBUG - Requesting: http://10.0.0.50:8082/domain/730d7f74-bf6f-4ab7-a74f-259518789a81
2025-04-21 10:50:38,478 - DEBUG - Requesting: http://10.0.0.50:8082/project/ad857fae-b4bf-41eb-981d-51e133405d99
2025-04-21 10:50:38,537 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:38,549 - DEBUG - Requesting: http://10.0.0.50:8082/floating-ip-pool/551bc6dc-adb9-45f6-92f3-76c70f719a43
2025-04-21 10:50:38,556 - DEBUG - Requesting: http://10.0.0.50:8082/domains
2025-04-21 10:50:38,570 - DEBUG - Requesting: http://10.0.0.50:8082/domain/730d7f74-bf6f-4ab7-a74f-259518789a81
2025-04-21 10:50:38,579 - DEBUG - Requesting: http://10.0.0.50:8082/project/ad857fae-b4bf-41eb-981d-51e133405d99
2025-04-21 10:50:38,636 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/39a0dbc7-a676-406b-a00f-5a39ba5b53e6
2025-04-21 10:50:38,649 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2025-04-21 10:50:38,649 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2025-04-21 10:50:38,660 - DEBUG - Requesting: http://10.0.0.50:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-04-21 10:50:38,669 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2025-04-21 10:50:38,670 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2025-04-21 10:50:38,676 - DEBUG - Ingress ctest-nginx-ingress-17603108 not present
2025-04-21 10:50:38,676 - INFO - Creating Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:38,685 - INFO - Created Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:38,688 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:41,694 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:44,699 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:47,704 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:50,709 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:53,715 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:56,722 - DEBUG - For Ingress ctest-nginx-ingress-17603108, Cluster IP: 10.47.255.246, External IPs ['4.5.76.60']
2025-04-21 10:50:56,722 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-17603108
2025-04-21 10:50:56,722 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:50:56,729 - INFO - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 found in kube manager
2025-04-21 10:50:56,729 - INFO - Ingress ctest-nginx-ingress-17603108 verification passed
2025-04-21 10:50:56,734 - DEBUG - Pod ctest-busybox-pod-03629665 not present
2025-04-21 10:50:56,734 - INFO - Creating Pod ctest-busybox-pod-03629665
2025-04-21 10:50:56,776 - DEBUG - Pod : ctest-busybox-pod-03629665 UUID is e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:50:56,790 - DEBUG - Pod ctest-nginx-pod-89444620 not in running state.Currently in Pending
2025-04-21 10:51:01,798 - INFO - Pod ctest-nginx-pod-89444620 is in running state.Got IP 10.47.255.248
2025-04-21 10:51:01,816 - DEBUG - Pod ctest-nginx-pod-89444620 has vmi 76e15576-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:51:01,816 - INFO - Verified pod ctest-nginx-pod-89444620 in contrail-api
2025-04-21 10:51:01,817 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:51:01,833 - DEBUG - VMI 76e15576-1e9e-11f0-9ac8-fa163e3b4d6b is active in agent 10.0.0.50
2025-04-21 10:51:01,834 - INFO - Verified Pod ctest-nginx-pod-89444620 in agent 10.0.0.50
2025-04-21 10:51:01,835 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a
2025-04-21 10:51:01,842 - INFO - Pod ctest-nginx-pod-89444620 with uuid 3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a found in kube manager
2025-04-21 10:51:01,842 - INFO - Pod ctest-nginx-pod-89444620 verification passed
2025-04-21 10:51:01,902 - DEBUG - [Pod ctest-nginx-pod-89444620] Cmd: echo ctest-nginx-pod-89444620 > /usr/share/nginx/html/index.html, Output:
2025-04-21 10:51:01,913 - DEBUG - Pod ctest-nginx-pod-20211068 not in running state.Currently in Pending
2025-04-21 10:51:06,920 - INFO - Pod ctest-nginx-pod-20211068 is in running state.Got IP 10.47.255.247
2025-04-21 10:51:06,938 - DEBUG - Pod ctest-nginx-pod-20211068 has vmi 7a400776-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:51:06,938 - INFO - Verified pod ctest-nginx-pod-20211068 in contrail-api
2025-04-21 10:51:06,938 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:51:06,956 - DEBUG - VMI 7a400776-1e9e-11f0-9ac8-fa163e3b4d6b is active in agent 10.0.0.50
2025-04-21 10:51:06,956 - INFO - Verified Pod ctest-nginx-pod-20211068 in agent 10.0.0.50
2025-04-21 10:51:06,956 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=3f6e9226-f2df-4482-82e9-49f2748ad897
2025-04-21 10:51:06,962 - INFO - Pod ctest-nginx-pod-20211068 with uuid 3f6e9226-f2df-4482-82e9-49f2748ad897 found in kube manager
2025-04-21 10:51:06,963 - INFO - Pod ctest-nginx-pod-20211068 verification passed
2025-04-21 10:51:07,024 - DEBUG - [Pod ctest-nginx-pod-20211068] Cmd: echo ctest-nginx-pod-20211068 > /usr/share/nginx/html/index.html, Output:
2025-04-21 10:51:07,031 - DEBUG - Pod ctest-busybox-pod-03629665 not in running state.Currently in Pending
2025-04-21 10:51:12,039 - DEBUG - Pod ctest-busybox-pod-03629665 not in running state.Currently in Pending
2025-04-21 10:51:17,048 - INFO - Pod ctest-busybox-pod-03629665 is in running state.Got IP 10.47.255.245
2025-04-21 10:51:17,067 - DEBUG - Pod ctest-busybox-pod-03629665 has vmi 84e8172c-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:51:17,067 - INFO - Verified pod ctest-busybox-pod-03629665 in contrail-api
2025-04-21 10:51:17,067 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:51:17,083 - DEBUG - VMI 84e8172c-1e9e-11f0-9ac8-fa163e3b4d6b is active in agent 10.0.0.50
2025-04-21 10:51:17,084 - INFO - Verified Pod ctest-busybox-pod-03629665 in agent 10.0.0.50
2025-04-21 10:51:17,084 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:17,091 - INFO - Pod ctest-busybox-pod-03629665 with uuid e0bb7697-4669-414d-84e4-a2699b304992 found in kube manager
2025-04-21 10:51:17,091 - INFO - Pod ctest-busybox-pod-03629665 verification passed
2025-04-21 10:51:17,146 - DEBUG - [Pod ctest-busybox-pod-03629665] Cmd: wget http://10.47.255.246:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.246:80 (10.47.255.246:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-89444620
2025-04-21 10:51:17,147 - DEBUG - [Pod Pod ctest-busybox-pod-03629665] Cmd wget http://10.47.255.246:80/ -O - -T 5 -t 1 passed
2025-04-21 10:51:17,147 - DEBUG - [Pod Pod ctest-busybox-pod-03629665] Cmd output: Connecting to 10.47.255.246:80 (10.47.255.246:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-89444620
2025-04-21 10:51:17,201 - DEBUG - [Pod ctest-busybox-pod-03629665] Cmd: wget http://10.47.255.246:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.246:80 (10.47.255.246:80)
ctest-nginx-pod-20211068
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-04-21 10:51:17,202 - DEBUG - [Pod Pod ctest-busybox-pod-03629665] Cmd wget http://10.47.255.246:80/ -O - -T 5 -t 1 passed
2025-04-21 10:51:17,202 - DEBUG - [Pod Pod ctest-busybox-pod-03629665] Cmd output: Connecting to 10.47.255.246:80 (10.47.255.246:80)
ctest-nginx-pod-20211068
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-04-21 10:51:17,202 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-89444620': 1, 'ctest-nginx-pod-20211068': 1}
2025-04-21 10:51:17,202 - WARNING - Nothing to delete parallely
2025-04-21 10:51:17,202 - INFO - Deleting pod default:ctest-busybox-pod-03629665
2025-04-21 10:51:17,212 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:17,222 - WARNING - Pod uuid e0bb7697-4669-414d-84e4-a2699b304992 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:51:22,223 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:22,230 - WARNING - Pod uuid e0bb7697-4669-414d-84e4-a2699b304992 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:51:27,230 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:27,237 - WARNING - Pod uuid e0bb7697-4669-414d-84e4-a2699b304992 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:51:32,238 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:32,246 - WARNING - Pod uuid e0bb7697-4669-414d-84e4-a2699b304992 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:51:37,247 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:37,257 - WARNING - Pod uuid e0bb7697-4669-414d-84e4-a2699b304992 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:51:42,258 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:42,265 - WARNING - Pod uuid e0bb7697-4669-414d-84e4-a2699b304992 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:51:47,265 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:47,277 - WARNING - Pod uuid e0bb7697-4669-414d-84e4-a2699b304992 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:51:52,277 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e0bb7697-4669-414d-84e4-a2699b304992
2025-04-21 10:51:52,284 - DEBUG - Pod e0bb7697-4669-414d-84e4-a2699b304992 is not in agent 10.0.0.50 VM list
2025-04-21 10:51:52,284 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:84e8172c-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:51:52,290 - DEBUG - VMI 84e8172c-1e9e-11f0-9ac8-fa163e3b4d6b is removed from agent 10.0.0.50
2025-04-21 10:51:52,290 - INFO - Verified that pod ctest-busybox-pod-03629665 is removed in agent
2025-04-21 10:51:52,290 - INFO - Deleting Ingress : ctest-nginx-ingress-17603108
2025-04-21 10:51:52,298 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:51:52,305 - ERROR - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 still found in kube manager
2025-04-21 10:51:53,306 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:51:53,312 - ERROR - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 still found in kube manager
2025-04-21 10:51:54,312 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:51:54,317 - ERROR - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 still found in kube manager
2025-04-21 10:51:55,319 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:51:55,324 - ERROR - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 still found in kube manager
2025-04-21 10:51:56,325 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:51:56,330 - ERROR - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 still found in kube manager
2025-04-21 10:51:57,331 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:51:57,337 - ERROR - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 still found in kube manager
2025-04-21 10:51:58,337 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=f8dd4236-b74a-423b-a7aa-36797ebb3b33
2025-04-21 10:51:58,344 - INFO - Ingress ctest-nginx-ingress-17603108 with uuid f8dd4236-b74a-423b-a7aa-36797ebb3b33 deleted successfully from kube manager
2025-04-21 10:51:58,344 - INFO - Verifications on Ingress %s cleanup passed
2025-04-21 10:51:58,344 - INFO - Deleting the FIP pool __fip_pool_public__
2025-04-21 10:51:58,532 - DEBUG - Requesting: http://10.0.0.50:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-04-21 10:51:58,538 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2025-04-21 10:51:58,539 - INFO - Deleting VN __public__
2025-04-21 10:51:58,801 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/99bef6e7-ab7f-4dca-b6ce-e730cb5e788c
2025-04-21 10:51:58,807 - DEBUG - Response Code: 404
2025-04-21 10:51:58,807 - DEBUG - Requesting: http://10.0.0.50:8082/domains
2025-04-21 10:51:58,818 - DEBUG - Requesting: http://10.0.0.50:8082/domain/730d7f74-bf6f-4ab7-a74f-259518789a81
2025-04-21 10:51:58,830 - DEBUG - Requesting: http://10.0.0.50:8082/project/ad857fae-b4bf-41eb-981d-51e133405d99
2025-04-21 10:51:58,884 - INFO - Validated that VN __public__ is not found in API Server
2025-04-21 10:51:58,884 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2025-04-21 10:51:58,893 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-21 10:51:58,902 - DEBUG - VN __public__ is not present in Agent 10.0.0.50
2025-04-21 10:51:58,902 - INFO - Validated that VN __public__ is not in any agent
2025-04-21 10:51:58,903 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-21 10:51:58,909 - DEBUG - Requesting: http://10.0.0.50:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-04-21 10:51:58,917 - DEBUG - Requesting: http://10.0.0.50:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-04-21 10:51:58,924 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2025-04-21 10:51:58,924 - INFO - Deleting pod default:ctest-nginx-pod-20211068
2025-04-21 10:51:58,947 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=3f6e9226-f2df-4482-82e9-49f2748ad897
2025-04-21 10:51:58,958 - WARNING - Pod uuid 3f6e9226-f2df-4482-82e9-49f2748ad897 is still seen in agent 10.0.0.50 VM list
2025-04-21 10:52:03,958 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=3f6e9226-f2df-4482-82e9-49f2748ad897
2025-04-21 10:52:03,981 - DEBUG - Pod 3f6e9226-f2df-4482-82e9-49f2748ad897 is not in agent 10.0.0.50 VM list
2025-04-21 10:52:03,981 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7a400776-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:52:04,003 - DEBUG - VMI 7a400776-1e9e-11f0-9ac8-fa163e3b4d6b is removed from agent 10.0.0.50
2025-04-21 10:52:04,003 - INFO - Verified that pod ctest-nginx-pod-20211068 is removed in agent
2025-04-21 10:52:04,004 - INFO - Deleting pod default:ctest-nginx-pod-89444620
2025-04-21 10:52:04,024 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a
2025-04-21 10:52:04,033 - WARNING - Pod uuid 3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a is still seen in agent 10.0.0.50 VM list
2025-04-21 10:52:09,034 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a
2025-04-21 10:52:09,041 - DEBUG - Pod 3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a is not in agent 10.0.0.50 VM list
2025-04-21 10:52:09,041 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:76e15576-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:52:09,050 - WARNING - VMI 76e15576-1e9e-11f0-9ac8-fa163e3b4d6b of Pod ctest-nginx-pod-89444620 is still seen in agent 10.0.0.50
2025-04-21 10:52:09,050 - DEBUG - [{'index': '7', 'name': 'tapeth0-3dd6fb', 'uuid': '76e15576-1e9e-11f0-9ac8-fa163e3b4d6b', 'vrf_name': '--ERROR--', 'active': 'Inactive < vn-null vrf-null os-state-down ipv4_inactive ipv6_inactive l2_inactive >', 'ipv4_active': 'Ipv4 Inactive < vn-null vrf-null os-state-down l3-disabled >', 'l2_active': 'L2 Inactive < vn-null vrf-null os-state-down l2-disabled >', 'ip6_active': 'Ipv6 Inactive < vn-null vrf-null os-state-down l3-disabled no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '-1', 'l2_label': '-1', 'vxlan_id': '0', 'vn_name': None, 'vm_uuid': None, 'vm_name': None, 'ip_addr': '10.47.255.248', 'mac_addr': '02:76:e1:55:76:1e', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '18', 'fabric_port': 'FabricPort', 'alloc_linklocal_ip': 'LL-Disable', 'analyzer_name': None, 'config_name': None, 'sg_uuid_list': [], 'static_route_list': None, 'vm_project_uuid': '00000000-0000-0000-0000-000000000000', 'admin_state': 'Enabled', 'flow_key_idx': '0', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Invalid', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Inactive', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}]
2025-04-21 10:52:14,052 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a
2025-04-21 10:52:14,060 - DEBUG - Pod 3dd6fb47-f8b0-4f1d-b8c4-4716d8ddba2a is not in agent 10.0.0.50 VM list
2025-04-21 10:52:14,060 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:76e15576-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:52:14,066 - DEBUG - VMI 76e15576-1e9e-11f0-9ac8-fa163e3b4d6b is removed from agent 10.0.0.50
2025-04-21 10:52:14,066 - INFO - Verified that pod ctest-nginx-pod-89444620 is removed in agent
2025-04-21 10:52:14,067 - INFO - Deleting service : ctest-nginx-svc-10627377
2025-04-21 10:52:14,602 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-21 10:52:14,610 - DEBUG - No XMPP flaps were noticed during the test
2025-04-21 10:52:14,610 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:43]
2025-04-21 10:52:14,610 - INFO - --------------------------------------------------------------------------------
2025-04-21 10:52:21,042 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-04-21 10:52:21,292 - DEBUG - Output : cluster_project={}
2025-04-21 10:52:21,346 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-04-21 10:52:21,562 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-04-21 10:52:21,568 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-04-21 10:52:21,822 - DEBUG - Output : cluster_project={}
2025-04-21 10:52:23,835 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-04-21 10:52:24,044 - DEBUG - Output : cluster_project={}
2025-04-21 10:52:44,170 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:52:59,245 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:52:59,304 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:53:04,365 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:53:24,448 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:53:24,496 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:53:24,543 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:53:24,597 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-21 10:53:25,194 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-21 10:53:35,496 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_ApplicationPolicySetReq?
2025-04-21 10:53:35,504 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AclReq?
2025-04-21 10:53:35,543 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AclReq?
2025-04-21 10:53:37,589 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AclReq?
2025-04-21 10:53:39,638 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AclReq?
2025-04-21 10:53:41,673 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AclReq?
2025-04-21 10:56:42,223 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-21 10:56:42,259 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=f9fcc241-22b3-42e6-89d0-cfb510c000d9
2025-04-21 10:56:42,327 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=46c5a6e7-0dcb-4cf0-b56e-741b6ed63228
2025-04-21 10:56:42,338 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:56:42,346 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:56:42,355 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:56:42,361 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=773811a7-e295-4aff-9db8-4a1df654a839
2025-04-21 10:56:42,367 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=29a00533-49c1-4af0-ab24-760b7d8a019c
2025-04-21 10:56:42,376 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:56:47,319 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=f9fcc241-22b3-42e6-89d0-cfb510c000d9
2025-04-21 10:56:47,439 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=46c5a6e7-0dcb-4cf0-b56e-741b6ed63228
2025-04-21 10:56:47,441 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:56:47,443 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:56:47,448 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:56:47,450 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=773811a7-e295-4aff-9db8-4a1df654a839
2025-04-21 10:56:47,452 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=29a00533-49c1-4af0-ab24-760b7d8a019c
2025-04-21 10:56:47,464 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:56:47,520 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c2a3dd4e-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:56:52,329 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=f9fcc241-22b3-42e6-89d0-cfb510c000d9
2025-04-21 10:56:52,465 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:56:52,479 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:56:52,486 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=46c5a6e7-0dcb-4cf0-b56e-741b6ed63228
2025-04-21 10:56:52,492 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bf1ca7b4-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:56:52,519 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:56:52,521 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:56:52,523 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=29a00533-49c1-4af0-ab24-760b7d8a019c
2025-04-21 10:56:52,537 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c5756704-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:56:57,339 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=f9fcc241-22b3-42e6-89d0-cfb510c000d9
2025-04-21 10:56:57,473 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:56:57,487 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:56:57,536 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:56:57,539 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:57:02,347 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=f9fcc241-22b3-42e6-89d0-cfb510c000d9
2025-04-21 10:57:02,362 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bcd9d6f2-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:57:02,482 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:57:02,497 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:57:02,549 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:57:02,551 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:57:07,490 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:57:07,504 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:57:07,566 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:57:07,568 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:57:12,498 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:57:12,512 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:57:12,579 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:57:12,582 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:57:17,507 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:57:17,521 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:57:17,590 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=e8ffac68-4cb7-4818-af12-e9bb95d3176c
2025-04-21 10:57:17,596 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=c5bc49de-5f18-4ae0-9cd5-dba21ac3f6a7
2025-04-21 10:57:17,599 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c98569c0-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:57:17,610 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d0c745fa-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:57:22,520 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=7c4aa775-1a22-4c19-85d6-efb07b64a604
2025-04-21 10:57:22,527 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ce8b48ea-1e9e-11f0-9ac8-fa163e3b4d6b
2025-04-21 10:57:22,529 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:57:27,540 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VmListReq?uuid=6b269e81-e16d-4334-a188-7908950117ad
2025-04-21 10:57:27,548 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cb292050-1e9e-11f0-9ac8-fa163e3b4d6b