2024-10-28 16:29:28,313 - INFO - Domain Default found not creating 2024-10-28 16:29:28,506 - INFO - Project ctest-AnalyticsBasicTestSanity-16072396 not found, creating it 2024-10-28 16:29:29,058 - INFO - Created Project:ctest-AnalyticsBasicTestSanity-16072396, ID : 6873ac78-f1f7-4e91-b262-7c0b400ba46d 2024-10-28 16:29:30,638 - INFO - ================================================================================ 2024-10-28 16:29:30,639 - INFO - STARTING TEST : test_verify_object_logs 2024-10-28 16:29:30,639 - INFO - TEST DESCRIPTION : Description: Test to validate object logs 1.Create vn/vm and verify object log tables updated with those vn, vm and routing-instance - fails otherwise Maintainer: sandipd@juniper.net 2024-10-28 16:29:30,768 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.20.0.31': '0'}} with 2024-10-28 16:29:30,768 - INFO - Initial checks done. Running the testcase now 2024-10-28 16:29:30,768 - INFO - 2024-10-28 16:29:31,698 - DEBUG - Response for create_network : {'network': {'id': '7d826f86-2704-4951-914e-8cb78a0470a9', 'name': 'ctest-vn22-65975091', 'tenant_id': '6873ac78f1f74e91b2627c0b400ba46d', 'project_id': '6873ac78f1f74e91b2627c0b400ba46d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-16072396', 'ctest-vn22-65975091'], 'port_security_enabled': True, 'description': ''}} 2024-10-28 16:29:31,930 - DEBUG - Response for create_subnet : {'subnet': {'id': '174ab6a5-c82a-4d17-a18b-c4342cfaa51f', 'name': '', 'tenant_id': '6873ac78f1f74e91b2627c0b400ba46d', 'network_id': '7d826f86-2704-4951-914e-8cb78a0470a9', 'ip_version': 4, 'cidr': '51.110.122.0/26', 'allocation_pools': [{'start': '51.110.122.2', 'end': '51.110.122.62'}], 'gateway_ip': '51.110.122.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '51.110.122.2', 'tags': [], 'project_id': '6873ac78f1f74e91b2627c0b400ba46d'}} 2024-10-28 16:29:31,953 - INFO - Created VN ctest-vn22-65975091 2024-10-28 16:29:32,016 - DEBUG - VN ctest-vn22-65975091 UUID is 7d826f86-2704-4951-914e-8cb78a0470a9 2024-10-28 16:29:32,140 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-10-28 16:29:32,433 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-10-28 16:29:32,467 - DEBUG - Requesting: http://10.0.0.40:8082/domain/5274d552-d800-4c4f-90d0-debc9940531b 2024-10-28 16:29:32,493 - DEBUG - Requesting: http://10.0.0.40:8082/project/6873ac78-f1f7-4e91-b262-7c0b400ba46d 2024-10-28 16:29:32,584 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/7d826f86-2704-4951-914e-8cb78a0470a9 2024-10-28 16:29:32,602 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/7d826f86-2704-4951-914e-8cb78a0470a9 2024-10-28 16:29:32,616 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/e694c813-5f2b-432b-b72e-fe28263a88a0 2024-10-28 16:29:32,625 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/e694c813-5f2b-432b-b72e-fe28263a88a0 2024-10-28 16:29:32,634 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/61dac938-3f33-48df-a7b5-f592e9299284 2024-10-28 16:29:32,642 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-28 16:29:32,642 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/7d826f86-2704-4951-914e-8cb78a0470a9 2024-10-28 16:29:32,657 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/e694c813-5f2b-432b-b72e-fe28263a88a0 2024-10-28 16:29:32,678 - INFO - Verified VN network id 6 for VN 7d826f86-2704-4951-914e-8cb78a0470a9 2024-10-28 16:29:32,678 - INFO - Verifications in API Server for VN ctest-vn22-65975091 passed 2024-10-28 16:29:32,678 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/7d826f86-2704-4951-914e-8cb78a0470a9 2024-10-28 16:29:32,693 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/e694c813-5f2b-432b-b72e-fe28263a88a0 2024-10-28 16:29:32,703 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/e694c813-5f2b-432b-b72e-fe28263a88a0 2024-10-28 16:29:32,712 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/61dac938-3f33-48df-a7b5-f592e9299284 2024-10-28 16:29:32,720 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091 2024-10-28 16:29:32,726 - DEBUG - Control-node 10.0.0.40 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsBasicTestSanity-16072396', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9043913623684270417', 'uuid-lslong': '10470460903605432489'}, 'enable': 'true', 'created': '2024-10-28T16:29:31', 'last-modified': '2024-10-28T16:29:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.833812'} 2024-10-28 16:29:32,726 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091 2024-10-28 16:29:32,733 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-28 16:29:32,733 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn22-65975091 passed 2024-10-28 16:29:32,734 - DEBUG - ====Verifying policy data for ctest-vn22-65975091 in API_Server ====== 2024-10-28 16:29:32,734 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-10-28 16:29:32,740 - DEBUG - Requesting: http://10.0.0.40:8082/domain/5274d552-d800-4c4f-90d0-debc9940531b 2024-10-28 16:29:32,755 - DEBUG - Requesting: http://10.0.0.40:8082/project/6873ac78-f1f7-4e91-b262-7c0b400ba46d 2024-10-28 16:29:32,846 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/7d826f86-2704-4951-914e-8cb78a0470a9 2024-10-28 16:29:32,864 - DEBUG - =>VN ctest-vn22-65975091 has no policy to be verified 2024-10-28 16:29:32,864 - DEBUG - Verifying the vn in opserver 2024-10-28 16:29:32,864 - DEBUG - Verifying the default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091 virtual network link through opserver 10.0.0.40 2024-10-28 16:29:32,865 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2024-10-28 16:29:33,164 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2024-10-28 16:29:33,228 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'href': 'http://10.0.0.40:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091?flat'} 2024-10-28 16:29:33,228 - INFO - Validated that VN default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091 is found in opserver 2024-10-28 16:29:33,242 - DEBUG - Do not have enough data to verify VN in agent 2024-10-28 16:29:33,247 - DEBUG - VRF ids for VN ctest-vn22-65975091: {} 2024-10-28 16:29:33,357 - DEBUG - Services list from nova: [, , ] 2024-10-28 16:29:33,472 - DEBUG - Image by name cirros not found 2024-10-28 16:29:33,472 - DEBUG - Installing image cirros 2024-10-28 16:29:33,472 - DEBUG - Image info {'name': 'cirros-0.3.0-x86_64-disk.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'cubswin:)', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'vcpath': '/images/vcenter/', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2024-10-28 16:29:33,473 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz 2024-10-28 16:29:33,473 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz 2024-10-28 16:29:33,483 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz -O /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz 2024-10-28 16:29:33,648 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz 2024-10-28 16:29:33,648 - DEBUG - Unzip image 2024-10-28 16:29:33,648 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz 2024-10-28 16:29:33,770 - DEBUG - Try to create image in user context 2024-10-28 16:29:34,004 - DEBUG - Image has been created in user context 2024-10-28 16:29:34,005 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk 2024-10-28 16:29:34,017 - DEBUG - Downloaded image has been removed 2024-10-28 16:29:34,043 - DEBUG - Uploaded image status = active 2024-10-28 16:29:36,689 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2168-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2168-1) 2024-10-28 16:29:36,731 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-10-28 16:29:41,856 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-10-28 16:29:46,956 - DEBUG - VM is in ACTIVE state now 2024-10-28 16:29:46,956 - DEBUG - Verifying ObjectVNTable for vn default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091 on analytics node 10.0.0.40 2024-10-28 16:29:46,960 - DEBUG - Posting: http://10.0.0.40:8081/analytics/query, payload {'table': 'ObjectVNTable', 'start_time': 1730132970768464, 'end_time': 1730132986960118, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'Messagetype', 'ModuleId', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'op': 1, 'value2': None}]]} 2024-10-28 16:29:47,991 - DEBUG - Query output : [{'MessageTS': 1730132971597414, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091display_name"ctest-vn22-65975091"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-16072396", "ctest-vn22-65975091"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-16072396", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9043913623684270417, "uuid_lslong": 10470460903605432489}, "enable": true, "created": "2024-10-28T16:29:31.588202", "last_modified": "2024-10-28T16:29:31.588202", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_policy_refs[]parent_type"project"parent_uuid"6873ac78-f1f7-4e91-b262-7c0b400ba46d"perms2{"owner": "6873ac78f1f74e91b2627c0b400ba46d", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"7d826f86-2704-4951-914e-8cb78a0470a9"virtual_network_network_id6false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132971599116, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132971599651, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132971653144, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091target:10.20.0.31:7target:64512:7999999cn-jenkins-deploy-platform-ansible-os-2168-1controller/src/bgp/routing-instance/routing_instance.cc1238', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132971653166, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091Addinetcn-jenkins-deploy-platform-ansible-os-2168-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132971653264, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091Addinet6cn-jenkins-deploy-platform-ansible-os-2168-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132971653351, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091Adderm-vpncn-jenkins-deploy-platform-ansible-os-2168-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132971653430, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091Adde-vpncn-jenkins-deploy-platform-ansible-os-2168-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132971653501, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091Addinet-mvpncn-jenkins-deploy-platform-ansible-os-2168-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132971728963, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-6597509110.20.0.31:7target:64512:8000005target:64512:8000005cn-jenkins-deploy-platform-ansible-os-2168-1controller/src/bgp/routing-instance/routing_instance.cc1390', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132971768904, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132971769434, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132971892635, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091display_name"ctest-vn22-65975091"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-16072396", "ctest-vn22-65975091"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-16072396", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9043913623684270417, "uuid_lslong": 10470460903605432489}, "enable": true, "created": "2024-10-28T16:29:31.588202", "last_modified": "2024-10-28T16:29:31.882749", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_ipam_refs[{"to": ["default-domain", "default-project", "default-network-ipam"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "51.110.122.0", "ip_prefix_len": 26}, "default_gateway": "51.110.122.1", "dns_server_address": "51.110.122.2", "subnet_uuid": "174ab6a5-c82a-4d17-a18b-c4342cfaa51f", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": "", "alloc_unit": 1, "created": "2024-10-28T16:29:31.868412", "last_modified": "2024-10-28T16:29:31.868412", "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "f1d31429-1fb0-4022-9605-a972aecfdc82"}]parent_type"project"parent_uuid"6873ac78-f1f7-4e91-b262-7c0b400ba46d"perms2{"owner": "6873ac78f1f74e91b2627c0b400ba46d", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"7d826f86-2704-4951-914e-8cb78a0470a9"virtual_network_network_id6false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132971892681, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132971893374, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978114291, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978114557, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978130589, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978130838, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978200492, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978200773, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978739828, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132978740101, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750910', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132981648079, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'Addition 7d826f86-2704-4951-914e-8cb78a0470a9default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-6597509151.110.122.02651.110.122.1default-domain:default-project:default-network-ipamtrue51.110.122.2truetruetruetruecontroller/src/vnsw/agent/oper/vn.cc1391', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132981654675, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'Modification 7d826f86-2704-4951-914e-8cb78a0470a9default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-6597509151.110.122.02651.110.122.1default-domain:default-project:default-network-ipamtrue51.110.122.2truetruetruetruecontroller/src/vnsw/agent/oper/vn.cc1391', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132981745208, 'Messagetype': 'UveVirtualNetworkAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-659750910default-domain:ctest-AnalyticsBasicTestSanity-16072396:fd6aa919-cd37-44bd-8b6b-461d2b3afbe2883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132981751044, 'Messagetype': 'UveVirtualNetworkAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091000default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091000000000000000000000000000', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}] 2024-10-28 16:29:47,991 - DEBUG - Verifying ObjectVMTable for vm 883f6ca0-073a-4e25-b1c2-47e35a6a726d on analytics node 10.0.0.40 2024-10-28 16:29:47,991 - DEBUG - Posting: http://10.0.0.40:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1730132970768464, 'end_time': 1730132987991471, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'op': 1, 'value2': None}]]} 2024-10-28 16:29:49,018 - DEBUG - Query output : [{'MessageTS': 1730132981600456, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': 'Addition 883f6ca0-073a-4e25-b1c2-47e35a6a726d0controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132981614480, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': 'Modification 883f6ca0-073a-4e25-b1c2-47e35a6a726d1controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132981745250, 'Messagetype': 'UveVirtualMachineAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': '883f6ca0-073a-4e25-b1c2-47e35a6a726ddefault-domain:ctest-AnalyticsBasicTestSanity-16072396:fd6aa919-cd37-44bd-8b6b-461d2b3afbe2cn-jenkins-deploy-platform-ansible-os-2168-1883f6ca0-073a-4e25-b1c2-47e35a6a726dctest-AnalyticsBasicTestSanity-16072396-41003192', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132978009187, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': '883f6ca0-073a-4e25-b1c2-47e35a6a726ddisplay_name"883f6ca0-073a-4e25-b1c2-47e35a6a726d"fq_name["883f6ca0-073a-4e25-b1c2-47e35a6a726d"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9817685147262799397, "uuid_lslong": 12808879331995185773}, "enable": true, "created": "2024-10-28T16:29:37.998550", "last_modified": "2024-10-28T16:29:37.998550", "description": null, "user_visible": true, "creator": null}perms2{"owner": "6873ac78-f1f7-4e91-b262-7c0b400ba46d", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"883f6ca0-073a-4e25-b1c2-47e35a6a726d"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}] 2024-10-28 16:29:49,018 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091 on analytics node 10.0.0.40 2024-10-28 16:29:49,018 - DEBUG - Posting: http://10.0.0.40:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1730132970768464, 'end_time': 1730132989018514, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091', 'op': 1, 'value2': None}]]} 2024-10-28 16:29:50,054 - DEBUG - Query output : [{'MessageTS': 1730132981648148, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091', 'ObjectLog': 'Addition default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750912controller/src/vnsw/agent/oper/vrf.cc414', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}] 2024-10-28 16:29:50,054 - DEBUG - Verifying ObjectVMTable for vm 883f6ca0-073a-4e25-b1c2-47e35a6a726d on analytics node 10.0.0.40 2024-10-28 16:29:50,055 - DEBUG - Posting: http://10.0.0.40:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1730132970768464, 'end_time': 1730132990055029, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'op': 1, 'value2': None}]]} 2024-10-28 16:29:51,082 - DEBUG - Query output : [{'MessageTS': 1730132978009187, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': '883f6ca0-073a-4e25-b1c2-47e35a6a726ddisplay_name"883f6ca0-073a-4e25-b1c2-47e35a6a726d"fq_name["883f6ca0-073a-4e25-b1c2-47e35a6a726d"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9817685147262799397, "uuid_lslong": 12808879331995185773}, "enable": true, "created": "2024-10-28T16:29:37.998550", "last_modified": "2024-10-28T16:29:37.998550", "description": null, "user_visible": true, "creator": null}perms2{"owner": "6873ac78-f1f7-4e91-b262-7c0b400ba46d", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"883f6ca0-073a-4e25-b1c2-47e35a6a726d"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1.', 'SystemLog': None}, {'MessageTS': 1730132981600456, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': 'Addition 883f6ca0-073a-4e25-b1c2-47e35a6a726d0controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132981614480, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': 'Modification 883f6ca0-073a-4e25-b1c2-47e35a6a726d1controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}, {'MessageTS': 1730132981745250, 'Messagetype': 'UveVirtualMachineAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '883f6ca0-073a-4e25-b1c2-47e35a6a726d', 'ObjectLog': '883f6ca0-073a-4e25-b1c2-47e35a6a726ddefault-domain:ctest-AnalyticsBasicTestSanity-16072396:fd6aa919-cd37-44bd-8b6b-461d2b3afbe2cn-jenkins-deploy-platform-ansible-os-2168-1883f6ca0-073a-4e25-b1c2-47e35a6a726dctest-AnalyticsBasicTestSanity-16072396-41003192', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}] 2024-10-28 16:29:51,082 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091 on analytics node 10.0.0.40 2024-10-28 16:29:51,082 - DEBUG - Posting: http://10.0.0.40:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1730132970768464, 'end_time': 1730132991082631, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091', 'op': 1, 'value2': None}]]} 2024-10-28 16:29:52,106 - DEBUG - Query output : [{'MessageTS': 1730132981648148, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091', 'ObjectLog': 'Addition default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-659750912controller/src/vnsw/agent/oper/vrf.cc414', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2168-1', 'SystemLog': None}] 2024-10-28 16:29:52,106 - INFO - Validated ObjectVNTable, ObjectRoutingInstance, ObjectVMTable logs 2024-10-28 16:29:52,107 - INFO - Deleting VM ctest-AnalyticsBasicTestSanity-16072396-41003192 2024-10-28 16:29:52,278 - INFO - Deleting VN ctest-vn22-65975091 2024-10-28 16:29:52,326 - DEBUG - VN 7d826f86-2704-4951-914e-8cb78a0470a9 still in use: Unable to complete operation on network 7d826f86-2704-4951-914e-8cb78a0470a9. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6c145748-ffe4-42e5-aa77-a8690b2ceca2'] 2024-10-28 16:29:52,327 - WARNING - Deleting VN ctest-vn22-65975091 failed..Will retry 2024-10-28 16:29:54,452 - DEBUG - Response for deleting network () 2024-10-28 16:29:54,453 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/e694c813-5f2b-432b-b72e-fe28263a88a0 2024-10-28 16:29:54,460 - DEBUG - Response Code: 404 2024-10-28 16:29:54,460 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-10-28 16:29:54,465 - DEBUG - Requesting: http://10.0.0.40:8082/domain/5274d552-d800-4c4f-90d0-debc9940531b 2024-10-28 16:29:54,524 - DEBUG - Requesting: http://10.0.0.40:8082/project/6873ac78-f1f7-4e91-b262-7c0b400ba46d 2024-10-28 16:29:54,610 - INFO - Validated that VN ctest-vn22-65975091 is not found in API Server 2024-10-28 16:29:54,627 - DEBUG - VN ctest-vn22-65975091 is not present in Agent 10.0.0.40 2024-10-28 16:29:54,627 - INFO - Validated that VN ctest-vn22-65975091 is not in any agent 2024-10-28 16:29:54,634 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091:ctest-vn22-65975091 2024-10-28 16:29:54,641 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-16072396:ctest-vn22-65975091 2024-10-28 16:29:54,647 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn22-65975091 info 2024-10-28 16:29:54,776 - DEBUG - No XMPP flaps were noticed during the test 2024-10-28 16:29:54,776 - INFO - END TEST : test_verify_object_logs : PASSED[0:00:24] 2024-10-28 16:29:54,777 - INFO - -------------------------------------------------------------------------------- 2024-10-28 16:29:55,514 - INFO - Deleted project: ctest-AnalyticsBasicTestSanity-16072396, ID : 6873ac78-f1f7-4e91-b262-7c0b400ba46d 2024-10-28 16:30:01,111 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-fvn-61487645 2024-10-28 16:30:01,117 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-fvn-61487645:ctest-fvn-61487645 2024-10-28 16:30:02,527 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-vn1-24341906 2024-10-28 16:30:02,533 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-vn1-24341906:ctest-vn1-24341906 2024-10-28 16:30:06,271 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-fvn-61487645:ctest-some-pool-87441530 2024-10-28 16:30:19,300 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRtGroupReq?x=target:64512:8000005 2024-10-28 16:30:22,223 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-fvn-61487645:ctest-some-pool-87441530 2024-10-28 16:30:24,749 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-vn1-24341906:ctest-vn1-24341906 2024-10-28 16:30:24,754 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-vn1-24341906 2024-10-28 16:30:25,068 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-fvn-61487645:ctest-fvn-61487645 2024-10-28 16:30:25,073 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-61070254:ctest-fvn-61487645 2024-10-28 16:31:06,183 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-94753096 2024-10-28 16:31:06,190 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-94753096:ctest-vn-94753096 2024-10-28 16:31:07,004 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-35031864 2024-10-28 16:31:07,012 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-35031864:ctest-vn-35031864 2024-10-28 16:31:07,938 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-35031864:ctest-vn-35031864 2024-10-28 16:31:07,946 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-35031864 2024-10-28 16:31:08,256 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-94753096:ctest-vn-94753096 2024-10-28 16:31:08,263 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-56589113:ctest-vn-94753096 2024-10-28 16:31:15,187 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-86494652 2024-10-28 16:31:15,194 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-86494652:ctest-vn-86494652 2024-10-28 16:31:15,989 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-56783079 2024-10-28 16:31:15,996 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-56783079:ctest-vn-56783079 2024-10-28 16:31:42,201 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-56783079:ctest-vn-56783079 2024-10-28 16:31:42,207 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-56783079 2024-10-28 16:31:42,508 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-86494652:ctest-vn-86494652 2024-10-28 16:31:42,514 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-44007831:ctest-vn-86494652 2024-10-28 16:31:48,180 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-87765544:ctest-mgmt_vn-61332202 2024-10-28 16:31:48,186 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-87765544:ctest-mgmt_vn-61332202:ctest-mgmt_vn-61332202 2024-10-28 16:31:49,653 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-87765544:ctest-left_vn-17003134 2024-10-28 16:31:49,661 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-87765544:ctest-left_vn-17003134:ctest-left_vn-17003134 2024-10-28 16:31:50,829 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-87765544:ctest-right_vn-61587596 2024-10-28 16:31:50,837 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-87765544:ctest-right_vn-61587596:ctest-right_vn-61587596 2024-10-28 16:33:02,341 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-87765544:ctest-right_vn-61587596:ctest-right_vn-61587596 2024-10-28 16:33:02,349 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-87765544:ctest-right_vn-61587596 2024-10-28 16:33:02,684 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-87765544:ctest-left_vn-17003134:ctest-left_vn-17003134 2024-10-28 16:33:02,690 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-87765544:ctest-left_vn-17003134 2024-10-28 16:33:03,003 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-87765544:ctest-mgmt_vn-61332202:ctest-mgmt_vn-61332202 2024-10-28 16:33:03,010 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-87765544:ctest-mgmt_vn-61332202 2024-10-28 16:33:07,875 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS&search_string=virtual-DNS:default-domain:ctest-vdns1-69940278 2024-10-28 16:33:51,376 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS-record&search_string=virtual-DNS-record:default-domain:ctest-vdns1-69940278:test-rec 2024-10-28 16:33:59,482 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS&search_string=virtual-DNS:default-domain:ctest-vdns1-69940278 2024-10-28 16:34:53,741 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=network-ipam&search_string=network-ipam:default-domain:ctest-TestBasicVMVN-43111311:ctest-ipam-38174176 2024-10-28 16:34:54,104 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicVMVN-43111311:ctest-vn-80437955 2024-10-28 16:34:54,111 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-43111311:ctest-vn-80437955:ctest-vn-80437955 2024-10-28 16:35:26,176 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-43111311:ctest-vn-80437955:ctest-vn-80437955 2024-10-28 16:35:26,183 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicVMVN-43111311:ctest-vn-80437955 2024-10-28 16:35:26,272 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-43111311:ctest-ipam-38174176:ctest-ipam-38174176 2024-10-28 16:35:26,278 - DEBUG - Requesting: http://10.0.0.40:8083/Snh_IFMapTableShowReq?table_name=network-ipam&search_string=network-ipam:default-domain:ctest-TestBasicVMVN-43111311:ctest-ipam-38174176