2025-01-09 07:32:47,911 - INFO - Domain Default found not creating 2025-01-09 07:32:48,119 - INFO - Project ctest-AnalyticsBasicTestSanity-23412536 not found, creating it 2025-01-09 07:32:48,968 - INFO - Created Project:ctest-AnalyticsBasicTestSanity-23412536, ID : 5cbe4d6d-fe8a-47cd-abaa-37135b534999 2025-01-09 07:32:50,484 - INFO - ================================================================================ 2025-01-09 07:32:50,484 - INFO - STARTING TEST : test_verify_object_logs 2025-01-09 07:32:50,484 - INFO - TEST DESCRIPTION : Description: Test to validate object logs 1.Create vn/vm and verify object log tables updated with those vn, vm and routing-instance - fails otherwise Maintainer: sandipd@juniper.net 2025-01-09 07:32:50,611 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.20.0.31': '0'}} with 2025-01-09 07:32:50,611 - INFO - Initial checks done. Running the testcase now 2025-01-09 07:32:50,611 - INFO - 2025-01-09 07:32:51,470 - DEBUG - Response for create_network : {'network': {'id': 'b3713d7e-9e0c-437b-9750-acbf30de57e2', 'name': 'ctest-vn22-47380463', 'tenant_id': '5cbe4d6dfe8a47cdabaa37135b534999', 'project_id': '5cbe4d6dfe8a47cdabaa37135b534999', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-23412536', 'ctest-vn22-47380463'], 'port_security_enabled': True, 'description': ''}} 2025-01-09 07:32:51,728 - DEBUG - Response for create_subnet : {'subnet': {'id': '0fa843f3-7371-4b89-98b3-c0bf7f783a1f', 'name': '', 'tenant_id': '5cbe4d6dfe8a47cdabaa37135b534999', 'network_id': 'b3713d7e-9e0c-437b-9750-acbf30de57e2', 'ip_version': 4, 'cidr': '156.239.222.0/26', 'allocation_pools': [{'start': '156.239.222.2', 'end': '156.239.222.62'}], 'gateway_ip': '156.239.222.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '156.239.222.2', 'tags': [], 'project_id': '5cbe4d6dfe8a47cdabaa37135b534999'}} 2025-01-09 07:32:51,751 - INFO - Created VN ctest-vn22-47380463 2025-01-09 07:32:51,768 - DEBUG - VN ctest-vn22-47380463 UUID is b3713d7e-9e0c-437b-9750-acbf30de57e2 2025-01-09 07:32:51,845 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2025-01-09 07:32:52,145 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2025-01-09 07:32:52,180 - DEBUG - Requesting: http://10.0.0.42:8082/domain/31c12e07-fc4b-4ec5-b298-cedca8c582a4 2025-01-09 07:32:52,198 - DEBUG - Requesting: http://10.0.0.42:8082/project/5cbe4d6d-fe8a-47cd-abaa-37135b534999 2025-01-09 07:32:52,240 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/b3713d7e-9e0c-437b-9750-acbf30de57e2 2025-01-09 07:32:52,255 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/b3713d7e-9e0c-437b-9750-acbf30de57e2 2025-01-09 07:32:52,267 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/2966e1b0-e24b-4b8b-a008-e4eed2c724d5 2025-01-09 07:32:52,276 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/2966e1b0-e24b-4b8b-a008-e4eed2c724d5 2025-01-09 07:32:52,286 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/7d4d3a20-da60-44d0-8715-99b2bc6990a5 2025-01-09 07:32:52,296 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-01-09 07:32:52,296 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/b3713d7e-9e0c-437b-9750-acbf30de57e2 2025-01-09 07:32:52,338 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/2966e1b0-e24b-4b8b-a008-e4eed2c724d5 2025-01-09 07:32:52,361 - INFO - Verified VN network id 5 for VN b3713d7e-9e0c-437b-9750-acbf30de57e2 2025-01-09 07:32:52,361 - INFO - Verifications in API Server for VN ctest-vn22-47380463 passed 2025-01-09 07:32:52,361 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/b3713d7e-9e0c-437b-9750-acbf30de57e2 2025-01-09 07:32:52,386 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/2966e1b0-e24b-4b8b-a008-e4eed2c724d5 2025-01-09 07:32:52,395 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/2966e1b0-e24b-4b8b-a008-e4eed2c724d5 2025-01-09 07:32:52,404 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/7d4d3a20-da60-44d0-8715-99b2bc6990a5 2025-01-09 07:32:52,412 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463 2025-01-09 07:32:52,419 - DEBUG - Control-node 10.0.0.42 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsBasicTestSanity-23412536', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12930183619184182139', 'uuid-lslong': '10903404635022579682'}, 'enable': 'true', 'created': '2025-01-09T07:32:51', 'last-modified': '2025-01-09T07:32:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.740777'} 2025-01-09 07:32:52,419 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463 2025-01-09 07:32:52,428 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-01-09 07:32:52,428 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn22-47380463 passed 2025-01-09 07:32:52,429 - DEBUG - ====Verifying policy data for ctest-vn22-47380463 in API_Server ====== 2025-01-09 07:32:52,429 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2025-01-09 07:32:52,435 - DEBUG - Requesting: http://10.0.0.42:8082/domain/31c12e07-fc4b-4ec5-b298-cedca8c582a4 2025-01-09 07:32:52,475 - DEBUG - Requesting: http://10.0.0.42:8082/project/5cbe4d6d-fe8a-47cd-abaa-37135b534999 2025-01-09 07:32:52,517 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/b3713d7e-9e0c-437b-9750-acbf30de57e2 2025-01-09 07:32:52,527 - DEBUG - =>VN ctest-vn22-47380463 has no policy to be verified 2025-01-09 07:32:52,527 - DEBUG - Verifying the vn in opserver 2025-01-09 07:32:52,527 - DEBUG - Verifying the default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463 virtual network link through opserver 10.0.0.42 2025-01-09 07:32:52,527 - DEBUG - Requesting: http://10.0.0.42:8081/analytics/uves/virtual-networks 2025-01-09 07:32:52,821 - DEBUG - Requesting: http://10.0.0.42:8081/analytics/uves/virtual-networks 2025-01-09 07:32:52,888 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'href': 'http://10.0.0.42:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463?flat'} 2025-01-09 07:32:52,889 - INFO - Validated that VN default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463 is found in opserver 2025-01-09 07:32:52,905 - DEBUG - Do not have enough data to verify VN in agent 2025-01-09 07:32:52,913 - DEBUG - VRF ids for VN ctest-vn22-47380463: {} 2025-01-09 07:32:53,016 - DEBUG - Services list from nova: [, , ] 2025-01-09 07:32:53,117 - DEBUG - Image by name cirros not found 2025-01-09 07:32:53,117 - DEBUG - Installing image cirros 2025-01-09 07:32:53,117 - DEBUG - Image info {'name': 'cirros-0.3.0-x86_64-disk.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'cubswin:)', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-01-09 07:32:53,118 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz 2025-01-09 07:32:53,118 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz 2025-01-09 07:32:53,127 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz -O /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz 2025-01-09 07:32:53,342 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz 2025-01-09 07:32:53,342 - DEBUG - Unzip image 2025-01-09 07:32:53,342 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz 2025-01-09 07:32:53,459 - DEBUG - Try to create image in user context 2025-01-09 07:32:53,664 - DEBUG - Image has been created in user context 2025-01-09 07:32:53,664 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk 2025-01-09 07:32:53,680 - DEBUG - Downloaded image has been removed 2025-01-09 07:32:53,700 - DEBUG - Uploaded image status = active 2025-01-09 07:32:56,192 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2578-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2578-1) 2025-01-09 07:32:56,240 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-01-09 07:33:01,356 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-01-09 07:33:06,451 - DEBUG - VM is in ACTIVE state now 2025-01-09 07:33:06,451 - DEBUG - Verifying ObjectVNTable for vn default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463 on analytics node 10.0.0.42 2025-01-09 07:33:06,455 - DEBUG - Posting: http://10.0.0.42:8081/analytics/query, payload {'table': 'ObjectVNTable', 'start_time': 1736407970611909, 'end_time': 1736407986455589, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'Messagetype', 'ModuleId', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'op': 1, 'value2': None}]]} 2025-01-09 07:33:07,786 - DEBUG - Query output : [{'MessageTS': 1736407980604528, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'Addition b3713d7e-9e0c-437b-9750-acbf30de57e2default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463156.239.222.026156.239.222.1default-domain:default-project:default-network-ipamtrue156.239.222.2truetruetruetruecontroller/src/vnsw/agent/oper/vn.cc1391', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407980610952, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'Modification b3713d7e-9e0c-437b-9750-acbf30de57e2default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463156.239.222.026156.239.222.1default-domain:default-project:default-network-ipamtrue156.239.222.2truetruetruetruecontroller/src/vnsw/agent/oper/vn.cc1391', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407983621810, 'Messagetype': 'UveVirtualNetworkAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-473804630default-domain:ctest-AnalyticsBasicTestSanity-23412536:680df259-3290-49ba-a99c-ecd1092bd8ad273d00ad-0350-4dc2-bdac-b476f0550318', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407983625784, 'Messagetype': 'UveVirtualNetworkAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463000default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463000000000000000000000000000', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971405691, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463display_name"ctest-vn22-47380463"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-23412536", "ctest-vn22-47380463"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-23412536", "owner_access": 7, "group": "admin", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12930183619184182139, "uuid_lslong": 10903404635022579682}, "enable": true, "created": "2025-01-09T07:32:51.400499", "last_modified": "2025-01-09T07:32:51.400499", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_policy_refs[]parent_type"project"parent_uuid"5cbe4d6d-fe8a-47cd-abaa-37135b534999"perms2{"owner": "5cbe4d6dfe8a47cdabaa37135b534999", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"b3713d7e-9e0c-437b-9750-acbf30de57e2"virtual_network_network_id5false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971408257, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463display_name"ctest-vn22-47380463"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-23412536", "ctest-vn22-47380463"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-23412536", "owner_access": 7, "group": "admin", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12930183619184182139, "uuid_lslong": 10903404635022579682}, "enable": true, "created": "2025-01-09T07:32:51.400499", "last_modified": "2025-01-09T07:32:51.400499", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_policy_refs[]parent_type"project"parent_uuid"5cbe4d6d-fe8a-47cd-abaa-37135b534999"perms2{"owner": "5cbe4d6dfe8a47cdabaa37135b534999", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"b3713d7e-9e0c-437b-9750-acbf30de57e2"virtual_network_network_id5false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971417309, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463display_name"ctest-vn22-47380463"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-23412536", "ctest-vn22-47380463"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-23412536", "owner_access": 7, "group": "admin", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12930183619184182139, "uuid_lslong": 10903404635022579682}, "enable": true, "created": "2025-01-09T07:32:51.400499", "last_modified": "2025-01-09T07:32:51.400499", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_policy_refs[]parent_type"project"parent_uuid"5cbe4d6d-fe8a-47cd-abaa-37135b534999"perms2{"owner": "5cbe4d6dfe8a47cdabaa37135b534999", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"b3713d7e-9e0c-437b-9750-acbf30de57e2"virtual_network_network_id5false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971422160, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971422622, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971439227, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463target:10.20.0.31:6target:64512:7999999cn-jenkins-deploy-platform-ansible-os-2578-1controller/src/bgp/routing-instance/routing_instance.cc1238', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971439255, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463Addinetcn-jenkins-deploy-platform-ansible-os-2578-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971439753, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463Addinet6cn-jenkins-deploy-platform-ansible-os-2578-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971439878, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463Adderm-vpncn-jenkins-deploy-platform-ansible-os-2578-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971440004, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463Adde-vpncn-jenkins-deploy-platform-ansible-os-2578-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971440108, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463Addinet-mvpncn-jenkins-deploy-platform-ansible-os-2578-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971500916, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971501332, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971508450, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-4738046310.20.0.31:6target:64512:8000004target:64512:8000004cn-jenkins-deploy-platform-ansible-os-2578-1controller/src/bgp/routing-instance/routing_instance.cc1390', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407971677242, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971677694, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971680803, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463display_name"ctest-vn22-47380463"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-23412536", "ctest-vn22-47380463"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-23412536", "owner_access": 7, "group": "admin", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12930183619184182139, "uuid_lslong": 10903404635022579682}, "enable": true, "created": "2025-01-09T07:32:51.400499", "last_modified": "2025-01-09T07:32:51.670372", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_ipam_refs[{"to": ["default-domain", "default-project", "default-network-ipam"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "156.239.222.0", "ip_prefix_len": 26}, "default_gateway": "156.239.222.1", "dns_server_address": "156.239.222.2", "subnet_uuid": "0fa843f3-7371-4b89-98b3-c0bf7f783a1f", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": "", "alloc_unit": 1, "created": "2025-01-09T07:32:51.657021", "last_modified": "2025-01-09T07:32:51.657021", "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "6a8b43a4-cc5e-4dd8-91ae-749d87bebf4c"}]parent_type"project"parent_uuid"5cbe4d6d-fe8a-47cd-abaa-37135b534999"perms2{"owner": "5cbe4d6dfe8a47cdabaa37135b534999", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"b3713d7e-9e0c-437b-9750-acbf30de57e2"virtual_network_network_id5false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971686134, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463display_name"ctest-vn22-47380463"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-23412536", "ctest-vn22-47380463"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-23412536", "owner_access": 7, "group": "admin", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12930183619184182139, "uuid_lslong": 10903404635022579682}, "enable": true, "created": "2025-01-09T07:32:51.400499", "last_modified": "2025-01-09T07:32:51.670372", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_ipam_refs[{"to": ["default-domain", "default-project", "default-network-ipam"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "156.239.222.0", "ip_prefix_len": 26}, "default_gateway": "156.239.222.1", "dns_server_address": "156.239.222.2", "subnet_uuid": "0fa843f3-7371-4b89-98b3-c0bf7f783a1f", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": "", "alloc_unit": 1, "created": "2025-01-09T07:32:51.657021", "last_modified": "2025-01-09T07:32:51.657021", "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "6a8b43a4-cc5e-4dd8-91ae-749d87bebf4c"}]parent_type"project"parent_uuid"5cbe4d6d-fe8a-47cd-abaa-37135b534999"perms2{"owner": "5cbe4d6dfe8a47cdabaa37135b534999", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"b3713d7e-9e0c-437b-9750-acbf30de57e2"virtual_network_network_id5false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407971696441, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463display_name"ctest-vn22-47380463"fq_name["default-domain", "ctest-AnalyticsBasicTestSanity-23412536", "ctest-vn22-47380463"]id_perms{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-23412536", "owner_access": 7, "group": "admin", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12930183619184182139, "uuid_lslong": 10903404635022579682}, "enable": true, "created": "2025-01-09T07:32:51.400499", "last_modified": "2025-01-09T07:32:51.670372", "description": "", "user_visible": true, "creator": null}is_sharedfalsemtu0network_ipam_refs[{"to": ["default-domain", "default-project", "default-network-ipam"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "156.239.222.0", "ip_prefix_len": 26}, "default_gateway": "156.239.222.1", "dns_server_address": "156.239.222.2", "subnet_uuid": "0fa843f3-7371-4b89-98b3-c0bf7f783a1f", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": "", "alloc_unit": 1, "created": "2025-01-09T07:32:51.657021", "last_modified": "2025-01-09T07:32:51.657021", "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "6a8b43a4-cc5e-4dd8-91ae-749d87bebf4c"}]parent_type"project"parent_uuid"5cbe4d6d-fe8a-47cd-abaa-37135b534999"perms2{"owner": "5cbe4d6dfe8a47cdabaa37135b534999", "owner_access": 7, "global_access": 0, "share": []}port_security_enabledtruerouter_externalfalseuuid"b3713d7e-9e0c-437b-9750-acbf30de57e2"virtual_network_network_id5false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977471561, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977471903, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977500038, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977500395, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977562371, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977562594, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407978116674, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407978116898, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804630', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}] 2025-01-09 07:33:07,787 - DEBUG - Verifying ObjectVMTable for vm 273d00ad-0350-4dc2-bdac-b476f0550318 on analytics node 10.0.0.42 2025-01-09 07:33:07,787 - DEBUG - Posting: http://10.0.0.42:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1736407970611909, 'end_time': 1736407987787293, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '273d00ad-0350-4dc2-bdac-b476f0550318', 'op': 1, 'value2': None}]]} 2025-01-09 07:33:08,854 - DEBUG - Query output : [{'MessageTS': 1736407980562332, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': 'Addition 273d00ad-0350-4dc2-bdac-b476f05503180controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407980573360, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': 'Modification 273d00ad-0350-4dc2-bdac-b476f05503181controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407983621860, 'Messagetype': 'UveVirtualMachineAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318default-domain:ctest-AnalyticsBasicTestSanity-23412536:680df259-3290-49ba-a99c-ecd1092bd8adcn-jenkins-deploy-platform-ansible-os-2578-1273d00ad-0350-4dc2-bdac-b476f0550318ctest-AnalyticsBasicTestSanity-23412536-93252189', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407977374247, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318display_name"273d00ad-0350-4dc2-bdac-b476f0550318"fq_name["273d00ad-0350-4dc2-bdac-b476f0550318"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2827416884143476162, "uuid_lslong": 13667497392093856536}, "enable": true, "created": "2025-01-09T07:32:57.364782", "last_modified": "2025-01-09T07:32:57.364782", "description": null, "user_visible": true, "creator": null}perms2{"owner": "5cbe4d6d-fe8a-47cd-abaa-37135b534999", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"273d00ad-0350-4dc2-bdac-b476f0550318"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977374830, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318display_name"273d00ad-0350-4dc2-bdac-b476f0550318"fq_name["273d00ad-0350-4dc2-bdac-b476f0550318"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2827416884143476162, "uuid_lslong": 13667497392093856536}, "enable": true, "created": "2025-01-09T07:32:57.364782", "last_modified": "2025-01-09T07:32:57.364782", "description": null, "user_visible": true, "creator": null}perms2{"owner": "5cbe4d6d-fe8a-47cd-abaa-37135b534999", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"273d00ad-0350-4dc2-bdac-b476f0550318"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977375300, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318display_name"273d00ad-0350-4dc2-bdac-b476f0550318"fq_name["273d00ad-0350-4dc2-bdac-b476f0550318"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2827416884143476162, "uuid_lslong": 13667497392093856536}, "enable": true, "created": "2025-01-09T07:32:57.364782", "last_modified": "2025-01-09T07:32:57.364782", "description": null, "user_visible": true, "creator": null}perms2{"owner": "5cbe4d6d-fe8a-47cd-abaa-37135b534999", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"273d00ad-0350-4dc2-bdac-b476f0550318"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}] 2025-01-09 07:33:08,854 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463 on analytics node 10.0.0.42 2025-01-09 07:33:08,854 - DEBUG - Posting: http://10.0.0.42:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1736407970611909, 'end_time': 1736407988854671, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463', 'op': 1, 'value2': None}]]} 2025-01-09 07:33:09,881 - DEBUG - Query output : [{'MessageTS': 1736407980604592, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463', 'ObjectLog': 'Addition default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804632controller/src/vnsw/agent/oper/vrf.cc414', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}] 2025-01-09 07:33:09,882 - DEBUG - Verifying ObjectVMTable for vm 273d00ad-0350-4dc2-bdac-b476f0550318 on analytics node 10.0.0.42 2025-01-09 07:33:09,882 - DEBUG - Posting: http://10.0.0.42:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1736407970611909, 'end_time': 1736407989882159, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '273d00ad-0350-4dc2-bdac-b476f0550318', 'op': 1, 'value2': None}]]} 2025-01-09 07:33:10,906 - DEBUG - Query output : [{'MessageTS': 1736407980562332, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': 'Addition 273d00ad-0350-4dc2-bdac-b476f05503180controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407980573360, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': 'Modification 273d00ad-0350-4dc2-bdac-b476f05503181controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407983621860, 'Messagetype': 'UveVirtualMachineAgentTrace', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318default-domain:ctest-AnalyticsBasicTestSanity-23412536:680df259-3290-49ba-a99c-ecd1092bd8adcn-jenkins-deploy-platform-ansible-os-2578-1273d00ad-0350-4dc2-bdac-b476f0550318ctest-AnalyticsBasicTestSanity-23412536-93252189', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}, {'MessageTS': 1736407977374247, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318display_name"273d00ad-0350-4dc2-bdac-b476f0550318"fq_name["273d00ad-0350-4dc2-bdac-b476f0550318"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2827416884143476162, "uuid_lslong": 13667497392093856536}, "enable": true, "created": "2025-01-09T07:32:57.364782", "last_modified": "2025-01-09T07:32:57.364782", "description": null, "user_visible": true, "creator": null}perms2{"owner": "5cbe4d6d-fe8a-47cd-abaa-37135b534999", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"273d00ad-0350-4dc2-bdac-b476f0550318"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977374830, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318display_name"273d00ad-0350-4dc2-bdac-b476f0550318"fq_name["273d00ad-0350-4dc2-bdac-b476f0550318"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2827416884143476162, "uuid_lslong": 13667497392093856536}, "enable": true, "created": "2025-01-09T07:32:57.364782", "last_modified": "2025-01-09T07:32:57.364782", "description": null, "user_visible": true, "creator": null}perms2{"owner": "5cbe4d6d-fe8a-47cd-abaa-37135b534999", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"273d00ad-0350-4dc2-bdac-b476f0550318"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}, {'MessageTS': 1736407977375300, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '273d00ad-0350-4dc2-bdac-b476f0550318', 'ObjectLog': '273d00ad-0350-4dc2-bdac-b476f0550318display_name"273d00ad-0350-4dc2-bdac-b476f0550318"fq_name["273d00ad-0350-4dc2-bdac-b476f0550318"]id_perms{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2827416884143476162, "uuid_lslong": 13667497392093856536}, "enable": true, "created": "2025-01-09T07:32:57.364782", "last_modified": "2025-01-09T07:32:57.364782", "description": null, "user_visible": true, "creator": null}perms2{"owner": "5cbe4d6d-fe8a-47cd-abaa-37135b534999", "owner_access": 7, "global_access": 0, "share": []}server_type"virtual-server"uuid"273d00ad-0350-4dc2-bdac-b476f0550318"false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1.', 'SystemLog': None}] 2025-01-09 07:33:10,906 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463 on analytics node 10.0.0.42 2025-01-09 07:33:10,907 - DEBUG - Posting: http://10.0.0.42:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1736407970611909, 'end_time': 1736407990907002, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463', 'op': 1, 'value2': None}]]} 2025-01-09 07:33:11,929 - DEBUG - Query output : [{'MessageTS': 1736407980604592, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463', 'ObjectLog': 'Addition default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-473804632controller/src/vnsw/agent/oper/vrf.cc414', 'Source': 'cn-jenkins-deploy-platform-ansible-os-2578-1', 'SystemLog': None}] 2025-01-09 07:33:11,929 - INFO - Validated ObjectVNTable, ObjectRoutingInstance, ObjectVMTable logs 2025-01-09 07:33:11,929 - INFO - Deleting VM ctest-AnalyticsBasicTestSanity-23412536-93252189 2025-01-09 07:33:12,062 - INFO - Deleting VN ctest-vn22-47380463 2025-01-09 07:33:12,108 - DEBUG - VN b3713d7e-9e0c-437b-9750-acbf30de57e2 still in use: Unable to complete operation on network b3713d7e-9e0c-437b-9750-acbf30de57e2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a69bd7d4-cbc7-4bf3-a249-3a982a87d943'] 2025-01-09 07:33:12,108 - WARNING - Deleting VN ctest-vn22-47380463 failed..Will retry 2025-01-09 07:33:14,241 - DEBUG - Response for deleting network () 2025-01-09 07:33:14,242 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/2966e1b0-e24b-4b8b-a008-e4eed2c724d5 2025-01-09 07:33:14,277 - DEBUG - Response Code: 404 2025-01-09 07:33:14,277 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2025-01-09 07:33:14,284 - DEBUG - Requesting: http://10.0.0.42:8082/domain/31c12e07-fc4b-4ec5-b298-cedca8c582a4 2025-01-09 07:33:14,303 - DEBUG - Requesting: http://10.0.0.42:8082/project/5cbe4d6d-fe8a-47cd-abaa-37135b534999 2025-01-09 07:33:14,353 - INFO - Validated that VN ctest-vn22-47380463 is not found in API Server 2025-01-09 07:33:14,365 - DEBUG - VN ctest-vn22-47380463 is not present in Agent 10.0.0.42 2025-01-09 07:33:14,365 - INFO - Validated that VN ctest-vn22-47380463 is not in any agent 2025-01-09 07:33:14,373 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463:ctest-vn22-47380463 2025-01-09 07:33:14,379 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-23412536:ctest-vn22-47380463 2025-01-09 07:33:14,385 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn22-47380463 info 2025-01-09 07:33:14,530 - DEBUG - No XMPP flaps were noticed during the test
2025-01-09 07:33:14,530 - INFO - END TEST : test_verify_object_logs : PASSED[0:00:24]
2025-01-09 07:33:14,531 - INFO - -------------------------------------------------------------------------------- 2025-01-09 07:33:15,185 - INFO - Deleted project: ctest-AnalyticsBasicTestSanity-23412536, ID : 5cbe4d6d-fe8a-47cd-abaa-37135b534999 2025-01-09 07:33:19,951 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-fvn-70418345 2025-01-09 07:33:19,958 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-fvn-70418345:ctest-fvn-70418345 2025-01-09 07:33:21,092 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-vn1-85912958 2025-01-09 07:33:21,100 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-vn1-85912958:ctest-vn1-85912958 2025-01-09 07:33:23,963 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-fvn-70418345:ctest-some-pool-95158252 2025-01-09 07:33:36,497 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRtGroupReq?x=target:64512:8000004 2025-01-09 07:33:39,406 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-fvn-70418345:ctest-some-pool-95158252 2025-01-09 07:33:41,810 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-vn1-85912958:ctest-vn1-85912958 2025-01-09 07:33:41,818 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-vn1-85912958 2025-01-09 07:33:42,049 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-fvn-70418345:ctest-fvn-70418345 2025-01-09 07:33:42,057 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-94915395:ctest-fvn-70418345 2025-01-09 07:34:19,251 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-43793406 2025-01-09 07:34:19,258 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-43793406:ctest-vn-43793406 2025-01-09 07:34:19,922 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-18116362 2025-01-09 07:34:19,931 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-18116362:ctest-vn-18116362 2025-01-09 07:34:20,566 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-18116362:ctest-vn-18116362 2025-01-09 07:34:20,572 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-18116362 2025-01-09 07:34:20,820 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-43793406:ctest-vn-43793406 2025-01-09 07:34:20,825 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00582106:ctest-vn-43793406 2025-01-09 07:34:26,565 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-18409305 2025-01-09 07:34:26,573 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-18409305:ctest-vn-18409305 2025-01-09 07:34:27,214 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-80810225 2025-01-09 07:34:27,220 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-80810225:ctest-vn-80810225 2025-01-09 07:34:51,741 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-80810225:ctest-vn-80810225 2025-01-09 07:34:51,748 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-80810225 2025-01-09 07:34:51,944 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-18409305:ctest-vn-18409305 2025-01-09 07:34:51,949 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-54266114:ctest-vn-18409305 2025-01-09 07:34:56,494 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-74699824:ctest-mgmt_vn-66852822 2025-01-09 07:34:56,500 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-74699824:ctest-mgmt_vn-66852822:ctest-mgmt_vn-66852822 2025-01-09 07:34:57,669 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-74699824:ctest-left_vn-69409786 2025-01-09 07:34:57,675 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-74699824:ctest-left_vn-69409786:ctest-left_vn-69409786 2025-01-09 07:34:58,468 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-74699824:ctest-right_vn-51309598 2025-01-09 07:34:58,474 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-74699824:ctest-right_vn-51309598:ctest-right_vn-51309598 2025-01-09 07:35:56,617 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-74699824:ctest-right_vn-51309598:ctest-right_vn-51309598 2025-01-09 07:35:56,624 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-74699824:ctest-right_vn-51309598 2025-01-09 07:35:56,813 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-74699824:ctest-left_vn-69409786:ctest-left_vn-69409786 2025-01-09 07:35:56,818 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-74699824:ctest-left_vn-69409786 2025-01-09 07:35:57,010 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-74699824:ctest-mgmt_vn-66852822:ctest-mgmt_vn-66852822 2025-01-09 07:35:57,017 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-74699824:ctest-mgmt_vn-66852822 2025-01-09 07:36:01,106 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS&search_string=virtual-DNS:default-domain:ctest-vdns1-29007854 2025-01-09 07:36:41,535 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS-record&search_string=virtual-DNS-record:default-domain:ctest-vdns1-29007854:test-rec 2025-01-09 07:36:49,370 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS&search_string=virtual-DNS:default-domain:ctest-vdns1-29007854 2025-01-09 07:38:02,057 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=network-ipam&search_string=network-ipam:default-domain:ctest-TestBasicVMVN-16233179:ctest-ipam-48023759 2025-01-09 07:38:02,320 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicVMVN-16233179:ctest-vn-02000097 2025-01-09 07:38:02,326 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-16233179:ctest-vn-02000097:ctest-vn-02000097 2025-01-09 07:38:35,238 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-16233179:ctest-vn-02000097:ctest-vn-02000097 2025-01-09 07:38:35,245 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicVMVN-16233179:ctest-vn-02000097 2025-01-09 07:38:35,310 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-16233179:ctest-ipam-48023759:ctest-ipam-48023759 2025-01-09 07:38:35,316 - DEBUG - Requesting: http://10.0.0.42:8083/Snh_IFMapTableShowReq?table_name=network-ipam&search_string=network-ipam:default-domain:ctest-TestBasicVMVN-16233179:ctest-ipam-48023759