2025-05-12 02:23:08,852 - INFO - Domain Default found not creating
2025-05-12 02:23:08,995 - INFO - Project ctest-AnalyticsBasicTestSanity-69792219 not found, creating it
2025-05-12 02:23:09,466 - INFO - Created Project:ctest-AnalyticsBasicTestSanity-69792219, ID : a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:10,987 - INFO - ================================================================================
2025-05-12 02:23:10,987 - INFO - STARTING TEST : test_verify_object_logs
2025-05-12 02:23:10,987 - INFO - TEST DESCRIPTION :
Description: Test to validate object logs
1.Create vn/vm and verify object log tables updated with
those vn, vm and routing-instance - fails otherwise
Maintainer: sandipd@juniper.net
2025-05-12 02:23:11,111 - DEBUG - Nothing to compare xmpp stats {'10.0.0.130': {'10.20.0.17': '0'}} with
2025-05-12 02:23:11,111 - INFO - Initial checks done. Running the testcase now
2025-05-12 02:23:11,111 - INFO -
2025-05-12 02:23:11,910 - DEBUG - Response for create_network : {'network': {'id': '5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395', 'name': 'ctest-vn22-07778668', 'tenant_id': 'a07864cce6bc4317929fc123beca8528', 'project_id': 'a07864cce6bc4317929fc123beca8528', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-69792219', 'ctest-vn22-07778668'], 'port_security_enabled': True, 'description': ''}}
2025-05-12 02:23:12,115 - DEBUG - Response for create_subnet : {'subnet': {'id': '441c783c-ffdc-42d7-a33a-299aeb77d3b8', 'name': '', 'tenant_id': 'a07864cce6bc4317929fc123beca8528', 'network_id': '5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395', 'ip_version': 4, 'cidr': '112.189.79.128/26', 'allocation_pools': [{'start': '112.189.79.130', 'end': '112.189.79.190'}], 'gateway_ip': '112.189.79.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '112.189.79.130', 'tags': [], 'project_id': 'a07864cce6bc4317929fc123beca8528'}}
2025-05-12 02:23:12,142 - INFO - Created VN ctest-vn22-07778668
2025-05-12 02:23:12,200 - DEBUG - VN ctest-vn22-07778668 UUID is 5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:12,312 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:12,641 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:12,668 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:12,686 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:12,765 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:12,776 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:12,786 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:12,793 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:12,799 - DEBUG - Route Targets: []
2025-05-12 02:23:12,799 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:17,800 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:17,807 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:17,818 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:17,894 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:17,904 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:17,919 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:17,926 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:17,933 - DEBUG - Route Targets: []
2025-05-12 02:23:17,933 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:22,934 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:22,941 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:22,974 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:23,051 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:23,061 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:23,071 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:23,077 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:23,084 - DEBUG - Route Targets: []
2025-05-12 02:23:23,084 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:28,085 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:28,092 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:28,103 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:28,176 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:28,186 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:28,196 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:28,202 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:28,209 - DEBUG - Route Targets: []
2025-05-12 02:23:28,209 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:33,209 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:33,216 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:33,227 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:33,309 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:33,320 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:33,329 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:33,336 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:33,342 - DEBUG - Route Targets: []
2025-05-12 02:23:33,342 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:38,343 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:38,357 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:38,369 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:38,459 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:38,472 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:38,484 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:38,492 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:38,502 - DEBUG - Route Targets: []
2025-05-12 02:23:38,502 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:43,503 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:43,509 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:43,521 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:43,590 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:43,600 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:43,610 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:43,619 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:43,626 - DEBUG - Route Targets: []
2025-05-12 02:23:43,626 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:48,627 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:48,634 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:48,645 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:48,721 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:48,736 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:48,749 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:48,756 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:48,762 - DEBUG - Route Targets: []
2025-05-12 02:23:48,762 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:53,764 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:53,771 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:53,782 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:53,852 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:53,862 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:53,872 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:53,879 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:53,885 - DEBUG - Route Targets: []
2025-05-12 02:23:53,885 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:23:58,886 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:23:58,893 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:23:58,904 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:23:58,974 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:58,984 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:23:58,993 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:58,999 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:23:59,005 - DEBUG - Route Targets: []
2025-05-12 02:23:59,005 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:24:04,007 - DEBUG - Requesting: http://10.0.0.130:8082/domains
2025-05-12 02:24:04,013 - DEBUG - Requesting: http://10.0.0.130:8082/domain/94500e9a-84c0-47cc-b918-7f84a249feb4
2025-05-12 02:24:04,025 - DEBUG - Requesting: http://10.0.0.130:8082/project/a07864cc-e6bc-4317-929f-c123beca8528
2025-05-12 02:24:04,099 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:24:04,108 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395
2025-05-12 02:24:04,118 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:24:04,124 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/a8f6113e-576e-4d59-9936-6f21a4339c52
2025-05-12 02:24:04,130 - DEBUG - Route Targets: []
2025-05-12 02:24:04,130 - DEBUG - RT names not yet present for VN ctest-vn22-07778668
2025-05-12 02:24:04,131 - ERROR - One or more verifications in API Server for VN ctest-vn22-07778668 failed
2025-05-12 02:24:04,237 - DEBUG - Services list from nova: [, , ]
2025-05-12 02:24:04,332 - DEBUG - Image by name cirros not found
2025-05-12 02:24:04,332 - DEBUG - Installing image cirros
2025-05-12 02:24:04,332 - DEBUG - Image info {'name': 'cirros-0.3.0-x86_64-disk.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'cubswin:)', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-05-12 02:24:04,332 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz
2025-05-12 02:24:04,333 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz
2025-05-12 02:24:04,342 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz -O /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz
2025-05-12 02:24:04,401 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz
2025-05-12 02:24:04,401 - DEBUG - Unzip image
2025-05-12 02:24:04,401 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz
2025-05-12 02:24:04,546 - DEBUG - Try to create image in user context
2025-05-12 02:24:04,763 - DEBUG - Image has been created in user context
2025-05-12 02:24:04,763 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk
2025-05-12 02:24:04,775 - DEBUG - Downloaded image has been removed
2025-05-12 02:24:04,795 - DEBUG - Uploaded image status = active
2025-05-12 02:24:07,436 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3299-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3299-1)
2025-05-12 02:24:07,475 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-05-12 02:24:12,580 - DEBUG - VM is in ACTIVE state now
2025-05-12 02:24:12,580 - DEBUG - Verifying ObjectVNTable for vn default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668 on analytics node 10.0.0.130
2025-05-12 02:24:12,584 - DEBUG - Posting: http://10.0.0.130:8081/analytics/query, payload {'table': 'ObjectVNTable', 'start_time': 1747016591111840, 'end_time': 1747016652584521, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'Messagetype', 'ModuleId', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'op': 1, 'value2': None}]]}
2025-05-12 02:24:12,914 - DEBUG - Posting: http://10.0.0.130:8081/analytics/query, payload {'table': 'ObjectVNTable', 'start_time': 1747016591111840, 'end_time': 1747016652584521, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'Messagetype', 'ModuleId', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'op': 1, 'value2': None}]]}
2025-05-12 02:24:13,984 - DEBUG - Query output : [{'MessageTS': 1747016651399565, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'Addition 5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668112.189.79.12826112.189.79.129default-domain:default-project:default-network-ipamtrue112.189.79.130true
truetruetruecontroller/src/vnsw/agent/oper/vn.cc1391', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016651406474, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'Modification 5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668112.189.79.12826112.189.79.129default-domain:default-project:default-network-ipamtrue112.189.79.130true
truetruetruecontroller/src/vnsw/agent/oper/vn.cc1391', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016591861540, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1.', 'SystemLog': None}, {'MessageTS': 1747016591890849, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668target:10.20.0.17:7target:64512:7999999
cn-jenkins-deploy-platform-ansible-os-3299-1controller/src/bgp/routing-instance/routing_instance.cc1238', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016591890870, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668Addinetcn-jenkins-deploy-platform-ansible-os-3299-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016591892491, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668Addinet6cn-jenkins-deploy-platform-ansible-os-3299-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016591892690, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668Adderm-vpncn-jenkins-deploy-platform-ansible-os-3299-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016591892843, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668Adde-vpncn-jenkins-deploy-platform-ansible-os-3299-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016591893056, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668Addinet-mvpncn-jenkins-deploy-platform-ansible-os-3299-1controller/src/bgp/routing-instance/routing_instance.cc1718', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016592078140, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1.', 'SystemLog': None}, {'MessageTS': 1747016644812141, 'Messagetype': 'RoutingInstanceStats', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'ObjectLog': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}]
2025-05-12 02:24:13,984 - DEBUG - Verifying ObjectVMTable for vm 476cf34f-be81-4f84-9649-a146408e00f3 on analytics node 10.0.0.130
2025-05-12 02:24:13,984 - DEBUG - Posting: http://10.0.0.130:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1747016591111840, 'end_time': 1747016653984725, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '476cf34f-be81-4f84-9649-a146408e00f3', 'op': 1, 'value2': None}]]}
2025-05-12 02:24:15,011 - DEBUG - Query output : [{'MessageTS': 1747016651359628, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '476cf34f-be81-4f84-9649-a146408e00f3', 'ObjectLog': 'Addition 476cf34f-be81-4f84-9649-a146408e00f30controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016651372556, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '476cf34f-be81-4f84-9649-a146408e00f3', 'ObjectLog': 'Modification 476cf34f-be81-4f84-9649-a146408e00f31controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016648528540, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '476cf34f-be81-4f84-9649-a146408e00f3', 'ObjectLog': '476cf34f-be81-4f84-9649-a146408e00f3false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1.', 'SystemLog': None}]
2025-05-12 02:24:15,011 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668 on analytics node 10.0.0.130
2025-05-12 02:24:15,011 - DEBUG - Posting: http://10.0.0.130:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1747016591111840, 'end_time': 1747016655011461, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668', 'op': 1, 'value2': None}]]}
2025-05-12 02:24:16,034 - DEBUG - Query output : [{'MessageTS': 1747016651399640, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668', 'ObjectLog': 'Addition default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-077786682controller/src/vnsw/agent/oper/vrf.cc414', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}]
2025-05-12 02:24:16,034 - DEBUG - Verifying ObjectVMTable for vm 476cf34f-be81-4f84-9649-a146408e00f3 on analytics node 10.0.0.130
2025-05-12 02:24:16,034 - DEBUG - Posting: http://10.0.0.130:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1747016591111840, 'end_time': 1747016656034880, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '476cf34f-be81-4f84-9649-a146408e00f3', 'op': 1, 'value2': None}]]}
2025-05-12 02:24:17,068 - DEBUG - Query output : [{'MessageTS': 1747016651359628, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '476cf34f-be81-4f84-9649-a146408e00f3', 'ObjectLog': 'Addition 476cf34f-be81-4f84-9649-a146408e00f30controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016651372556, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '476cf34f-be81-4f84-9649-a146408e00f3', 'ObjectLog': 'Modification 476cf34f-be81-4f84-9649-a146408e00f31controller/src/vnsw/agent/oper/vm.cc141', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}, {'MessageTS': 1747016648528540, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '476cf34f-be81-4f84-9649-a146408e00f3', 'ObjectLog': '476cf34f-be81-4f84-9649-a146408e00f3false', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1.', 'SystemLog': None}]
2025-05-12 02:24:17,068 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668 on analytics node 10.0.0.130
2025-05-12 02:24:17,069 - DEBUG - Posting: http://10.0.0.130:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1747016591111840, 'end_time': 1747016657068975, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668', 'op': 1, 'value2': None}]]}
2025-05-12 02:24:18,092 - DEBUG - Query output : [{'MessageTS': 1747016651399640, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-07778668', 'ObjectLog': 'Addition default-domain:ctest-AnalyticsBasicTestSanity-69792219:ctest-vn22-07778668:ctest-vn22-077786682controller/src/vnsw/agent/oper/vrf.cc414', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3299-1', 'SystemLog': None}]
2025-05-12 02:24:18,092 - INFO - Validated ObjectVNTable, ObjectRoutingInstance, ObjectVMTable logs
2025-05-12 02:24:18,092 - INFO - Deleting VM ctest-AnalyticsBasicTestSanity-69792219-68127731
2025-05-12 02:24:18,237 - INFO - Deleting VN ctest-vn22-07778668
2025-05-12 02:24:18,280 - DEBUG - VN 5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395 still in use: Unable to complete operation on network 5a0a5e83-bc2a-4a4b-b2cd-08bb7efda395. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-5aa73ac2-b0d8-41e5-9fd6-63412ad2fc6f']
2025-05-12 02:24:18,280 - WARNING - Deleting VN ctest-vn22-07778668 failed..Will retry
2025-05-12 02:24:20,374 - DEBUG - Response for deleting network ()
2025-05-12 02:24:20,498 - DEBUG - No XMPP flaps were noticed during the test
2025-05-12 02:24:20,498 - INFO - END TEST : test_verify_object_logs : PASSED[0:01:10]
2025-05-12 02:24:20,498 - INFO - --------------------------------------------------------------------------------
2025-05-12 02:24:21,230 - INFO - Deleted project: ctest-AnalyticsBasicTestSanity-69792219, ID : a07864cc-e6bc-4317-929f-c123beca8528