]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2)
2025-08-14 03:01:03,809 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-48373772']
2025-08-14 03:01:04,123 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-48373772'] created succesfully
2025-08-14 03:01:04,485 - DEBUG - Image by name tiny_nat_fw not found
2025-08-14 03:01:04,485 - DEBUG - Installing image tiny_nat_fw
2025-08-14 03:01:04,485 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-14 03:01:04,485 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:04,485 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:04,499 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:04,706 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:04,706 - DEBUG - Unzip image
2025-08-14 03:01:04,706 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:04,723 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-08-14 03:01:04,723 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-48373772']
2025-08-14 03:01:04,811 - INFO - Service template: ['default-domain', 'ctest-service_template_1-48373772'] deleted successfully.
2025-08-14 03:01:04,812 - INFO - Skip interface_detach for VM ctest-right_vm-66491906 in state BUILD
2025-08-14 03:01:04,812 - INFO - Deleting VM ctest-right_vm-66491906
2025-08-14 03:01:04,836 - ERROR - VM ctest-right_vm-66491906 has failed to come up
2025-08-14 03:01:04,836 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:04,836 - ERROR - VM ctest-right_vm-66491906 has failed to come up
2025-08-14 03:01:04,836 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:04,892 - INFO - Skip interface_detach for VM ctest-left_vm-40247109 in state BUILD
2025-08-14 03:01:04,892 - INFO - Deleting VM ctest-left_vm-40247109
2025-08-14 03:01:04,892 - ERROR - VM ctest-left_vm-40247109 has failed to come up
2025-08-14 03:01:04,892 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:04,893 - ERROR - VM ctest-left_vm-40247109 has failed to come up
2025-08-14 03:01:04,893 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:04,953 - INFO - Deleting VN ctest-right_vn-29116120
2025-08-14 03:01:04,992 - DEBUG - VN 9d907c10-89e3-46d4-afff-e6358436caff still in use: Unable to complete operation on network 9d907c10-89e3-46d4-afff-e6358436caff. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7577d872-2af7-4221-b05e-039ac71b267c']
2025-08-14 03:01:04,992 - WARNING - Deleting VN ctest-right_vn-29116120 failed..Will retry
2025-08-14 03:01:07,204 - DEBUG - Response for deleting network ()
2025-08-14 03:01:07,204 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/0fdb02ee-156c-4838-9d03-c142670102e9
2025-08-14 03:01:07,212 - DEBUG - Response Code: 404
2025-08-14 03:01:07,212 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:07,222 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:07,292 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:07,440 - INFO - Validated that VN ctest-right_vn-29116120 is not found in API Server
2025-08-14 03:01:07,454 - DEBUG - VN ctest-right_vn-29116120 is not present in Agent 10.0.0.65
2025-08-14 03:01:07,466 - DEBUG - VN ctest-right_vn-29116120 is not present in Agent 10.0.0.130
2025-08-14 03:01:07,466 - INFO - Validated that VN ctest-right_vn-29116120 is not in any agent
2025-08-14 03:01:07,506 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-29116120 info
2025-08-14 03:01:07,506 - INFO - Deleting VN ctest-left_vn-89771253
2025-08-14 03:01:07,656 - DEBUG - Response for deleting network ()
2025-08-14 03:01:07,656 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f513fb7c-f5d7-45c7-b458-d4611771882b
2025-08-14 03:01:07,662 - DEBUG - Response Code: 404
2025-08-14 03:01:07,663 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:07,669 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:07,736 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:07,830 - INFO - Validated that VN ctest-left_vn-89771253 is not found in API Server
2025-08-14 03:01:07,844 - DEBUG - VN ctest-left_vn-89771253 is not present in Agent 10.0.0.65
2025-08-14 03:01:07,859 - DEBUG - VN ctest-left_vn-89771253 is not present in Agent 10.0.0.130
2025-08-14 03:01:07,859 - INFO - Validated that VN ctest-left_vn-89771253 is not in any agent
2025-08-14 03:01:07,896 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-89771253 info
2025-08-14 03:01:07,896 - INFO - Deleting VN ctest-mgmt_vn-08558614
2025-08-14 03:01:08,034 - DEBUG - Response for deleting network ()
2025-08-14 03:01:08,034 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/824991d3-e537-456d-8cee-04343d960a85
2025-08-14 03:01:08,049 - DEBUG - Response Code: 404
2025-08-14 03:01:08,049 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:08,056 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:08,069 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:08,159 - INFO - Validated that VN ctest-mgmt_vn-08558614 is not found in API Server
2025-08-14 03:01:08,174 - DEBUG - VN ctest-mgmt_vn-08558614 is not present in Agent 10.0.0.65
2025-08-14 03:01:08,187 - DEBUG - VN ctest-mgmt_vn-08558614 is not present in Agent 10.0.0.130
2025-08-14 03:01:08,187 - INFO - Validated that VN ctest-mgmt_vn-08558614 is not in any agent
2025-08-14 03:01:08,222 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-08558614 info
2025-08-14 03:01:08,222 - INFO - Deleting VM ctest-vm-in-third-vn-69877942
2025-08-14 03:01:08,290 - INFO - Deleting VN ctest-third-vn-31009756
2025-08-14 03:01:08,336 - DEBUG - VN ae3314b1-4f80-4f92-a335-4f6ab48e059d still in use: Unable to complete operation on network ae3314b1-4f80-4f92-a335-4f6ab48e059d. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-cfa98b6a-3e20-4e47-abcb-fecf7bb54ef5']
2025-08-14 03:01:08,337 - WARNING - Deleting VN ctest-third-vn-31009756 failed..Will retry
2025-08-14 03:01:10,519 - DEBUG - Response for deleting network ()
2025-08-14 03:01:11,788 - DEBUG - No XMPP flaps were noticed during the test
2025-08-14 03:01:11,788 - INFO -
2025-08-14 03:01:11,788 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : SKIPPED[0:00:24]
2025-08-14 03:01:11,788 - INFO - --------------------------------------------------------------------------------
2025-08-14 03:01:11,792 - INFO - ================================================================================
2025-08-14 03:01:11,792 - INFO - STARTING TEST : test_svc_v2_transparent_datapath
2025-08-14 03:01:13,048 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.25': '0'}} with
2025-08-14 03:01:13,048 - INFO - Initial checks done. Running the testcase now
2025-08-14 03:01:13,048 - INFO -
2025-08-14 03:01:13,300 - DEBUG - Response for create_network : {'network': {'id': '964b8ea8-7976-40bc-be2a-63fab0f271a6', 'name': 'ctest-mgmt_vn-57285714', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'project_id': '6d3e6227dfe44a319da85869b4c50462', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-58616616', 'ctest-mgmt_vn-57285714'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:13,508 - DEBUG - Response for create_subnet : {'subnet': {'id': '371307f1-8b18-4e5c-841a-43717a0f66b9', 'name': '', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'network_id': '964b8ea8-7976-40bc-be2a-63fab0f271a6', 'ip_version': 4, 'cidr': '43.49.241.64/26', 'allocation_pools': [{'start': '43.49.241.66', 'end': '43.49.241.126'}], 'gateway_ip': '43.49.241.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.49.241.66', 'tags': [], 'project_id': '6d3e6227dfe44a319da85869b4c50462'}}
2025-08-14 03:01:13,535 - INFO - Created VN ctest-mgmt_vn-57285714
2025-08-14 03:01:13,548 - DEBUG - VN ctest-mgmt_vn-57285714 UUID is 964b8ea8-7976-40bc-be2a-63fab0f271a6
2025-08-14 03:01:13,620 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:13,627 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:13,640 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:13,734 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/964b8ea8-7976-40bc-be2a-63fab0f271a6
2025-08-14 03:01:13,747 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/964b8ea8-7976-40bc-be2a-63fab0f271a6
2025-08-14 03:01:13,757 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f4e79d65-43c4-4bb1-9d48-810e057f5950
2025-08-14 03:01:13,765 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f4e79d65-43c4-4bb1-9d48-810e057f5950
2025-08-14 03:01:13,772 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/71e36db4-21a1-40a6-8683-60722d712a73
2025-08-14 03:01:13,784 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:13,784 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/964b8ea8-7976-40bc-be2a-63fab0f271a6
2025-08-14 03:01:13,794 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f4e79d65-43c4-4bb1-9d48-810e057f5950
2025-08-14 03:01:13,813 - INFO - Verified VN network id 13 for VN 964b8ea8-7976-40bc-be2a-63fab0f271a6
2025-08-14 03:01:13,813 - INFO - Verifications in API Server for VN ctest-mgmt_vn-57285714 passed
2025-08-14 03:01:13,814 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/964b8ea8-7976-40bc-be2a-63fab0f271a6
2025-08-14 03:01:13,824 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f4e79d65-43c4-4bb1-9d48-810e057f5950
2025-08-14 03:01:13,836 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f4e79d65-43c4-4bb1-9d48-810e057f5950
2025-08-14 03:01:13,844 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/71e36db4-21a1-40a6-8683-60722d712a73
2025-08-14 03:01:13,857 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10829906583185932476', 'uuid-lslong': '13702874744589808038'}, 'enable': 'true', 'created': '2025-08-14T03:01:13', 'last-modified': '2025-08-14T03:01:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.409833'}
2025-08-14 03:01:13,864 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:13,871 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10829906583185932476', 'uuid-lslong': '13702874744589808038'}, 'enable': 'true', 'created': '2025-08-14T03:01:13', 'last-modified': '2025-08-14T03:01:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415507'}
2025-08-14 03:01:13,880 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:13,887 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10829906583185932476', 'uuid-lslong': '13702874744589808038'}, 'enable': 'true', 'created': '2025-08-14T03:01:13', 'last-modified': '2025-08-14T03:01:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436915'}
2025-08-14 03:01:13,894 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:13,894 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-57285714 passed
2025-08-14 03:01:13,894 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-57285714 in API_Server ======
2025-08-14 03:01:13,894 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:13,901 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:13,913 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:14,012 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/964b8ea8-7976-40bc-be2a-63fab0f271a6
2025-08-14 03:01:14,022 - DEBUG - =>VN ctest-mgmt_vn-57285714 has no policy to be verified
2025-08-14 03:01:14,022 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:14,022 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:14,022 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:14,035 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714?flat'}
2025-08-14 03:01:14,035 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:14,035 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:14,047 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714?flat'}
2025-08-14 03:01:14,047 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:14,047 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:14,060 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714?flat'}
2025-08-14 03:01:14,060 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-58616616:ctest-mgmt_vn-57285714 is found in opserver
2025-08-14 03:01:14,083 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:14,095 - DEBUG - VRF ids for VN ctest-mgmt_vn-57285714: {}
2025-08-14 03:01:14,366 - DEBUG - Response for create_network : {'network': {'id': 'a4c6b43f-8d39-49e4-9185-fc03a1bb125c', 'name': 'ctest-left_vn-53875788', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'project_id': '6d3e6227dfe44a319da85869b4c50462', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-58616616', 'ctest-left_vn-53875788'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:14,644 - DEBUG - Response for create_subnet : {'subnet': {'id': '29250be0-6f33-4652-a557-6265ed8f8785', 'name': '', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'network_id': 'a4c6b43f-8d39-49e4-9185-fc03a1bb125c', 'ip_version': 4, 'cidr': '2.52.21.192/26', 'allocation_pools': [{'start': '2.52.21.194', 'end': '2.52.21.254'}], 'gateway_ip': '2.52.21.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2.52.21.194', 'tags': [], 'project_id': '6d3e6227dfe44a319da85869b4c50462'}}
2025-08-14 03:01:14,672 - INFO - Created VN ctest-left_vn-53875788
2025-08-14 03:01:14,686 - DEBUG - VN ctest-left_vn-53875788 UUID is a4c6b43f-8d39-49e4-9185-fc03a1bb125c
2025-08-14 03:01:14,761 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:14,768 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:14,780 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:14,884 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a4c6b43f-8d39-49e4-9185-fc03a1bb125c
2025-08-14 03:01:14,900 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a4c6b43f-8d39-49e4-9185-fc03a1bb125c
2025-08-14 03:01:14,913 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5fa69783-d50c-480a-83dd-8abf2d72e8c5
2025-08-14 03:01:14,924 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5fa69783-d50c-480a-83dd-8abf2d72e8c5
2025-08-14 03:01:14,938 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/29f945ea-ee84-4f75-b87e-a2f318a5f4ca
2025-08-14 03:01:14,951 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:14,951 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a4c6b43f-8d39-49e4-9185-fc03a1bb125c
2025-08-14 03:01:14,962 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5fa69783-d50c-480a-83dd-8abf2d72e8c5
2025-08-14 03:01:14,978 - INFO - Verified VN network id 14 for VN a4c6b43f-8d39-49e4-9185-fc03a1bb125c
2025-08-14 03:01:14,979 - INFO - Verifications in API Server for VN ctest-left_vn-53875788 passed
2025-08-14 03:01:14,979 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a4c6b43f-8d39-49e4-9185-fc03a1bb125c
2025-08-14 03:01:14,989 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5fa69783-d50c-480a-83dd-8abf2d72e8c5
2025-08-14 03:01:14,997 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5fa69783-d50c-480a-83dd-8abf2d72e8c5
2025-08-14 03:01:15,005 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/29f945ea-ee84-4f75-b87e-a2f318a5f4ca
2025-08-14 03:01:15,018 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11873375652654172644', 'uuid-lslong': '10486064399930561116'}, 'enable': 'true', 'created': '2025-08-14T03:01:14', 'last-modified': '2025-08-14T03:01:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.451655'}
2025-08-14 03:01:15,025 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:15,032 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11873375652654172644', 'uuid-lslong': '10486064399930561116'}, 'enable': 'true', 'created': '2025-08-14T03:01:14', 'last-modified': '2025-08-14T03:01:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465702'}
2025-08-14 03:01:15,040 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:15,048 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11873375652654172644', 'uuid-lslong': '10486064399930561116'}, 'enable': 'true', 'created': '2025-08-14T03:01:14', 'last-modified': '2025-08-14T03:01:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.478319'}
2025-08-14 03:01:15,056 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:15,056 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-53875788 passed
2025-08-14 03:01:15,056 - DEBUG - ====Verifying policy data for ctest-left_vn-53875788 in API_Server ======
2025-08-14 03:01:15,056 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:15,062 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:15,074 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:15,166 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a4c6b43f-8d39-49e4-9185-fc03a1bb125c
2025-08-14 03:01:15,181 - DEBUG - =>VN ctest-left_vn-53875788 has no policy to be verified
2025-08-14 03:01:15,181 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:15,181 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:15,181 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:15,198 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788?flat'}
2025-08-14 03:01:15,198 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:15,198 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:15,211 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788?flat'}
2025-08-14 03:01:15,211 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:15,211 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:15,226 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788?flat'}
2025-08-14 03:01:15,226 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-58616616:ctest-left_vn-53875788 is found in opserver
2025-08-14 03:01:15,249 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:15,261 - DEBUG - VRF ids for VN ctest-left_vn-53875788: {}
2025-08-14 03:01:15,537 - DEBUG - Response for create_network : {'network': {'id': '8962ead5-ad22-4346-b7e3-c38be8505fdf', 'name': 'ctest-right_vn-46376261', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'project_id': '6d3e6227dfe44a319da85869b4c50462', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-58616616', 'ctest-right_vn-46376261'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:15,766 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bdb77be2-6823-4ebe-918e-53b2f2b5aa33', 'name': '', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'network_id': '8962ead5-ad22-4346-b7e3-c38be8505fdf', 'ip_version': 4, 'cidr': '60.97.16.0/26', 'allocation_pools': [{'start': '60.97.16.2', 'end': '60.97.16.62'}], 'gateway_ip': '60.97.16.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '60.97.16.2', 'tags': [], 'project_id': '6d3e6227dfe44a319da85869b4c50462'}}
2025-08-14 03:01:15,792 - INFO - Created VN ctest-right_vn-46376261
2025-08-14 03:01:15,805 - DEBUG - VN ctest-right_vn-46376261 UUID is 8962ead5-ad22-4346-b7e3-c38be8505fdf
2025-08-14 03:01:15,889 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:15,896 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:15,909 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:15,999 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8962ead5-ad22-4346-b7e3-c38be8505fdf
2025-08-14 03:01:16,011 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8962ead5-ad22-4346-b7e3-c38be8505fdf
2025-08-14 03:01:16,021 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c5ffe85e-a944-496d-b6cf-83d00a87b044
2025-08-14 03:01:16,029 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c5ffe85e-a944-496d-b6cf-83d00a87b044
2025-08-14 03:01:16,037 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/7332696f-5c47-4479-86db-d85f756f7bf6
2025-08-14 03:01:16,045 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:16,045 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8962ead5-ad22-4346-b7e3-c38be8505fdf
2025-08-14 03:01:16,056 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c5ffe85e-a944-496d-b6cf-83d00a87b044
2025-08-14 03:01:16,074 - INFO - Verified VN network id 15 for VN 8962ead5-ad22-4346-b7e3-c38be8505fdf
2025-08-14 03:01:16,074 - INFO - Verifications in API Server for VN ctest-right_vn-46376261 passed
2025-08-14 03:01:16,074 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8962ead5-ad22-4346-b7e3-c38be8505fdf
2025-08-14 03:01:16,085 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c5ffe85e-a944-496d-b6cf-83d00a87b044
2025-08-14 03:01:16,094 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c5ffe85e-a944-496d-b6cf-83d00a87b044
2025-08-14 03:01:16,102 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/7332696f-5c47-4479-86db-d85f756f7bf6
2025-08-14 03:01:16,115 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9899733134367408966', 'uuid-lslong': '13250649534319583199'}, 'enable': 'true', 'created': '2025-08-14T03:01:15', 'last-modified': '2025-08-14T03:01:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410085'}
2025-08-14 03:01:16,121 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:16,128 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9899733134367408966', 'uuid-lslong': '13250649534319583199'}, 'enable': 'true', 'created': '2025-08-14T03:01:15', 'last-modified': '2025-08-14T03:01:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.427257'}
2025-08-14 03:01:16,135 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:16,142 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9899733134367408966', 'uuid-lslong': '13250649534319583199'}, 'enable': 'true', 'created': '2025-08-14T03:01:15', 'last-modified': '2025-08-14T03:01:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442483'}
2025-08-14 03:01:16,149 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:16,150 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-46376261 passed
2025-08-14 03:01:16,150 - DEBUG - ====Verifying policy data for ctest-right_vn-46376261 in API_Server ======
2025-08-14 03:01:16,150 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:16,156 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:16,169 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:16,276 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8962ead5-ad22-4346-b7e3-c38be8505fdf
2025-08-14 03:01:16,287 - DEBUG - =>VN ctest-right_vn-46376261 has no policy to be verified
2025-08-14 03:01:16,287 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:16,287 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:16,287 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:16,301 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261?flat'}
2025-08-14 03:01:16,301 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:16,301 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:16,315 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261?flat'}
2025-08-14 03:01:16,315 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:16,315 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:16,330 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261?flat'}
2025-08-14 03:01:16,330 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-58616616:ctest-right_vn-46376261 is found in opserver
2025-08-14 03:01:16,352 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:16,363 - DEBUG - VRF ids for VN ctest-right_vn-46376261: {}
2025-08-14 03:01:16,641 - DEBUG - Response for create_network : {'network': {'id': 'd4d30fa8-ed81-4d5b-b190-a63041a4dd94', 'name': 'ctest-trans_left_vn-05288906', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'project_id': '6d3e6227dfe44a319da85869b4c50462', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-58616616', 'ctest-trans_left_vn-05288906'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:16,859 - DEBUG - Response for create_subnet : {'subnet': {'id': '77ee2613-fed3-441f-95a6-ab1ff2c6db21', 'name': '', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'network_id': 'd4d30fa8-ed81-4d5b-b190-a63041a4dd94', 'ip_version': 4, 'cidr': '181.244.186.0/26', 'allocation_pools': [{'start': '181.244.186.2', 'end': '181.244.186.62'}], 'gateway_ip': '181.244.186.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '181.244.186.2', 'tags': [], 'project_id': '6d3e6227dfe44a319da85869b4c50462'}}
2025-08-14 03:01:16,881 - INFO - Created VN ctest-trans_left_vn-05288906
2025-08-14 03:01:16,895 - DEBUG - VN ctest-trans_left_vn-05288906 UUID is d4d30fa8-ed81-4d5b-b190-a63041a4dd94
2025-08-14 03:01:16,987 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:16,993 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:17,005 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:17,108 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d4d30fa8-ed81-4d5b-b190-a63041a4dd94
2025-08-14 03:01:17,121 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d4d30fa8-ed81-4d5b-b190-a63041a4dd94
2025-08-14 03:01:17,132 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1d4951d9-12bf-4a51-b2fe-d98b63b7e9cc
2025-08-14 03:01:17,140 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1d4951d9-12bf-4a51-b2fe-d98b63b7e9cc
2025-08-14 03:01:17,148 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/3a3efb56-aef5-400f-83f1-ca40a28d0b41
2025-08-14 03:01:17,155 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-14 03:01:17,155 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d4d30fa8-ed81-4d5b-b190-a63041a4dd94
2025-08-14 03:01:17,165 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1d4951d9-12bf-4a51-b2fe-d98b63b7e9cc
2025-08-14 03:01:17,181 - INFO - Verified VN network id 16 for VN d4d30fa8-ed81-4d5b-b190-a63041a4dd94
2025-08-14 03:01:17,182 - INFO - Verifications in API Server for VN ctest-trans_left_vn-05288906 passed
2025-08-14 03:01:17,182 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d4d30fa8-ed81-4d5b-b190-a63041a4dd94
2025-08-14 03:01:17,193 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1d4951d9-12bf-4a51-b2fe-d98b63b7e9cc
2025-08-14 03:01:17,201 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1d4951d9-12bf-4a51-b2fe-d98b63b7e9cc
2025-08-14 03:01:17,209 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/3a3efb56-aef5-400f-83f1-ca40a28d0b41
2025-08-14 03:01:17,222 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15335618374340267355', 'uuid-lslong': '12794909267549543828'}, 'enable': 'true', 'created': '2025-08-14T03:01:16', 'last-modified': '2025-08-14T03:01:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421673'}
2025-08-14 03:01:17,230 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-14 03:01:17,237 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15335618374340267355', 'uuid-lslong': '12794909267549543828'}, 'enable': 'true', 'created': '2025-08-14T03:01:16', 'last-modified': '2025-08-14T03:01:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426788'}
2025-08-14 03:01:17,243 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-14 03:01:17,249 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15335618374340267355', 'uuid-lslong': '12794909267549543828'}, 'enable': 'true', 'created': '2025-08-14T03:01:16', 'last-modified': '2025-08-14T03:01:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444047'}
2025-08-14 03:01:17,255 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-14 03:01:17,255 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-05288906 passed
2025-08-14 03:01:17,256 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-05288906 in API_Server ======
2025-08-14 03:01:17,256 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:17,261 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:17,273 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:17,373 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d4d30fa8-ed81-4d5b-b190-a63041a4dd94
2025-08-14 03:01:17,386 - DEBUG - =>VN ctest-trans_left_vn-05288906 has no policy to be verified
2025-08-14 03:01:17,387 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:17,387 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:17,387 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:17,400 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906?flat'}
2025-08-14 03:01:17,400 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:17,400 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:17,413 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906?flat'}
2025-08-14 03:01:17,413 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:17,413 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:17,427 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906?flat'}
2025-08-14 03:01:17,427 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-58616616:ctest-trans_left_vn-05288906 is found in opserver
2025-08-14 03:01:17,451 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:17,464 - DEBUG - VRF ids for VN ctest-trans_left_vn-05288906: {}
2025-08-14 03:01:17,779 - DEBUG - Response for create_network : {'network': {'id': '4973368d-a1af-4450-8595-fc3ba5e436f1', 'name': 'ctest-trans_right_vn-68283821', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'project_id': '6d3e6227dfe44a319da85869b4c50462', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-58616616', 'ctest-trans_right_vn-68283821'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:18,100 - DEBUG - Response for create_subnet : {'subnet': {'id': '84abe376-56fe-41b0-a6d9-b75198cbcb10', 'name': '', 'tenant_id': '6d3e6227dfe44a319da85869b4c50462', 'network_id': '4973368d-a1af-4450-8595-fc3ba5e436f1', 'ip_version': 4, 'cidr': '208.25.132.192/26', 'allocation_pools': [{'start': '208.25.132.194', 'end': '208.25.132.254'}], 'gateway_ip': '208.25.132.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '208.25.132.194', 'tags': [], 'project_id': '6d3e6227dfe44a319da85869b4c50462'}}
2025-08-14 03:01:18,122 - INFO - Created VN ctest-trans_right_vn-68283821
2025-08-14 03:01:18,134 - DEBUG - VN ctest-trans_right_vn-68283821 UUID is 4973368d-a1af-4450-8595-fc3ba5e436f1
2025-08-14 03:01:18,200 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:18,206 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:18,218 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:18,313 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4973368d-a1af-4450-8595-fc3ba5e436f1
2025-08-14 03:01:18,328 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4973368d-a1af-4450-8595-fc3ba5e436f1
2025-08-14 03:01:18,339 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/39c61809-ecbb-4acc-8ee9-406846538ab7
2025-08-14 03:01:18,349 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/39c61809-ecbb-4acc-8ee9-406846538ab7
2025-08-14 03:01:18,357 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/840aecbb-6b49-4eb1-9b49-f46e55573113
2025-08-14 03:01:18,365 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-14 03:01:18,365 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4973368d-a1af-4450-8595-fc3ba5e436f1
2025-08-14 03:01:18,375 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/39c61809-ecbb-4acc-8ee9-406846538ab7
2025-08-14 03:01:18,390 - INFO - Verified VN network id 17 for VN 4973368d-a1af-4450-8595-fc3ba5e436f1
2025-08-14 03:01:18,390 - INFO - Verifications in API Server for VN ctest-trans_right_vn-68283821 passed
2025-08-14 03:01:18,391 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4973368d-a1af-4450-8595-fc3ba5e436f1
2025-08-14 03:01:18,405 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/39c61809-ecbb-4acc-8ee9-406846538ab7
2025-08-14 03:01:18,414 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/39c61809-ecbb-4acc-8ee9-406846538ab7
2025-08-14 03:01:18,422 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/840aecbb-6b49-4eb1-9b49-f46e55573113
2025-08-14 03:01:18,434 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5292633969021371472', 'uuid-lslong': '9625877111690770161'}, 'enable': 'true', 'created': '2025-08-14T03:01:17', 'last-modified': '2025-08-14T03:01:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401699'}
2025-08-14 03:01:18,441 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-14 03:01:18,447 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5292633969021371472', 'uuid-lslong': '9625877111690770161'}, 'enable': 'true', 'created': '2025-08-14T03:01:17', 'last-modified': '2025-08-14T03:01:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425353'}
2025-08-14 03:01:18,454 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-14 03:01:18,460 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-58616616', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5292633969021371472', 'uuid-lslong': '9625877111690770161'}, 'enable': 'true', 'created': '2025-08-14T03:01:17', 'last-modified': '2025-08-14T03:01:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420357'}
2025-08-14 03:01:18,467 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-14 03:01:18,467 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-68283821 passed
2025-08-14 03:01:18,467 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-68283821 in API_Server ======
2025-08-14 03:01:18,467 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:18,473 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:18,485 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:18,582 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/4973368d-a1af-4450-8595-fc3ba5e436f1
2025-08-14 03:01:18,596 - DEBUG - =>VN ctest-trans_right_vn-68283821 has no policy to be verified
2025-08-14 03:01:18,596 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:18,596 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:18,596 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:18,608 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821?flat'}
2025-08-14 03:01:18,608 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:18,608 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:18,622 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821?flat'}
2025-08-14 03:01:18,622 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:18,622 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:18,635 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821?flat'}
2025-08-14 03:01:18,636 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-58616616:ctest-trans_right_vn-68283821 is found in opserver
2025-08-14 03:01:18,661 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:18,673 - DEBUG - VRF ids for VN ctest-trans_right_vn-68283821: {}
2025-08-14 03:01:19,748 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2)
2025-08-14 03:01:20,982 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1)
2025-08-14 03:01:20,982 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-47060832']
2025-08-14 03:01:21,290 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-47060832'] created succesfully
2025-08-14 03:01:21,629 - DEBUG - Image by name tiny_trans_fw not found
2025-08-14 03:01:21,629 - DEBUG - Installing image tiny_trans_fw
2025-08-14 03:01:21,629 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-08-14 03:01:21,629 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-08-14 03:01:21,630 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-08-14 03:01:21,643 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-14 03:01:21,669 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-14 03:01:21,669 - DEBUG - Unzip image
2025-08-14 03:01:21,669 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-14 03:01:21,707 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found
2025-08-14 03:01:21,708 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-47060832']
2025-08-14 03:01:21,827 - INFO - Service template: ['default-domain', 'ctest-service_template_1-47060832'] deleted successfully.
2025-08-14 03:01:21,828 - INFO - Skip interface_detach for VM ctest-right_vm-64404483 in state BUILD
2025-08-14 03:01:21,828 - INFO - Deleting VM ctest-right_vm-64404483
2025-08-14 03:01:21,828 - ERROR - VM ctest-right_vm-64404483 has failed to come up
2025-08-14 03:01:21,828 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:21,828 - ERROR - VM ctest-right_vm-64404483 has failed to come up
2025-08-14 03:01:21,828 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:21,894 - INFO - Skip interface_detach for VM ctest-left_vm-34566312 in state BUILD
2025-08-14 03:01:21,894 - INFO - Deleting VM ctest-left_vm-34566312
2025-08-14 03:01:21,894 - ERROR - VM ctest-left_vm-34566312 has failed to come up
2025-08-14 03:01:21,894 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:21,894 - ERROR - VM ctest-left_vm-34566312 has failed to come up
2025-08-14 03:01:21,895 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:21,964 - INFO - Deleting VN ctest-trans_right_vn-68283821
2025-08-14 03:01:22,121 - DEBUG - Response for deleting network ()
2025-08-14 03:01:22,121 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/39c61809-ecbb-4acc-8ee9-406846538ab7
2025-08-14 03:01:22,128 - DEBUG - Response Code: 404
2025-08-14 03:01:22,128 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:22,139 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:22,168 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:22,272 - INFO - Validated that VN ctest-trans_right_vn-68283821 is not found in API Server
2025-08-14 03:01:22,285 - DEBUG - VN ctest-trans_right_vn-68283821 is not present in Agent 10.0.0.65
2025-08-14 03:01:22,299 - DEBUG - VN ctest-trans_right_vn-68283821 is not present in Agent 10.0.0.130
2025-08-14 03:01:22,299 - INFO - Validated that VN ctest-trans_right_vn-68283821 is not in any agent
2025-08-14 03:01:22,343 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-68283821 info
2025-08-14 03:01:22,343 - INFO - Deleting VN ctest-trans_left_vn-05288906
2025-08-14 03:01:22,489 - DEBUG - Response for deleting network ()
2025-08-14 03:01:22,489 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1d4951d9-12bf-4a51-b2fe-d98b63b7e9cc
2025-08-14 03:01:22,497 - DEBUG - Response Code: 404
2025-08-14 03:01:22,497 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:22,507 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:22,529 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:22,632 - INFO - Validated that VN ctest-trans_left_vn-05288906 is not found in API Server
2025-08-14 03:01:22,663 - DEBUG - VN ctest-trans_left_vn-05288906 is not present in Agent 10.0.0.65
2025-08-14 03:01:22,678 - DEBUG - VN ctest-trans_left_vn-05288906 is not present in Agent 10.0.0.130
2025-08-14 03:01:22,678 - INFO - Validated that VN ctest-trans_left_vn-05288906 is not in any agent
2025-08-14 03:01:22,733 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-05288906 info
2025-08-14 03:01:22,733 - INFO - Deleting VN ctest-right_vn-46376261
2025-08-14 03:01:22,783 - DEBUG - VN 8962ead5-ad22-4346-b7e3-c38be8505fdf still in use: Unable to complete operation on network 8962ead5-ad22-4346-b7e3-c38be8505fdf. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-bcaf76b4-f434-4272-8a34-59edcee8b82b']
2025-08-14 03:01:22,783 - WARNING - Deleting VN ctest-right_vn-46376261 failed..Will retry
2025-08-14 03:01:24,959 - DEBUG - Response for deleting network ()
2025-08-14 03:01:24,960 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c5ffe85e-a944-496d-b6cf-83d00a87b044
2025-08-14 03:01:24,975 - DEBUG - Response Code: 404
2025-08-14 03:01:24,975 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:24,981 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:24,995 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:25,077 - INFO - Validated that VN ctest-right_vn-46376261 is not found in API Server
2025-08-14 03:01:25,091 - DEBUG - VN ctest-right_vn-46376261 is not present in Agent 10.0.0.65
2025-08-14 03:01:25,105 - DEBUG - VN ctest-right_vn-46376261 is not present in Agent 10.0.0.130
2025-08-14 03:01:25,105 - INFO - Validated that VN ctest-right_vn-46376261 is not in any agent
2025-08-14 03:01:25,140 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-46376261 info
2025-08-14 03:01:25,140 - INFO - Deleting VN ctest-left_vn-53875788
2025-08-14 03:01:25,294 - DEBUG - Response for deleting network ()
2025-08-14 03:01:25,294 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5fa69783-d50c-480a-83dd-8abf2d72e8c5
2025-08-14 03:01:25,300 - DEBUG - Response Code: 404
2025-08-14 03:01:25,300 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:25,312 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:25,377 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:25,470 - INFO - Validated that VN ctest-left_vn-53875788 is not found in API Server
2025-08-14 03:01:25,483 - DEBUG - VN ctest-left_vn-53875788 is not present in Agent 10.0.0.65
2025-08-14 03:01:25,497 - DEBUG - VN ctest-left_vn-53875788 is not present in Agent 10.0.0.130
2025-08-14 03:01:25,497 - INFO - Validated that VN ctest-left_vn-53875788 is not in any agent
2025-08-14 03:01:25,531 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-53875788 info
2025-08-14 03:01:25,531 - INFO - Deleting VN ctest-mgmt_vn-57285714
2025-08-14 03:01:25,662 - DEBUG - Response for deleting network ()
2025-08-14 03:01:25,663 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f4e79d65-43c4-4bb1-9d48-810e057f5950
2025-08-14 03:01:25,669 - DEBUG - Response Code: 404
2025-08-14 03:01:25,670 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:25,678 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:25,691 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:25,789 - INFO - Validated that VN ctest-mgmt_vn-57285714 is not found in API Server
2025-08-14 03:01:25,802 - DEBUG - VN ctest-mgmt_vn-57285714 is not present in Agent 10.0.0.65
2025-08-14 03:01:25,816 - DEBUG - VN ctest-mgmt_vn-57285714 is not present in Agent 10.0.0.130
2025-08-14 03:01:25,816 - INFO - Validated that VN ctest-mgmt_vn-57285714 is not in any agent
2025-08-14 03:01:25,864 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-57285714 info
2025-08-14 03:01:27,142 - DEBUG - No XMPP flaps were noticed during the test
2025-08-14 03:01:27,142 - INFO -
2025-08-14 03:01:27,142 - INFO - END TEST : test_svc_v2_transparent_datapath : SKIPPED[0:00:16]
2025-08-14 03:01:27,142 - INFO - --------------------------------------------------------------------------------
2025-08-14 03:01:27,942 - INFO - Deleted project: ctest-TestSvcRegr-58616616, ID : 6d3e6227-dfe4-4a31-9da8-5869b4c50462
2025-08-14 03:01:28,126 - INFO - Domain Default found not creating
2025-08-14 03:01:28,274 - INFO - Project ctest-TestSvcRegr-87494895 not found, creating it
2025-08-14 03:01:28,800 - INFO - Created Project:ctest-TestSvcRegr-87494895, ID : ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:30,322 - INFO - ================================================================================
2025-08-14 03:01:30,322 - INFO - STARTING TEST : test_svc_CEM_22032
2025-08-14 03:01:31,643 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.25': '0'}} with
2025-08-14 03:01:31,643 - INFO - Initial checks done. Running the testcase now
2025-08-14 03:01:31,643 - INFO -
2025-08-14 03:01:32,337 - DEBUG - Response for create_network : {'network': {'id': 'c0cea360-3320-4396-84eb-9e476b880d7d', 'name': 'ctest-mgmt_vn-83796051', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'project_id': 'ae74403939b94c3facbd59fbf9019db1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87494895', 'ctest-mgmt_vn-83796051'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:32,631 - DEBUG - Response for create_subnet : {'subnet': {'id': '114191f3-8b00-40b4-a93c-9dd6e3e26257', 'name': '', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'network_id': 'c0cea360-3320-4396-84eb-9e476b880d7d', 'ip_version': 4, 'cidr': '153.70.177.0/26', 'allocation_pools': [{'start': '153.70.177.2', 'end': '153.70.177.62'}], 'gateway_ip': '153.70.177.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '153.70.177.2', 'tags': [], 'project_id': 'ae74403939b94c3facbd59fbf9019db1'}}
2025-08-14 03:01:32,652 - INFO - Created VN ctest-mgmt_vn-83796051
2025-08-14 03:01:32,666 - DEBUG - VN ctest-mgmt_vn-83796051 UUID is c0cea360-3320-4396-84eb-9e476b880d7d
2025-08-14 03:01:32,743 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:33,039 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:33,069 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:33,090 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:33,181 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c0cea360-3320-4396-84eb-9e476b880d7d
2025-08-14 03:01:33,194 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c0cea360-3320-4396-84eb-9e476b880d7d
2025-08-14 03:01:33,203 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1423fcf-3383-49c4-bd52-d751d64be689
2025-08-14 03:01:33,213 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1423fcf-3383-49c4-bd52-d751d64be689
2025-08-14 03:01:33,220 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/4610a456-abf7-4bb2-8cb8-46b4012d9dd6
2025-08-14 03:01:33,229 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:33,229 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c0cea360-3320-4396-84eb-9e476b880d7d
2025-08-14 03:01:33,239 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1423fcf-3383-49c4-bd52-d751d64be689
2025-08-14 03:01:33,254 - INFO - Verified VN network id 13 for VN c0cea360-3320-4396-84eb-9e476b880d7d
2025-08-14 03:01:33,254 - INFO - Verifications in API Server for VN ctest-mgmt_vn-83796051 passed
2025-08-14 03:01:33,254 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c0cea360-3320-4396-84eb-9e476b880d7d
2025-08-14 03:01:33,265 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1423fcf-3383-49c4-bd52-d751d64be689
2025-08-14 03:01:33,273 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1423fcf-3383-49c4-bd52-d751d64be689
2025-08-14 03:01:33,281 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/4610a456-abf7-4bb2-8cb8-46b4012d9dd6
2025-08-14 03:01:33,295 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13893221534054499222', 'uuid-lslong': '9577923062117436797'}, 'enable': 'true', 'created': '2025-08-14T03:01:32', 'last-modified': '2025-08-14T03:01:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.714930'}
2025-08-14 03:01:33,302 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:33,308 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13893221534054499222', 'uuid-lslong': '9577923062117436797'}, 'enable': 'true', 'created': '2025-08-14T03:01:32', 'last-modified': '2025-08-14T03:01:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.729314'}
2025-08-14 03:01:33,317 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:33,323 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13893221534054499222', 'uuid-lslong': '9577923062117436797'}, 'enable': 'true', 'created': '2025-08-14T03:01:32', 'last-modified': '2025-08-14T03:01:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.741372'}
2025-08-14 03:01:33,330 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:33,330 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-83796051 passed
2025-08-14 03:01:33,330 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-83796051 in API_Server ======
2025-08-14 03:01:33,330 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:33,336 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:33,352 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:33,443 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c0cea360-3320-4396-84eb-9e476b880d7d
2025-08-14 03:01:33,457 - DEBUG - =>VN ctest-mgmt_vn-83796051 has no policy to be verified
2025-08-14 03:01:33,457 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:33,457 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:33,457 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:33,747 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:33,826 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051?flat'}
2025-08-14 03:01:33,826 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:33,826 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:34,116 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:34,173 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051?flat'}
2025-08-14 03:01:34,173 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:34,173 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:34,464 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:34,523 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051?flat'}
2025-08-14 03:01:34,523 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-83796051 is found in opserver
2025-08-14 03:01:34,546 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:34,557 - DEBUG - VRF ids for VN ctest-mgmt_vn-83796051: {}
2025-08-14 03:01:34,833 - DEBUG - Response for create_network : {'network': {'id': '5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77', 'name': 'service-left-vn-46167144', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'project_id': 'ae74403939b94c3facbd59fbf9019db1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87494895', 'service-left-vn-46167144'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:35,058 - DEBUG - Response for create_subnet : {'subnet': {'id': '2e55c5c8-2998-4ba9-bbf9-869c8caf4fe1', 'name': '', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'network_id': '5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77', 'ip_version': 4, 'cidr': '168.101.103.0/26', 'allocation_pools': [{'start': '168.101.103.2', 'end': '168.101.103.62'}], 'gateway_ip': '168.101.103.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '168.101.103.2', 'tags': [], 'project_id': 'ae74403939b94c3facbd59fbf9019db1'}}
2025-08-14 03:01:35,083 - INFO - Created VN service-left-vn-46167144
2025-08-14 03:01:35,099 - DEBUG - VN service-left-vn-46167144 UUID is 5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77
2025-08-14 03:01:35,167 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:35,174 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:35,186 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:35,286 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77
2025-08-14 03:01:35,299 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77
2025-08-14 03:01:35,312 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/84100228-7bec-4347-b63a-91dfd4efbd32
2025-08-14 03:01:35,320 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/84100228-7bec-4347-b63a-91dfd4efbd32
2025-08-14 03:01:35,328 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/db4d60c2-d12d-4590-bce0-fb0ed105ed64
2025-08-14 03:01:35,337 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:35,337 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77
2025-08-14 03:01:35,347 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/84100228-7bec-4347-b63a-91dfd4efbd32
2025-08-14 03:01:35,363 - INFO - Verified VN network id 14 for VN 5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77
2025-08-14 03:01:35,363 - INFO - Verifications in API Server for VN service-left-vn-46167144 passed
2025-08-14 03:01:35,363 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77
2025-08-14 03:01:35,375 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/84100228-7bec-4347-b63a-91dfd4efbd32
2025-08-14 03:01:35,384 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/84100228-7bec-4347-b63a-91dfd4efbd32
2025-08-14 03:01:35,392 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/db4d60c2-d12d-4590-bce0-fb0ed105ed64
2025-08-14 03:01:35,405 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6563395207661767890', 'uuid-lslong': '10085343849694837623'}, 'enable': 'true', 'created': '2025-08-14T03:01:34', 'last-modified': '2025-08-14T03:01:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421102'}
2025-08-14 03:01:35,412 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:35,420 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6563395207661767890', 'uuid-lslong': '10085343849694837623'}, 'enable': 'true', 'created': '2025-08-14T03:01:34', 'last-modified': '2025-08-14T03:01:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428328'}
2025-08-14 03:01:35,427 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:35,433 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6563395207661767890', 'uuid-lslong': '10085343849694837623'}, 'enable': 'true', 'created': '2025-08-14T03:01:34', 'last-modified': '2025-08-14T03:01:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447066'}
2025-08-14 03:01:35,440 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:35,440 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-46167144 passed
2025-08-14 03:01:35,440 - DEBUG - ====Verifying policy data for service-left-vn-46167144 in API_Server ======
2025-08-14 03:01:35,440 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:35,447 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:35,464 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:35,558 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5b15dd2a-c12e-4cd2-8bf6-56cbfebb3b77
2025-08-14 03:01:35,569 - DEBUG - =>VN service-left-vn-46167144 has no policy to be verified
2025-08-14 03:01:35,569 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:35,569 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:35,569 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:35,622 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144?flat'}
2025-08-14 03:01:35,622 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:35,622 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:35,679 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144?flat'}
2025-08-14 03:01:35,679 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:35,679 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:35,735 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144?flat'}
2025-08-14 03:01:35,735 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87494895:service-left-vn-46167144 is found in opserver
2025-08-14 03:01:35,760 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:35,772 - DEBUG - VRF ids for VN service-left-vn-46167144: {}
2025-08-14 03:01:36,067 - DEBUG - Response for create_network : {'network': {'id': '383f8546-2299-479d-ba63-c8769b737c42', 'name': 'service-right-vn-85409112', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'project_id': 'ae74403939b94c3facbd59fbf9019db1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87494895', 'service-right-vn-85409112'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:36,354 - DEBUG - Response for create_subnet : {'subnet': {'id': '0cadef47-5d27-4553-bd8d-d636ce410b72', 'name': '', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'network_id': '383f8546-2299-479d-ba63-c8769b737c42', 'ip_version': 4, 'cidr': '154.138.212.64/26', 'allocation_pools': [{'start': '154.138.212.66', 'end': '154.138.212.126'}], 'gateway_ip': '154.138.212.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '154.138.212.66', 'tags': [], 'project_id': 'ae74403939b94c3facbd59fbf9019db1'}}
2025-08-14 03:01:36,381 - INFO - Created VN service-right-vn-85409112
2025-08-14 03:01:36,393 - DEBUG - VN service-right-vn-85409112 UUID is 383f8546-2299-479d-ba63-c8769b737c42
2025-08-14 03:01:36,481 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:36,488 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:36,504 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:36,606 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/383f8546-2299-479d-ba63-c8769b737c42
2025-08-14 03:01:36,621 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/383f8546-2299-479d-ba63-c8769b737c42
2025-08-14 03:01:36,631 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b82a82ac-906e-400c-8a29-1d18fce5ec07
2025-08-14 03:01:36,641 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b82a82ac-906e-400c-8a29-1d18fce5ec07
2025-08-14 03:01:36,649 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ee37569f-5055-4e9f-890f-7a896f0c269e
2025-08-14 03:01:36,658 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:36,658 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/383f8546-2299-479d-ba63-c8769b737c42
2025-08-14 03:01:36,668 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b82a82ac-906e-400c-8a29-1d18fce5ec07
2025-08-14 03:01:36,687 - INFO - Verified VN network id 15 for VN 383f8546-2299-479d-ba63-c8769b737c42
2025-08-14 03:01:36,687 - INFO - Verifications in API Server for VN service-right-vn-85409112 passed
2025-08-14 03:01:36,687 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/383f8546-2299-479d-ba63-c8769b737c42
2025-08-14 03:01:36,697 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b82a82ac-906e-400c-8a29-1d18fce5ec07
2025-08-14 03:01:36,705 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b82a82ac-906e-400c-8a29-1d18fce5ec07
2025-08-14 03:01:36,712 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ee37569f-5055-4e9f-890f-7a896f0c269e
2025-08-14 03:01:36,725 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4053104725931411357', 'uuid-lslong': '13430798925488684098'}, 'enable': 'true', 'created': '2025-08-14T03:01:35', 'last-modified': '2025-08-14T03:01:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438721'}
2025-08-14 03:01:36,731 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:36,737 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4053104725931411357', 'uuid-lslong': '13430798925488684098'}, 'enable': 'true', 'created': '2025-08-14T03:01:35', 'last-modified': '2025-08-14T03:01:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450805'}
2025-08-14 03:01:36,743 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:36,749 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4053104725931411357', 'uuid-lslong': '13430798925488684098'}, 'enable': 'true', 'created': '2025-08-14T03:01:35', 'last-modified': '2025-08-14T03:01:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.470823'}
2025-08-14 03:01:36,755 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:36,755 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-85409112 passed
2025-08-14 03:01:36,755 - DEBUG - ====Verifying policy data for service-right-vn-85409112 in API_Server ======
2025-08-14 03:01:36,755 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:36,762 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:36,775 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:36,865 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/383f8546-2299-479d-ba63-c8769b737c42
2025-08-14 03:01:36,880 - DEBUG - =>VN service-right-vn-85409112 has no policy to be verified
2025-08-14 03:01:36,880 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:36,880 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:36,880 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:36,937 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112?flat'}
2025-08-14 03:01:36,937 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:36,937 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:36,951 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112?flat'}
2025-08-14 03:01:36,951 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:36,951 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:36,964 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112?flat'}
2025-08-14 03:01:36,964 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87494895:service-right-vn-85409112 is found in opserver
2025-08-14 03:01:36,986 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:36,997 - DEBUG - VRF ids for VN service-right-vn-85409112: {}
2025-08-14 03:01:37,047 - DEBUG - Services list from nova: [, , , ]
2025-08-14 03:01:38,009 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2)
2025-08-14 03:01:39,195 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1)
2025-08-14 03:01:39,195 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-12063739']
2025-08-14 03:01:39,503 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-12063739'] created succesfully
2025-08-14 03:01:39,861 - DEBUG - Image by name tiny_nat_fw not found
2025-08-14 03:01:39,861 - DEBUG - Installing image tiny_nat_fw
2025-08-14 03:01:39,861 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-14 03:01:39,862 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:39,862 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:39,862 - DEBUG - Unzip image
2025-08-14 03:01:39,862 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:39,878 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-08-14 03:01:39,879 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-12063739']
2025-08-14 03:01:39,979 - INFO - Service template: ['default-domain', 'ctest-service_template_1-12063739'] deleted successfully.
2025-08-14 03:01:39,980 - INFO - Skip interface_detach for VM ctest-right_vm-47493816 in state BUILD
2025-08-14 03:01:39,980 - INFO - Deleting VM ctest-right_vm-47493816
2025-08-14 03:01:40,039 - ERROR - VM ctest-right_vm-47493816 has failed to come up
2025-08-14 03:01:40,039 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:40,039 - ERROR - VM ctest-right_vm-47493816 has failed to come up
2025-08-14 03:01:40,039 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:40,117 - INFO - Skip interface_detach for VM ctest-left_vm-54392347 in state BUILD
2025-08-14 03:01:40,117 - INFO - Deleting VM ctest-left_vm-54392347
2025-08-14 03:01:40,117 - ERROR - VM ctest-left_vm-54392347 has failed to come up
2025-08-14 03:01:40,117 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:40,117 - ERROR - VM ctest-left_vm-54392347 has failed to come up
2025-08-14 03:01:40,117 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:40,182 - INFO - Deleting VN service-right-vn-85409112
2025-08-14 03:01:40,224 - DEBUG - VN 383f8546-2299-479d-ba63-c8769b737c42 still in use: Unable to complete operation on network 383f8546-2299-479d-ba63-c8769b737c42. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-df733398-85dd-445a-a420-c492d1ce4721']
2025-08-14 03:01:40,224 - WARNING - Deleting VN service-right-vn-85409112 failed..Will retry
2025-08-14 03:01:42,404 - DEBUG - Response for deleting network ()
2025-08-14 03:01:42,404 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b82a82ac-906e-400c-8a29-1d18fce5ec07
2025-08-14 03:01:42,411 - DEBUG - Response Code: 404
2025-08-14 03:01:42,411 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:42,425 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:42,455 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:42,556 - INFO - Validated that VN service-right-vn-85409112 is not found in API Server
2025-08-14 03:01:42,570 - DEBUG - VN service-right-vn-85409112 is not present in Agent 10.0.0.65
2025-08-14 03:01:42,581 - DEBUG - VN service-right-vn-85409112 is not present in Agent 10.0.0.130
2025-08-14 03:01:42,581 - INFO - Validated that VN service-right-vn-85409112 is not in any agent
2025-08-14 03:01:42,621 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-85409112 info
2025-08-14 03:01:42,621 - INFO - Deleting VN service-left-vn-46167144
2025-08-14 03:01:42,787 - DEBUG - Response for deleting network ()
2025-08-14 03:01:42,787 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/84100228-7bec-4347-b63a-91dfd4efbd32
2025-08-14 03:01:42,798 - DEBUG - Response Code: 404
2025-08-14 03:01:42,798 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:42,810 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:42,828 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:42,927 - INFO - Validated that VN service-left-vn-46167144 is not found in API Server
2025-08-14 03:01:42,940 - DEBUG - VN service-left-vn-46167144 is not present in Agent 10.0.0.65
2025-08-14 03:01:42,950 - DEBUG - VN service-left-vn-46167144 is not present in Agent 10.0.0.130
2025-08-14 03:01:42,950 - INFO - Validated that VN service-left-vn-46167144 is not in any agent
2025-08-14 03:01:42,985 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-46167144 info
2025-08-14 03:01:42,985 - INFO - Deleting VN ctest-mgmt_vn-83796051
2025-08-14 03:01:43,140 - DEBUG - Response for deleting network ()
2025-08-14 03:01:43,140 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1423fcf-3383-49c4-bd52-d751d64be689
2025-08-14 03:01:43,146 - DEBUG - Response Code: 404
2025-08-14 03:01:43,147 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:43,161 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:43,177 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:43,277 - INFO - Validated that VN ctest-mgmt_vn-83796051 is not found in API Server
2025-08-14 03:01:43,289 - DEBUG - VN ctest-mgmt_vn-83796051 is not present in Agent 10.0.0.65
2025-08-14 03:01:43,300 - DEBUG - VN ctest-mgmt_vn-83796051 is not present in Agent 10.0.0.130
2025-08-14 03:01:43,300 - INFO - Validated that VN ctest-mgmt_vn-83796051 is not in any agent
2025-08-14 03:01:43,335 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-83796051 info
2025-08-14 03:01:44,616 - DEBUG - No XMPP flaps were noticed during the test
2025-08-14 03:01:44,616 - INFO -
2025-08-14 03:01:44,616 - INFO - END TEST : test_svc_CEM_22032 : SKIPPED[0:00:14]
2025-08-14 03:01:44,617 - INFO - --------------------------------------------------------------------------------
2025-08-14 03:01:44,620 - INFO - ================================================================================
2025-08-14 03:01:44,620 - INFO - STARTING TEST : test_svc_in_network_datapath
2025-08-14 03:01:45,897 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.25': '0'}} with
2025-08-14 03:01:45,897 - INFO - Initial checks done. Running the testcase now
2025-08-14 03:01:45,897 - INFO -
2025-08-14 03:01:46,168 - DEBUG - Response for create_network : {'network': {'id': '0a330cc3-1b11-4267-95c5-1fd6732ace36', 'name': 'ctest-mgmt_vn-61706241', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'project_id': 'ae74403939b94c3facbd59fbf9019db1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87494895', 'ctest-mgmt_vn-61706241'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:46,449 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e9c68e9a-7efe-4a73-9f29-0f7bdef04230', 'name': '', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'network_id': '0a330cc3-1b11-4267-95c5-1fd6732ace36', 'ip_version': 4, 'cidr': '24.241.194.128/26', 'allocation_pools': [{'start': '24.241.194.130', 'end': '24.241.194.190'}], 'gateway_ip': '24.241.194.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '24.241.194.130', 'tags': [], 'project_id': 'ae74403939b94c3facbd59fbf9019db1'}}
2025-08-14 03:01:46,471 - INFO - Created VN ctest-mgmt_vn-61706241
2025-08-14 03:01:46,504 - DEBUG - VN ctest-mgmt_vn-61706241 UUID is 0a330cc3-1b11-4267-95c5-1fd6732ace36
2025-08-14 03:01:46,578 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:46,585 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:46,599 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:46,716 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0a330cc3-1b11-4267-95c5-1fd6732ace36
2025-08-14 03:01:46,735 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0a330cc3-1b11-4267-95c5-1fd6732ace36
2025-08-14 03:01:46,750 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/00288c01-d036-4f2f-82d7-6bd524f7ab60
2025-08-14 03:01:46,763 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/00288c01-d036-4f2f-82d7-6bd524f7ab60
2025-08-14 03:01:46,774 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/613524cb-3d15-436b-b762-f32e49014253
2025-08-14 03:01:46,784 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:46,784 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0a330cc3-1b11-4267-95c5-1fd6732ace36
2025-08-14 03:01:46,797 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/00288c01-d036-4f2f-82d7-6bd524f7ab60
2025-08-14 03:01:46,818 - INFO - Verified VN network id 13 for VN 0a330cc3-1b11-4267-95c5-1fd6732ace36
2025-08-14 03:01:46,818 - INFO - Verifications in API Server for VN ctest-mgmt_vn-61706241 passed
2025-08-14 03:01:46,818 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0a330cc3-1b11-4267-95c5-1fd6732ace36
2025-08-14 03:01:46,832 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/00288c01-d036-4f2f-82d7-6bd524f7ab60
2025-08-14 03:01:46,840 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/00288c01-d036-4f2f-82d7-6bd524f7ab60
2025-08-14 03:01:46,848 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/613524cb-3d15-436b-b762-f32e49014253
2025-08-14 03:01:46,861 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '734945196303794791', 'uuid-lslong': '10792067087978909238'}, 'enable': 'true', 'created': '2025-08-14T03:01:46', 'last-modified': '2025-08-14T03:01:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479009'}
2025-08-14 03:01:46,868 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:46,875 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '734945196303794791', 'uuid-lslong': '10792067087978909238'}, 'enable': 'true', 'created': '2025-08-14T03:01:46', 'last-modified': '2025-08-14T03:01:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492606'}
2025-08-14 03:01:46,881 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:46,887 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '734945196303794791', 'uuid-lslong': '10792067087978909238'}, 'enable': 'true', 'created': '2025-08-14T03:01:46', 'last-modified': '2025-08-14T03:01:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491159'}
2025-08-14 03:01:46,894 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-14 03:01:46,894 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-61706241 passed
2025-08-14 03:01:46,894 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-61706241 in API_Server ======
2025-08-14 03:01:46,894 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:46,901 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:46,913 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:47,003 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0a330cc3-1b11-4267-95c5-1fd6732ace36
2025-08-14 03:01:47,042 - DEBUG - =>VN ctest-mgmt_vn-61706241 has no policy to be verified
2025-08-14 03:01:47,042 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:47,042 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:47,042 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:47,054 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241?flat'}
2025-08-14 03:01:47,054 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:47,054 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:47,068 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241?flat'}
2025-08-14 03:01:47,068 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:47,068 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:47,082 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241?flat'}
2025-08-14 03:01:47,082 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87494895:ctest-mgmt_vn-61706241 is found in opserver
2025-08-14 03:01:47,105 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:47,116 - DEBUG - VRF ids for VN ctest-mgmt_vn-61706241: {}
2025-08-14 03:01:47,385 - DEBUG - Response for create_network : {'network': {'id': '321a6667-96df-45a5-a949-6b72fb059dc8', 'name': 'ctest-left_vn-67087886', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'project_id': 'ae74403939b94c3facbd59fbf9019db1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87494895', 'ctest-left_vn-67087886'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:47,617 - DEBUG - Response for create_subnet : {'subnet': {'id': '4f55b170-b5d0-499d-880f-065d44a07a26', 'name': '', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'network_id': '321a6667-96df-45a5-a949-6b72fb059dc8', 'ip_version': 4, 'cidr': '156.84.175.64/26', 'allocation_pools': [{'start': '156.84.175.66', 'end': '156.84.175.126'}], 'gateway_ip': '156.84.175.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '156.84.175.66', 'tags': [], 'project_id': 'ae74403939b94c3facbd59fbf9019db1'}}
2025-08-14 03:01:47,637 - INFO - Created VN ctest-left_vn-67087886
2025-08-14 03:01:47,648 - DEBUG - VN ctest-left_vn-67087886 UUID is 321a6667-96df-45a5-a949-6b72fb059dc8
2025-08-14 03:01:47,720 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:47,726 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:47,738 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:47,839 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/321a6667-96df-45a5-a949-6b72fb059dc8
2025-08-14 03:01:47,852 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/321a6667-96df-45a5-a949-6b72fb059dc8
2025-08-14 03:01:47,862 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/059f6782-0547-4bf6-8b87-bde1392377ba
2025-08-14 03:01:47,883 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/059f6782-0547-4bf6-8b87-bde1392377ba
2025-08-14 03:01:47,892 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/588dfdd7-2a10-4a3d-9fab-a3f36702ffd0
2025-08-14 03:01:47,901 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:47,902 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/321a6667-96df-45a5-a949-6b72fb059dc8
2025-08-14 03:01:47,913 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/059f6782-0547-4bf6-8b87-bde1392377ba
2025-08-14 03:01:47,929 - INFO - Verified VN network id 14 for VN 321a6667-96df-45a5-a949-6b72fb059dc8
2025-08-14 03:01:47,929 - INFO - Verifications in API Server for VN ctest-left_vn-67087886 passed
2025-08-14 03:01:47,929 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/321a6667-96df-45a5-a949-6b72fb059dc8
2025-08-14 03:01:47,939 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/059f6782-0547-4bf6-8b87-bde1392377ba
2025-08-14 03:01:47,946 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/059f6782-0547-4bf6-8b87-bde1392377ba
2025-08-14 03:01:47,953 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/588dfdd7-2a10-4a3d-9fab-a3f36702ffd0
2025-08-14 03:01:47,966 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3610310646389753253', 'uuid-lslong': '12198399207291592136'}, 'enable': 'true', 'created': '2025-08-14T03:01:47', 'last-modified': '2025-08-14T03:01:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406347'}
2025-08-14 03:01:47,982 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:47,990 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3610310646389753253', 'uuid-lslong': '12198399207291592136'}, 'enable': 'true', 'created': '2025-08-14T03:01:47', 'last-modified': '2025-08-14T03:01:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431143'}
2025-08-14 03:01:47,998 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:48,005 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3610310646389753253', 'uuid-lslong': '12198399207291592136'}, 'enable': 'true', 'created': '2025-08-14T03:01:47', 'last-modified': '2025-08-14T03:01:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449903'}
2025-08-14 03:01:48,013 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-14 03:01:48,013 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-67087886 passed
2025-08-14 03:01:48,013 - DEBUG - ====Verifying policy data for ctest-left_vn-67087886 in API_Server ======
2025-08-14 03:01:48,013 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:48,020 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:48,035 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:48,140 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/321a6667-96df-45a5-a949-6b72fb059dc8
2025-08-14 03:01:48,154 - DEBUG - =>VN ctest-left_vn-67087886 has no policy to be verified
2025-08-14 03:01:48,154 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:48,154 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:48,154 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:48,182 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886?flat'}
2025-08-14 03:01:48,182 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:48,182 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:48,246 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886?flat'}
2025-08-14 03:01:48,247 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:48,247 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:48,303 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886?flat'}
2025-08-14 03:01:48,303 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87494895:ctest-left_vn-67087886 is found in opserver
2025-08-14 03:01:48,327 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:48,338 - DEBUG - VRF ids for VN ctest-left_vn-67087886: {}
2025-08-14 03:01:48,610 - DEBUG - Response for create_network : {'network': {'id': '7cdfde56-3318-4588-9a70-1c07e7a0f42c', 'name': 'ctest-right_vn-92963805', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'project_id': 'ae74403939b94c3facbd59fbf9019db1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87494895', 'ctest-right_vn-92963805'], 'port_security_enabled': True, 'description': ''}}
2025-08-14 03:01:48,888 - DEBUG - Response for create_subnet : {'subnet': {'id': 'db185ec2-ac00-4811-bc99-9114c3927b71', 'name': '', 'tenant_id': 'ae74403939b94c3facbd59fbf9019db1', 'network_id': '7cdfde56-3318-4588-9a70-1c07e7a0f42c', 'ip_version': 4, 'cidr': '17.148.152.192/26', 'allocation_pools': [{'start': '17.148.152.194', 'end': '17.148.152.254'}], 'gateway_ip': '17.148.152.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '17.148.152.194', 'tags': [], 'project_id': 'ae74403939b94c3facbd59fbf9019db1'}}
2025-08-14 03:01:48,911 - INFO - Created VN ctest-right_vn-92963805
2025-08-14 03:01:48,925 - DEBUG - VN ctest-right_vn-92963805 UUID is 7cdfde56-3318-4588-9a70-1c07e7a0f42c
2025-08-14 03:01:49,007 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:49,014 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:49,026 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:49,132 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cdfde56-3318-4588-9a70-1c07e7a0f42c
2025-08-14 03:01:49,149 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cdfde56-3318-4588-9a70-1c07e7a0f42c
2025-08-14 03:01:49,159 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7ca4ce1c-329a-4ccd-856f-0e2296caf9d9
2025-08-14 03:01:49,168 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7ca4ce1c-329a-4ccd-856f-0e2296caf9d9
2025-08-14 03:01:49,177 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/421cc2ae-7030-4624-b6c1-5250741f6ec2
2025-08-14 03:01:49,185 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:49,185 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cdfde56-3318-4588-9a70-1c07e7a0f42c
2025-08-14 03:01:49,198 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7ca4ce1c-329a-4ccd-856f-0e2296caf9d9
2025-08-14 03:01:49,214 - INFO - Verified VN network id 15 for VN 7cdfde56-3318-4588-9a70-1c07e7a0f42c
2025-08-14 03:01:49,216 - INFO - Verifications in API Server for VN ctest-right_vn-92963805 passed
2025-08-14 03:01:49,217 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cdfde56-3318-4588-9a70-1c07e7a0f42c
2025-08-14 03:01:49,227 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7ca4ce1c-329a-4ccd-856f-0e2296caf9d9
2025-08-14 03:01:49,236 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7ca4ce1c-329a-4ccd-856f-0e2296caf9d9
2025-08-14 03:01:49,246 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/421cc2ae-7030-4624-b6c1-5250741f6ec2
2025-08-14 03:01:49,268 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8998155042315322760', 'uuid-lslong': '11128425499508929580'}, 'enable': 'true', 'created': '2025-08-14T03:01:48', 'last-modified': '2025-08-14T03:01:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449991'}
2025-08-14 03:01:49,277 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:49,283 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8998155042315322760', 'uuid-lslong': '11128425499508929580'}, 'enable': 'true', 'created': '2025-08-14T03:01:48', 'last-modified': '2025-08-14T03:01:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.464144'}
2025-08-14 03:01:49,290 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:49,296 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87494895', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8998155042315322760', 'uuid-lslong': '11128425499508929580'}, 'enable': 'true', 'created': '2025-08-14T03:01:48', 'last-modified': '2025-08-14T03:01:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476083'}
2025-08-14 03:01:49,303 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 03:01:49,303 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-92963805 passed
2025-08-14 03:01:49,303 - DEBUG - ====Verifying policy data for ctest-right_vn-92963805 in API_Server ======
2025-08-14 03:01:49,303 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:49,310 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:49,322 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:49,421 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cdfde56-3318-4588-9a70-1c07e7a0f42c
2025-08-14 03:01:49,432 - DEBUG - =>VN ctest-right_vn-92963805 has no policy to be verified
2025-08-14 03:01:49,432 - DEBUG - Verifying the vn in opserver
2025-08-14 03:01:49,432 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805 virtual network link through opserver 10.0.0.38
2025-08-14 03:01:49,432 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-14 03:01:49,445 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805?flat'}
2025-08-14 03:01:49,445 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805 virtual network link through opserver 10.0.0.27
2025-08-14 03:01:49,445 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-14 03:01:49,459 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805?flat'}
2025-08-14 03:01:49,459 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805 virtual network link through opserver 10.0.0.23
2025-08-14 03:01:49,460 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-14 03:01:49,472 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805?flat'}
2025-08-14 03:01:49,472 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87494895:ctest-right_vn-92963805 is found in opserver
2025-08-14 03:01:49,494 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 03:01:49,506 - DEBUG - VRF ids for VN ctest-right_vn-92963805: {}
2025-08-14 03:01:50,493 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1)
2025-08-14 03:01:51,851 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2)
2025-08-14 03:01:51,852 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-11862808']
2025-08-14 03:01:52,166 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-11862808'] created succesfully
2025-08-14 03:01:52,573 - DEBUG - Image by name tiny_nat_fw not found
2025-08-14 03:01:52,573 - DEBUG - Installing image tiny_nat_fw
2025-08-14 03:01:52,573 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-14 03:01:52,573 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:52,573 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:52,574 - DEBUG - Unzip image
2025-08-14 03:01:52,574 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-14 03:01:52,598 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-08-14 03:01:52,598 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-11862808']
2025-08-14 03:01:52,691 - INFO - Service template: ['default-domain', 'ctest-service_template_1-11862808'] deleted successfully.
2025-08-14 03:01:52,692 - INFO - Skip interface_detach for VM ctest-right_vm-25824591 in state BUILD
2025-08-14 03:01:52,693 - INFO - Deleting VM ctest-right_vm-25824591
2025-08-14 03:01:52,693 - ERROR - VM ctest-right_vm-25824591 has failed to come up
2025-08-14 03:01:52,694 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:52,695 - ERROR - VM ctest-right_vm-25824591 has failed to come up
2025-08-14 03:01:52,695 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:52,803 - INFO - Skip interface_detach for VM ctest-left_vm-13261470 in state BUILD
2025-08-14 03:01:52,803 - INFO - Deleting VM ctest-left_vm-13261470
2025-08-14 03:01:52,803 - ERROR - VM ctest-left_vm-13261470 has failed to come up
2025-08-14 03:01:52,803 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:52,803 - ERROR - VM ctest-left_vm-13261470 has failed to come up
2025-08-14 03:01:52,803 - ERROR - Nova failed to get host of the VM
2025-08-14 03:01:52,891 - INFO - Deleting VN ctest-right_vn-92963805
2025-08-14 03:01:52,950 - DEBUG - VN 7cdfde56-3318-4588-9a70-1c07e7a0f42c still in use: Unable to complete operation on network 7cdfde56-3318-4588-9a70-1c07e7a0f42c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f7f4ad19-c90a-4ad0-a703-5274987eef3b']
2025-08-14 03:01:52,951 - WARNING - Deleting VN ctest-right_vn-92963805 failed..Will retry
2025-08-14 03:01:55,143 - DEBUG - Response for deleting network ()
2025-08-14 03:01:55,143 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7ca4ce1c-329a-4ccd-856f-0e2296caf9d9
2025-08-14 03:01:55,150 - DEBUG - Response Code: 404
2025-08-14 03:01:55,150 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:55,157 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:55,189 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:55,289 - INFO - Validated that VN ctest-right_vn-92963805 is not found in API Server
2025-08-14 03:01:55,303 - DEBUG - VN ctest-right_vn-92963805 is not present in Agent 10.0.0.65
2025-08-14 03:01:55,315 - DEBUG - VN ctest-right_vn-92963805 is not present in Agent 10.0.0.130
2025-08-14 03:01:55,315 - INFO - Validated that VN ctest-right_vn-92963805 is not in any agent
2025-08-14 03:01:55,352 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-92963805 info
2025-08-14 03:01:55,352 - INFO - Deleting VN ctest-left_vn-67087886
2025-08-14 03:01:55,521 - DEBUG - Response for deleting network ()
2025-08-14 03:01:55,521 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/059f6782-0547-4bf6-8b87-bde1392377ba
2025-08-14 03:01:55,527 - DEBUG - Response Code: 404
2025-08-14 03:01:55,527 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:55,533 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:55,554 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:55,648 - INFO - Validated that VN ctest-left_vn-67087886 is not found in API Server
2025-08-14 03:01:55,660 - DEBUG - VN ctest-left_vn-67087886 is not present in Agent 10.0.0.65
2025-08-14 03:01:55,672 - DEBUG - VN ctest-left_vn-67087886 is not present in Agent 10.0.0.130
2025-08-14 03:01:55,672 - INFO - Validated that VN ctest-left_vn-67087886 is not in any agent
2025-08-14 03:01:55,706 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-67087886 info
2025-08-14 03:01:55,706 - INFO - Deleting VN ctest-mgmt_vn-61706241
2025-08-14 03:01:55,847 - DEBUG - Response for deleting network ()
2025-08-14 03:01:55,847 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/00288c01-d036-4f2f-82d7-6bd524f7ab60
2025-08-14 03:01:55,852 - DEBUG - Response Code: 404
2025-08-14 03:01:55,852 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-14 03:01:55,859 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada
2025-08-14 03:01:55,921 - DEBUG - Requesting: http://10.0.0.38:8082/project/ae744039-39b9-4c3f-acbd-59fbf9019db1
2025-08-14 03:01:56,016 - INFO - Validated that VN ctest-mgmt_vn-61706241 is not found in API Server
2025-08-14 03:01:56,026 - DEBUG - VN ctest-mgmt_vn-61706241 is not present in Agent 10.0.0.65
2025-08-14 03:01:56,039 - DEBUG - VN ctest-mgmt_vn-61706241 is not present in Agent 10.0.0.130
2025-08-14 03:01:56,039 - INFO - Validated that VN ctest-mgmt_vn-61706241 is not in any agent
2025-08-14 03:01:56,072 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-61706241 info
2025-08-14 03:01:57,329 - DEBUG - No XMPP flaps were noticed during the test
2025-08-14 03:01:57,329 - INFO -
2025-08-14 03:01:57,329 - INFO - END TEST : test_svc_in_network_datapath : SKIPPED[0:00:13]
2025-08-14 03:01:57,329 - INFO - --------------------------------------------------------------------------------
2025-08-14 03:01:58,010 - INFO - Deleted project: ctest-TestSvcRegr-87494895, ID : ae744039-39b9-4c3f-acbd-59fbf9019db1