]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1)
2025-11-03 03:11:28,852 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-20098014']
2025-11-03 03:11:29,146 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-20098014'] created succesfully
2025-11-03 03:11:29,553 - DEBUG - Image by name tiny_nat_fw not found
2025-11-03 03:11:29,553 - DEBUG - Installing image tiny_nat_fw
2025-11-03 03:11:29,553 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-11-03 03:11:29,553 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-11-03 03:11:29,554 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz
2025-11-03 03:11:29,585 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:11:29,733 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:11:29,733 - DEBUG - Unzip image
2025-11-03 03:11:29,733 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:11:29,766 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-11-03 03:11:29,766 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-20098014']
2025-11-03 03:11:29,899 - INFO - Service template: ['default-domain', 'ctest-service_template_1-20098014'] deleted successfully.
2025-11-03 03:11:29,899 - INFO - Skip interface_detach for VM ctest-right_vm-34757843 in state BUILD
2025-11-03 03:11:29,899 - INFO - Deleting VM ctest-right_vm-34757843
2025-11-03 03:11:29,929 - ERROR - VM ctest-right_vm-34757843 has failed to come up
2025-11-03 03:11:29,930 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:29,930 - ERROR - VM ctest-right_vm-34757843 has failed to come up
2025-11-03 03:11:29,930 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:29,997 - INFO - Skip interface_detach for VM ctest-left_vm-68822863 in state BUILD
2025-11-03 03:11:29,997 - INFO - Deleting VM ctest-left_vm-68822863
2025-11-03 03:11:29,997 - ERROR - VM ctest-left_vm-68822863 has failed to come up
2025-11-03 03:11:29,997 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:29,997 - ERROR - VM ctest-left_vm-68822863 has failed to come up
2025-11-03 03:11:29,997 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:30,069 - INFO - Deleting VN ctest-right_vn-43926557
2025-11-03 03:11:30,117 - DEBUG - VN b4217a53-cca0-45f5-9e32-858113317f2d still in use: Unable to complete operation on network b4217a53-cca0-45f5-9e32-858113317f2d. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-3d47fc12-2f06-4c71-8379-75c3577646f9']
2025-11-03 03:11:30,117 - WARNING - Deleting VN ctest-right_vn-43926557 failed..Will retry
2025-11-03 03:11:32,278 - DEBUG - Response for deleting network ()
2025-11-03 03:11:32,279 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6a156bc2-e153-432b-a1d7-82a64a70f1b0
2025-11-03 03:11:32,286 - DEBUG - Response Code: 404
2025-11-03 03:11:32,286 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:32,293 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:32,312 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:32,420 - INFO - Validated that VN ctest-right_vn-43926557 is not found in API Server
2025-11-03 03:11:32,432 - DEBUG - VN ctest-right_vn-43926557 is not present in Agent 10.0.0.73
2025-11-03 03:11:32,443 - DEBUG - VN ctest-right_vn-43926557 is not present in Agent 10.0.0.33
2025-11-03 03:11:32,443 - INFO - Validated that VN ctest-right_vn-43926557 is not in any agent
2025-11-03 03:11:32,479 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-43926557 info
2025-11-03 03:11:32,479 - INFO - Deleting VN ctest-left_vn-98154929
2025-11-03 03:11:32,522 - DEBUG - VN 15e53284-9cb6-4d0f-be95-0cf66fce207b still in use: Unable to complete operation on network 15e53284-9cb6-4d0f-be95-0cf66fce207b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f48e1d37-9224-42e3-8db7-5d8cf81c2fb8']
2025-11-03 03:11:32,522 - WARNING - Deleting VN ctest-left_vn-98154929 failed..Will retry
2025-11-03 03:11:34,568 - DEBUG - VN 15e53284-9cb6-4d0f-be95-0cf66fce207b still in use: Unable to complete operation on network 15e53284-9cb6-4d0f-be95-0cf66fce207b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9ec485ff-fa81-4ca7-af7a-07ecc208e52e']
2025-11-03 03:11:34,568 - WARNING - Deleting VN ctest-left_vn-98154929 failed..Will retry
2025-11-03 03:11:36,607 - DEBUG - VN 15e53284-9cb6-4d0f-be95-0cf66fce207b still in use: Unable to complete operation on network 15e53284-9cb6-4d0f-be95-0cf66fce207b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9cc44532-a837-43cb-af2e-979febd6ff5e']
2025-11-03 03:11:36,607 - WARNING - Deleting VN ctest-left_vn-98154929 failed..Will retry
2025-11-03 03:11:38,761 - DEBUG - Response for deleting network ()
2025-11-03 03:11:38,761 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/93460859-2745-4ea8-94f8-da65d2bbbb02
2025-11-03 03:11:38,766 - DEBUG - Response Code: 404
2025-11-03 03:11:38,766 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:38,776 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:38,793 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:38,888 - INFO - Validated that VN ctest-left_vn-98154929 is not found in API Server
2025-11-03 03:11:38,898 - DEBUG - VN ctest-left_vn-98154929 is not present in Agent 10.0.0.73
2025-11-03 03:11:38,910 - DEBUG - VN ctest-left_vn-98154929 is not present in Agent 10.0.0.33
2025-11-03 03:11:38,910 - INFO - Validated that VN ctest-left_vn-98154929 is not in any agent
2025-11-03 03:11:38,944 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-98154929 info
2025-11-03 03:11:38,945 - INFO - Deleting VN ctest-mgmt_vn-08988477
2025-11-03 03:11:39,097 - DEBUG - Response for deleting network ()
2025-11-03 03:11:39,097 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/182c4d6d-1eec-4808-b8c9-2d93ecadf393
2025-11-03 03:11:39,106 - DEBUG - Response Code: 404
2025-11-03 03:11:39,106 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:39,114 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:39,146 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:39,249 - INFO - Validated that VN ctest-mgmt_vn-08988477 is not found in API Server
2025-11-03 03:11:39,266 - DEBUG - VN ctest-mgmt_vn-08988477 is not present in Agent 10.0.0.73
2025-11-03 03:11:39,279 - DEBUG - VN ctest-mgmt_vn-08988477 is not present in Agent 10.0.0.33
2025-11-03 03:11:39,279 - INFO - Validated that VN ctest-mgmt_vn-08988477 is not in any agent
2025-11-03 03:11:39,314 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-08988477 info
2025-11-03 03:11:39,314 - INFO - Deleting VM ctest-vm-in-third-vn-02714830
2025-11-03 03:11:39,386 - INFO - Deleting VN ctest-third-vn-34338032
2025-11-03 03:11:39,444 - DEBUG - VN 092d4fc2-d64c-477e-bd15-332da1346e96 still in use: Unable to complete operation on network 092d4fc2-d64c-477e-bd15-332da1346e96. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-8821bf89-33df-49e2-a273-f78f6c8eedb9']
2025-11-03 03:11:39,444 - WARNING - Deleting VN ctest-third-vn-34338032 failed..Will retry
2025-11-03 03:11:41,619 - DEBUG - Response for deleting network ()
2025-11-03 03:11:42,964 - DEBUG - No XMPP flaps were noticed during the test
2025-11-03 03:11:42,964 - INFO -
2025-11-03 03:11:42,964 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : SKIPPED[0:00:35]
2025-11-03 03:11:42,964 - INFO - --------------------------------------------------------------------------------
2025-11-03 03:11:42,967 - INFO - ================================================================================
2025-11-03 03:11:42,967 - INFO - STARTING TEST : test_svc_v2_transparent_datapath
2025-11-03 03:11:44,242 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.33': {'10.20.0.17': '0', '10.20.0.193': '0'}} with
2025-11-03 03:11:44,242 - INFO - Initial checks done. Running the testcase now
2025-11-03 03:11:44,242 - INFO -
2025-11-03 03:11:44,491 - DEBUG - Response for create_network : {'network': {'id': 'c8c41d2b-d752-4c58-9f1e-a8b890839976', 'name': 'ctest-mgmt_vn-32068159', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'project_id': '5f3507b65d8e47a9a506a0daf082ae91', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-20846099', 'ctest-mgmt_vn-32068159'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:11:44,710 - DEBUG - Response for create_subnet : {'subnet': {'id': 'da69c81b-7826-4987-b45f-81d880358879', 'name': '', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'network_id': 'c8c41d2b-d752-4c58-9f1e-a8b890839976', 'ip_version': 4, 'cidr': '84.120.254.0/26', 'allocation_pools': [{'start': '84.120.254.2', 'end': '84.120.254.62'}], 'gateway_ip': '84.120.254.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '84.120.254.2', 'tags': [], 'project_id': '5f3507b65d8e47a9a506a0daf082ae91'}}
2025-11-03 03:11:44,826 - INFO - Created VN ctest-mgmt_vn-32068159
2025-11-03 03:11:44,839 - DEBUG - VN ctest-mgmt_vn-32068159 UUID is c8c41d2b-d752-4c58-9f1e-a8b890839976
2025-11-03 03:11:44,907 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:44,913 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:44,925 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:45,014 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c8c41d2b-d752-4c58-9f1e-a8b890839976
2025-11-03 03:11:45,025 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c8c41d2b-d752-4c58-9f1e-a8b890839976
2025-11-03 03:11:45,035 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/22d4267e-a996-4bba-bbc6-0ae078e2b316
2025-11-03 03:11:45,045 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/22d4267e-a996-4bba-bbc6-0ae078e2b316
2025-11-03 03:11:45,053 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/f673c390-4d17-44f5-bcb6-a96cc6ecd078
2025-11-03 03:11:45,061 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:11:45,061 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c8c41d2b-d752-4c58-9f1e-a8b890839976
2025-11-03 03:11:45,071 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/22d4267e-a996-4bba-bbc6-0ae078e2b316
2025-11-03 03:11:45,088 - INFO - Verified VN network id 16 for VN c8c41d2b-d752-4c58-9f1e-a8b890839976
2025-11-03 03:11:45,088 - INFO - Verifications in API Server for VN ctest-mgmt_vn-32068159 passed
2025-11-03 03:11:45,088 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c8c41d2b-d752-4c58-9f1e-a8b890839976
2025-11-03 03:11:45,102 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/22d4267e-a996-4bba-bbc6-0ae078e2b316
2025-11-03 03:11:45,113 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/22d4267e-a996-4bba-bbc6-0ae078e2b316
2025-11-03 03:11:45,120 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/f673c390-4d17-44f5-bcb6-a96cc6ecd078
2025-11-03 03:11:45,131 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14466719977154169944', 'uuid-lslong': '11465787211983853942'}, 'enable': 'true', 'created': '2025-11-03T03:11:44', 'last-modified': '2025-11-03T03:11:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490655'}
2025-11-03 03:11:45,138 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:11:45,147 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14466719977154169944', 'uuid-lslong': '11465787211983853942'}, 'enable': 'true', 'created': '2025-11-03T03:11:44', 'last-modified': '2025-11-03T03:11:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.502791'}
2025-11-03 03:11:45,155 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:11:45,162 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14466719977154169944', 'uuid-lslong': '11465787211983853942'}, 'enable': 'true', 'created': '2025-11-03T03:11:44', 'last-modified': '2025-11-03T03:11:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.517224'}
2025-11-03 03:11:45,169 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:11:45,169 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-32068159 passed
2025-11-03 03:11:45,170 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-32068159 in API_Server ======
2025-11-03 03:11:45,170 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:45,177 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:45,190 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:45,283 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c8c41d2b-d752-4c58-9f1e-a8b890839976
2025-11-03 03:11:45,294 - DEBUG - =>VN ctest-mgmt_vn-32068159 has no policy to be verified
2025-11-03 03:11:45,294 - DEBUG - Verifying the vn in opserver
2025-11-03 03:11:45,294 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159 virtual network link through opserver 10.0.0.249
2025-11-03 03:11:45,294 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:11:45,307 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159?flat'}
2025-11-03 03:11:45,307 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159 virtual network link through opserver 10.0.0.61
2025-11-03 03:11:45,307 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:11:45,321 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159?flat'}
2025-11-03 03:11:45,321 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159 virtual network link through opserver 10.0.0.23
2025-11-03 03:11:45,321 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:11:45,334 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159?flat'}
2025-11-03 03:11:45,334 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-20846099:ctest-mgmt_vn-32068159 is found in opserver
2025-11-03 03:11:45,354 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:11:45,364 - DEBUG - VRF ids for VN ctest-mgmt_vn-32068159: {}
2025-11-03 03:11:45,627 - DEBUG - Response for create_network : {'network': {'id': '1b5065b9-e88d-4821-9adb-5d07971f27c0', 'name': 'ctest-left_vn-69362605', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'project_id': '5f3507b65d8e47a9a506a0daf082ae91', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-20846099', 'ctest-left_vn-69362605'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:11:45,870 - DEBUG - Response for create_subnet : {'subnet': {'id': '528a10a5-5477-4ae4-a6e0-836d376724d4', 'name': '', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'network_id': '1b5065b9-e88d-4821-9adb-5d07971f27c0', 'ip_version': 4, 'cidr': '210.124.92.64/26', 'allocation_pools': [{'start': '210.124.92.66', 'end': '210.124.92.126'}], 'gateway_ip': '210.124.92.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '210.124.92.66', 'tags': [], 'project_id': '5f3507b65d8e47a9a506a0daf082ae91'}}
2025-11-03 03:11:45,891 - INFO - Created VN ctest-left_vn-69362605
2025-11-03 03:11:45,902 - DEBUG - VN ctest-left_vn-69362605 UUID is 1b5065b9-e88d-4821-9adb-5d07971f27c0
2025-11-03 03:11:45,972 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:45,979 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:45,990 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:46,074 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1b5065b9-e88d-4821-9adb-5d07971f27c0
2025-11-03 03:11:46,087 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1b5065b9-e88d-4821-9adb-5d07971f27c0
2025-11-03 03:11:46,096 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4544f349-8591-408c-8af0-389d44ab47d6
2025-11-03 03:11:46,105 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4544f349-8591-408c-8af0-389d44ab47d6
2025-11-03 03:11:46,113 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/08c6fcb7-1dc7-4315-9e37-ac795bedae78
2025-11-03 03:11:46,119 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:11:46,119 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1b5065b9-e88d-4821-9adb-5d07971f27c0
2025-11-03 03:11:46,127 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4544f349-8591-408c-8af0-389d44ab47d6
2025-11-03 03:11:46,143 - INFO - Verified VN network id 17 for VN 1b5065b9-e88d-4821-9adb-5d07971f27c0
2025-11-03 03:11:46,143 - INFO - Verifications in API Server for VN ctest-left_vn-69362605 passed
2025-11-03 03:11:46,143 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1b5065b9-e88d-4821-9adb-5d07971f27c0
2025-11-03 03:11:46,152 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4544f349-8591-408c-8af0-389d44ab47d6
2025-11-03 03:11:46,159 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4544f349-8591-408c-8af0-389d44ab47d6
2025-11-03 03:11:46,166 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/08c6fcb7-1dc7-4315-9e37-ac795bedae78
2025-11-03 03:11:46,176 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1968184886305835041', 'uuid-lslong': '11158614788922091456'}, 'enable': 'true', 'created': '2025-11-03T03:11:45', 'last-modified': '2025-11-03T03:11:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.353465'}
2025-11-03 03:11:46,183 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:11:46,188 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1968184886305835041', 'uuid-lslong': '11158614788922091456'}, 'enable': 'true', 'created': '2025-11-03T03:11:45', 'last-modified': '2025-11-03T03:11:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.367471'}
2025-11-03 03:11:46,194 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:11:46,199 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1968184886305835041', 'uuid-lslong': '11158614788922091456'}, 'enable': 'true', 'created': '2025-11-03T03:11:45', 'last-modified': '2025-11-03T03:11:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382306'}
2025-11-03 03:11:46,205 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:11:46,205 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-69362605 passed
2025-11-03 03:11:46,205 - DEBUG - ====Verifying policy data for ctest-left_vn-69362605 in API_Server ======
2025-11-03 03:11:46,205 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:46,211 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:46,221 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:46,327 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1b5065b9-e88d-4821-9adb-5d07971f27c0
2025-11-03 03:11:46,337 - DEBUG - =>VN ctest-left_vn-69362605 has no policy to be verified
2025-11-03 03:11:46,337 - DEBUG - Verifying the vn in opserver
2025-11-03 03:11:46,337 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605 virtual network link through opserver 10.0.0.249
2025-11-03 03:11:46,337 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:11:46,350 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605?flat'}
2025-11-03 03:11:46,350 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605 virtual network link through opserver 10.0.0.61
2025-11-03 03:11:46,350 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:11:46,364 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605?flat'}
2025-11-03 03:11:46,364 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605 virtual network link through opserver 10.0.0.23
2025-11-03 03:11:46,364 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:11:46,376 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605?flat'}
2025-11-03 03:11:46,376 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-20846099:ctest-left_vn-69362605 is found in opserver
2025-11-03 03:11:46,396 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:11:46,407 - DEBUG - VRF ids for VN ctest-left_vn-69362605: {}
2025-11-03 03:11:46,664 - DEBUG - Response for create_network : {'network': {'id': '9759fcbd-70ca-47c9-a26b-a8df15b1b573', 'name': 'ctest-right_vn-89155314', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'project_id': '5f3507b65d8e47a9a506a0daf082ae91', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-20846099', 'ctest-right_vn-89155314'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:11:46,896 - DEBUG - Response for create_subnet : {'subnet': {'id': '7ca5f756-c25a-44f0-a4b9-6ebd44de1a0b', 'name': '', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'network_id': '9759fcbd-70ca-47c9-a26b-a8df15b1b573', 'ip_version': 4, 'cidr': '11.128.230.0/26', 'allocation_pools': [{'start': '11.128.230.2', 'end': '11.128.230.62'}], 'gateway_ip': '11.128.230.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.128.230.2', 'tags': [], 'project_id': '5f3507b65d8e47a9a506a0daf082ae91'}}
2025-11-03 03:11:46,925 - INFO - Created VN ctest-right_vn-89155314
2025-11-03 03:11:46,938 - DEBUG - VN ctest-right_vn-89155314 UUID is 9759fcbd-70ca-47c9-a26b-a8df15b1b573
2025-11-03 03:11:47,008 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:47,014 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:47,025 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:47,111 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9759fcbd-70ca-47c9-a26b-a8df15b1b573
2025-11-03 03:11:47,129 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9759fcbd-70ca-47c9-a26b-a8df15b1b573
2025-11-03 03:11:47,143 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4dc7e1fd-5cea-4d55-b4e3-beeceb1cc49b
2025-11-03 03:11:47,152 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4dc7e1fd-5cea-4d55-b4e3-beeceb1cc49b
2025-11-03 03:11:47,161 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7dd36c06-5e40-4e0d-98ce-bd46395a3c69
2025-11-03 03:11:47,169 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:11:47,169 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9759fcbd-70ca-47c9-a26b-a8df15b1b573
2025-11-03 03:11:47,179 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4dc7e1fd-5cea-4d55-b4e3-beeceb1cc49b
2025-11-03 03:11:47,194 - INFO - Verified VN network id 18 for VN 9759fcbd-70ca-47c9-a26b-a8df15b1b573
2025-11-03 03:11:47,194 - INFO - Verifications in API Server for VN ctest-right_vn-89155314 passed
2025-11-03 03:11:47,194 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9759fcbd-70ca-47c9-a26b-a8df15b1b573
2025-11-03 03:11:47,206 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4dc7e1fd-5cea-4d55-b4e3-beeceb1cc49b
2025-11-03 03:11:47,213 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4dc7e1fd-5cea-4d55-b4e3-beeceb1cc49b
2025-11-03 03:11:47,221 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7dd36c06-5e40-4e0d-98ce-bd46395a3c69
2025-11-03 03:11:47,233 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10906025863225690057', 'uuid-lslong': '11703633732747507059'}, 'enable': 'true', 'created': '2025-11-03T03:11:46', 'last-modified': '2025-11-03T03:11:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403701'}
2025-11-03 03:11:47,238 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:11:47,244 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10906025863225690057', 'uuid-lslong': '11703633732747507059'}, 'enable': 'true', 'created': '2025-11-03T03:11:46', 'last-modified': '2025-11-03T03:11:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414382'}
2025-11-03 03:11:47,251 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:11:47,256 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10906025863225690057', 'uuid-lslong': '11703633732747507059'}, 'enable': 'true', 'created': '2025-11-03T03:11:46', 'last-modified': '2025-11-03T03:11:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424750'}
2025-11-03 03:11:47,261 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:11:47,262 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-89155314 passed
2025-11-03 03:11:47,262 - DEBUG - ====Verifying policy data for ctest-right_vn-89155314 in API_Server ======
2025-11-03 03:11:47,262 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:47,267 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:47,278 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:47,372 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9759fcbd-70ca-47c9-a26b-a8df15b1b573
2025-11-03 03:11:47,381 - DEBUG - =>VN ctest-right_vn-89155314 has no policy to be verified
2025-11-03 03:11:47,381 - DEBUG - Verifying the vn in opserver
2025-11-03 03:11:47,381 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314 virtual network link through opserver 10.0.0.249
2025-11-03 03:11:47,381 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:11:47,393 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314?flat'}
2025-11-03 03:11:47,393 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314 virtual network link through opserver 10.0.0.61
2025-11-03 03:11:47,393 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:11:47,406 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314?flat'}
2025-11-03 03:11:47,406 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314 virtual network link through opserver 10.0.0.23
2025-11-03 03:11:47,406 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:11:47,418 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314?flat'}
2025-11-03 03:11:47,418 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-20846099:ctest-right_vn-89155314 is found in opserver
2025-11-03 03:11:47,437 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:11:47,448 - DEBUG - VRF ids for VN ctest-right_vn-89155314: {}
2025-11-03 03:11:47,695 - DEBUG - Response for create_network : {'network': {'id': 'f9e402ef-7501-41db-b821-ceab4ab4ad8a', 'name': 'ctest-trans_left_vn-41929407', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'project_id': '5f3507b65d8e47a9a506a0daf082ae91', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-20846099', 'ctest-trans_left_vn-41929407'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:11:47,958 - DEBUG - Response for create_subnet : {'subnet': {'id': '55aebba7-524f-400a-a343-9a70120d7a79', 'name': '', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'network_id': 'f9e402ef-7501-41db-b821-ceab4ab4ad8a', 'ip_version': 4, 'cidr': '106.176.182.0/26', 'allocation_pools': [{'start': '106.176.182.2', 'end': '106.176.182.62'}], 'gateway_ip': '106.176.182.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '106.176.182.2', 'tags': [], 'project_id': '5f3507b65d8e47a9a506a0daf082ae91'}}
2025-11-03 03:11:47,979 - INFO - Created VN ctest-trans_left_vn-41929407
2025-11-03 03:11:47,992 - DEBUG - VN ctest-trans_left_vn-41929407 UUID is f9e402ef-7501-41db-b821-ceab4ab4ad8a
2025-11-03 03:11:48,055 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:48,061 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:48,071 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:48,163 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/f9e402ef-7501-41db-b821-ceab4ab4ad8a
2025-11-03 03:11:48,174 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/f9e402ef-7501-41db-b821-ceab4ab4ad8a
2025-11-03 03:11:48,185 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84086648-c9e6-4ce9-a200-cdc7a65837ad
2025-11-03 03:11:48,197 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84086648-c9e6-4ce9-a200-cdc7a65837ad
2025-11-03 03:11:48,204 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/37f9f7b4-8159-4c76-b643-40378747f543
2025-11-03 03:11:48,212 - DEBUG - Route Targets: ['target:64512:8000008']
2025-11-03 03:11:48,212 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/f9e402ef-7501-41db-b821-ceab4ab4ad8a
2025-11-03 03:11:48,220 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84086648-c9e6-4ce9-a200-cdc7a65837ad
2025-11-03 03:11:48,235 - INFO - Verified VN network id 19 for VN f9e402ef-7501-41db-b821-ceab4ab4ad8a
2025-11-03 03:11:48,235 - INFO - Verifications in API Server for VN ctest-trans_left_vn-41929407 passed
2025-11-03 03:11:48,235 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/f9e402ef-7501-41db-b821-ceab4ab4ad8a
2025-11-03 03:11:48,246 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84086648-c9e6-4ce9-a200-cdc7a65837ad
2025-11-03 03:11:48,254 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84086648-c9e6-4ce9-a200-cdc7a65837ad
2025-11-03 03:11:48,261 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/37f9f7b4-8159-4c76-b643-40378747f543
2025-11-03 03:11:48,276 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18006520437617541595', 'uuid-lslong': '13268113212298276234'}, 'enable': 'true', 'created': '2025-11-03T03:11:47', 'last-modified': '2025-11-03T03:11:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376627'}
2025-11-03 03:11:48,282 - DEBUG - Route Targets: ['target:64512:8000008']
2025-11-03 03:11:48,287 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18006520437617541595', 'uuid-lslong': '13268113212298276234'}, 'enable': 'true', 'created': '2025-11-03T03:11:47', 'last-modified': '2025-11-03T03:11:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392095'}
2025-11-03 03:11:48,293 - DEBUG - Route Targets: ['target:64512:8000008']
2025-11-03 03:11:48,299 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18006520437617541595', 'uuid-lslong': '13268113212298276234'}, 'enable': 'true', 'created': '2025-11-03T03:11:47', 'last-modified': '2025-11-03T03:11:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404564'}
2025-11-03 03:11:48,305 - DEBUG - Route Targets: ['target:64512:8000008']
2025-11-03 03:11:48,305 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-41929407 passed
2025-11-03 03:11:48,306 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-41929407 in API_Server ======
2025-11-03 03:11:48,306 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:48,312 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:48,323 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:48,415 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/f9e402ef-7501-41db-b821-ceab4ab4ad8a
2025-11-03 03:11:48,424 - DEBUG - =>VN ctest-trans_left_vn-41929407 has no policy to be verified
2025-11-03 03:11:48,425 - DEBUG - Verifying the vn in opserver
2025-11-03 03:11:48,425 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407 virtual network link through opserver 10.0.0.249
2025-11-03 03:11:48,425 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:11:48,438 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407?flat'}
2025-11-03 03:11:48,438 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407 virtual network link through opserver 10.0.0.61
2025-11-03 03:11:48,438 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:11:48,458 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407?flat'}
2025-11-03 03:11:48,458 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407 virtual network link through opserver 10.0.0.23
2025-11-03 03:11:48,458 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:11:48,473 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407?flat'}
2025-11-03 03:11:48,473 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-20846099:ctest-trans_left_vn-41929407 is found in opserver
2025-11-03 03:11:48,500 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:11:48,513 - DEBUG - VRF ids for VN ctest-trans_left_vn-41929407: {}
2025-11-03 03:11:48,787 - DEBUG - Response for create_network : {'network': {'id': '343fd03d-5f5c-430a-a574-c560b8b081b7', 'name': 'ctest-trans_right_vn-10625290', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'project_id': '5f3507b65d8e47a9a506a0daf082ae91', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-20846099', 'ctest-trans_right_vn-10625290'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:11:49,027 - DEBUG - Response for create_subnet : {'subnet': {'id': '1059427d-c490-40ca-8803-4c347e7bf206', 'name': '', 'tenant_id': '5f3507b65d8e47a9a506a0daf082ae91', 'network_id': '343fd03d-5f5c-430a-a574-c560b8b081b7', 'ip_version': 4, 'cidr': '149.31.156.64/26', 'allocation_pools': [{'start': '149.31.156.66', 'end': '149.31.156.126'}], 'gateway_ip': '149.31.156.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.31.156.66', 'tags': [], 'project_id': '5f3507b65d8e47a9a506a0daf082ae91'}}
2025-11-03 03:11:49,048 - INFO - Created VN ctest-trans_right_vn-10625290
2025-11-03 03:11:49,058 - DEBUG - VN ctest-trans_right_vn-10625290 UUID is 343fd03d-5f5c-430a-a574-c560b8b081b7
2025-11-03 03:11:49,132 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:49,138 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:49,150 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:49,244 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/343fd03d-5f5c-430a-a574-c560b8b081b7
2025-11-03 03:11:49,259 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/343fd03d-5f5c-430a-a574-c560b8b081b7
2025-11-03 03:11:49,270 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fd617bd-b926-48c4-b26f-795f462b5314
2025-11-03 03:11:49,284 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fd617bd-b926-48c4-b26f-795f462b5314
2025-11-03 03:11:49,292 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/324458d9-7f4f-429e-9b93-8f00f4a33261
2025-11-03 03:11:49,299 - DEBUG - Route Targets: ['target:64512:8000009']
2025-11-03 03:11:49,299 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/343fd03d-5f5c-430a-a574-c560b8b081b7
2025-11-03 03:11:49,309 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fd617bd-b926-48c4-b26f-795f462b5314
2025-11-03 03:11:49,324 - INFO - Verified VN network id 20 for VN 343fd03d-5f5c-430a-a574-c560b8b081b7
2025-11-03 03:11:49,324 - INFO - Verifications in API Server for VN ctest-trans_right_vn-10625290 passed
2025-11-03 03:11:49,324 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/343fd03d-5f5c-430a-a574-c560b8b081b7
2025-11-03 03:11:49,337 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fd617bd-b926-48c4-b26f-795f462b5314
2025-11-03 03:11:49,345 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fd617bd-b926-48c4-b26f-795f462b5314
2025-11-03 03:11:49,354 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/324458d9-7f4f-429e-9b93-8f00f4a33261
2025-11-03 03:11:49,368 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3764956775516488458', 'uuid-lslong': '11922371132762653111'}, 'enable': 'true', 'created': '2025-11-03T03:11:48', 'last-modified': '2025-11-03T03:11:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.381978'}
2025-11-03 03:11:49,374 - DEBUG - Route Targets: ['target:64512:8000009']
2025-11-03 03:11:49,380 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3764956775516488458', 'uuid-lslong': '11922371132762653111'}, 'enable': 'true', 'created': '2025-11-03T03:11:48', 'last-modified': '2025-11-03T03:11:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402670'}
2025-11-03 03:11:49,386 - DEBUG - Route Targets: ['target:64512:8000009']
2025-11-03 03:11:49,391 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-20846099', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3764956775516488458', 'uuid-lslong': '11922371132762653111'}, 'enable': 'true', 'created': '2025-11-03T03:11:48', 'last-modified': '2025-11-03T03:11:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414895'}
2025-11-03 03:11:49,397 - DEBUG - Route Targets: ['target:64512:8000009']
2025-11-03 03:11:49,397 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-10625290 passed
2025-11-03 03:11:49,397 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-10625290 in API_Server ======
2025-11-03 03:11:49,397 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:49,403 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:49,413 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:49,502 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/343fd03d-5f5c-430a-a574-c560b8b081b7
2025-11-03 03:11:49,513 - DEBUG - =>VN ctest-trans_right_vn-10625290 has no policy to be verified
2025-11-03 03:11:49,513 - DEBUG - Verifying the vn in opserver
2025-11-03 03:11:49,513 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290 virtual network link through opserver 10.0.0.249
2025-11-03 03:11:49,513 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:11:49,527 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290?flat'}
2025-11-03 03:11:49,527 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290 virtual network link through opserver 10.0.0.61
2025-11-03 03:11:49,527 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:11:49,542 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290?flat'}
2025-11-03 03:11:49,542 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290 virtual network link through opserver 10.0.0.23
2025-11-03 03:11:49,542 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:11:49,554 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290?flat'}
2025-11-03 03:11:49,554 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-20846099:ctest-trans_right_vn-10625290 is found in opserver
2025-11-03 03:11:49,579 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:11:49,590 - DEBUG - VRF ids for VN ctest-trans_right_vn-10625290: {}
2025-11-03 03:11:50,623 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1)
2025-11-03 03:11:51,982 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2)
2025-11-03 03:11:51,982 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-09012900']
2025-11-03 03:11:52,281 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-09012900'] created succesfully
2025-11-03 03:11:52,619 - DEBUG - Image by name tiny_trans_fw not found
2025-11-03 03:11:52,619 - DEBUG - Installing image tiny_trans_fw
2025-11-03 03:11:52,619 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-11-03 03:11:52,619 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-11-03 03:11:52,620 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-11-03 03:11:52,646 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-11-03 03:11:52,674 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-11-03 03:11:52,674 - DEBUG - Unzip image
2025-11-03 03:11:52,674 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-11-03 03:11:52,691 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found
2025-11-03 03:11:52,691 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-09012900']
2025-11-03 03:11:52,784 - INFO - Service template: ['default-domain', 'ctest-service_template_1-09012900'] deleted successfully.
2025-11-03 03:11:52,785 - INFO - Skip interface_detach for VM ctest-right_vm-90115196 in state BUILD
2025-11-03 03:11:52,785 - INFO - Deleting VM ctest-right_vm-90115196
2025-11-03 03:11:52,785 - ERROR - VM ctest-right_vm-90115196 has failed to come up
2025-11-03 03:11:52,785 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:52,785 - ERROR - VM ctest-right_vm-90115196 has failed to come up
2025-11-03 03:11:52,785 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:52,882 - INFO - Skip interface_detach for VM ctest-left_vm-60465203 in state BUILD
2025-11-03 03:11:52,882 - INFO - Deleting VM ctest-left_vm-60465203
2025-11-03 03:11:52,882 - ERROR - VM ctest-left_vm-60465203 has failed to come up
2025-11-03 03:11:52,882 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:52,882 - ERROR - VM ctest-left_vm-60465203 has failed to come up
2025-11-03 03:11:52,882 - ERROR - Nova failed to get host of the VM
2025-11-03 03:11:52,953 - INFO - Deleting VN ctest-trans_right_vn-10625290
2025-11-03 03:11:53,107 - DEBUG - Response for deleting network ()
2025-11-03 03:11:53,108 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fd617bd-b926-48c4-b26f-795f462b5314
2025-11-03 03:11:53,118 - DEBUG - Response Code: 404
2025-11-03 03:11:53,118 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:53,124 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:53,140 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:53,234 - INFO - Validated that VN ctest-trans_right_vn-10625290 is not found in API Server
2025-11-03 03:11:53,247 - DEBUG - VN ctest-trans_right_vn-10625290 is not present in Agent 10.0.0.73
2025-11-03 03:11:53,260 - DEBUG - VN ctest-trans_right_vn-10625290 is not present in Agent 10.0.0.33
2025-11-03 03:11:53,260 - INFO - Validated that VN ctest-trans_right_vn-10625290 is not in any agent
2025-11-03 03:11:53,293 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-10625290 info
2025-11-03 03:11:53,293 - INFO - Deleting VN ctest-trans_left_vn-41929407
2025-11-03 03:11:53,490 - DEBUG - Response for deleting network ()
2025-11-03 03:11:53,490 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84086648-c9e6-4ce9-a200-cdc7a65837ad
2025-11-03 03:11:53,497 - DEBUG - Response Code: 404
2025-11-03 03:11:53,497 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:11:53,506 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:11:53,519 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:11:53,612 - INFO - Validated that VN ctest-trans_left_vn-41929407 is not found in API Server
2025-11-03 03:11:53,623 - DEBUG - VN ctest-trans_left_vn-41929407 is not present in Agent 10.0.0.73
2025-11-03 03:11:53,633 - DEBUG - VN ctest-trans_left_vn-41929407 is not present in Agent 10.0.0.33
2025-11-03 03:11:53,633 - INFO - Validated that VN ctest-trans_left_vn-41929407 is not in any agent
2025-11-03 03:11:53,663 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-41929407 info
2025-11-03 03:11:53,663 - INFO - Deleting VN ctest-right_vn-89155314
2025-11-03 03:11:53,704 - DEBUG - VN 9759fcbd-70ca-47c9-a26b-a8df15b1b573 still in use: Unable to complete operation on network 9759fcbd-70ca-47c9-a26b-a8df15b1b573. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e5d922e0-ebe0-44d6-99d2-927a8c2a198c']
2025-11-03 03:11:53,704 - WARNING - Deleting VN ctest-right_vn-89155314 failed..Will retry
2025-11-03 03:11:55,748 - DEBUG - VN 9759fcbd-70ca-47c9-a26b-a8df15b1b573 still in use: Unable to complete operation on network 9759fcbd-70ca-47c9-a26b-a8df15b1b573. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-23602d2d-26d7-48e0-bf79-d5f3807a06b7']
2025-11-03 03:11:55,748 - WARNING - Deleting VN ctest-right_vn-89155314 failed..Will retry
2025-11-03 03:11:57,793 - DEBUG - VN 9759fcbd-70ca-47c9-a26b-a8df15b1b573 still in use: Unable to complete operation on network 9759fcbd-70ca-47c9-a26b-a8df15b1b573. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-8520ba79-9cc2-4074-a10d-2a0f622584a1']
2025-11-03 03:11:57,793 - WARNING - Deleting VN ctest-right_vn-89155314 failed..Will retry
2025-11-03 03:11:59,840 - DEBUG - VN 9759fcbd-70ca-47c9-a26b-a8df15b1b573 still in use: Unable to complete operation on network 9759fcbd-70ca-47c9-a26b-a8df15b1b573. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e621d040-3157-4c88-9e16-6cd1accd0ffe']
2025-11-03 03:11:59,840 - WARNING - Deleting VN ctest-right_vn-89155314 failed..Will retry
2025-11-03 03:12:01,889 - DEBUG - VN 9759fcbd-70ca-47c9-a26b-a8df15b1b573 still in use: Unable to complete operation on network 9759fcbd-70ca-47c9-a26b-a8df15b1b573. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d622e992-f3e4-46ec-b5ef-60f7cf69067e']
2025-11-03 03:12:01,889 - WARNING - Deleting VN ctest-right_vn-89155314 failed..Will retry
2025-11-03 03:12:04,087 - DEBUG - Response for deleting network ()
2025-11-03 03:12:04,087 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4dc7e1fd-5cea-4d55-b4e3-beeceb1cc49b
2025-11-03 03:12:04,104 - DEBUG - Response Code: 404
2025-11-03 03:12:04,104 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:04,113 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:04,154 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:12:04,243 - INFO - Validated that VN ctest-right_vn-89155314 is not found in API Server
2025-11-03 03:12:04,256 - DEBUG - VN ctest-right_vn-89155314 is not present in Agent 10.0.0.73
2025-11-03 03:12:04,265 - DEBUG - VN ctest-right_vn-89155314 is not present in Agent 10.0.0.33
2025-11-03 03:12:04,265 - INFO - Validated that VN ctest-right_vn-89155314 is not in any agent
2025-11-03 03:12:04,303 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-89155314 info
2025-11-03 03:12:04,303 - INFO - Deleting VN ctest-left_vn-69362605
2025-11-03 03:12:04,503 - DEBUG - Response for deleting network ()
2025-11-03 03:12:04,503 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4544f349-8591-408c-8af0-389d44ab47d6
2025-11-03 03:12:04,509 - DEBUG - Response Code: 404
2025-11-03 03:12:04,509 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:04,526 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:04,546 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:12:04,640 - INFO - Validated that VN ctest-left_vn-69362605 is not found in API Server
2025-11-03 03:12:04,651 - DEBUG - VN ctest-left_vn-69362605 is not present in Agent 10.0.0.73
2025-11-03 03:12:04,666 - DEBUG - VN ctest-left_vn-69362605 is not present in Agent 10.0.0.33
2025-11-03 03:12:04,667 - INFO - Validated that VN ctest-left_vn-69362605 is not in any agent
2025-11-03 03:12:04,704 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-69362605 info
2025-11-03 03:12:04,704 - INFO - Deleting VN ctest-mgmt_vn-32068159
2025-11-03 03:12:04,895 - DEBUG - Response for deleting network ()
2025-11-03 03:12:04,895 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/22d4267e-a996-4bba-bbc6-0ae078e2b316
2025-11-03 03:12:04,901 - DEBUG - Response Code: 404
2025-11-03 03:12:04,901 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:04,908 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:04,919 - DEBUG - Requesting: http://10.0.0.249:8082/project/5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:12:05,015 - INFO - Validated that VN ctest-mgmt_vn-32068159 is not found in API Server
2025-11-03 03:12:05,024 - DEBUG - VN ctest-mgmt_vn-32068159 is not present in Agent 10.0.0.73
2025-11-03 03:12:05,039 - DEBUG - VN ctest-mgmt_vn-32068159 is not present in Agent 10.0.0.33
2025-11-03 03:12:05,039 - INFO - Validated that VN ctest-mgmt_vn-32068159 is not in any agent
2025-11-03 03:12:05,076 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-32068159 info
2025-11-03 03:12:06,411 - DEBUG - No XMPP flaps were noticed during the test
2025-11-03 03:12:06,411 - INFO -
2025-11-03 03:12:06,411 - INFO - END TEST : test_svc_v2_transparent_datapath : SKIPPED[0:00:24]
2025-11-03 03:12:06,411 - INFO - --------------------------------------------------------------------------------
2025-11-03 03:12:07,119 - INFO - Deleted project: ctest-TestSvcRegr-20846099, ID : 5f3507b6-5d8e-47a9-a506-a0daf082ae91
2025-11-03 03:12:07,290 - INFO - Domain Default found not creating
2025-11-03 03:12:07,433 - INFO - Project ctest-TestSvcRegr-52929804 not found, creating it
2025-11-03 03:12:07,962 - INFO - Created Project:ctest-TestSvcRegr-52929804, ID : 74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:09,394 - INFO - ================================================================================
2025-11-03 03:12:09,394 - INFO - STARTING TEST : test_svc_CEM_22032
2025-11-03 03:12:10,697 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.33': {'10.20.0.17': '0', '10.20.0.193': '0'}} with
2025-11-03 03:12:10,697 - INFO - Initial checks done. Running the testcase now
2025-11-03 03:12:10,697 - INFO -
2025-11-03 03:12:11,757 - DEBUG - Response for create_network : {'network': {'id': '2a16653c-3134-4262-bd8d-ab940f3e2158', 'name': 'ctest-mgmt_vn-87523420', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52929804', 'ctest-mgmt_vn-87523420'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:12:12,076 - DEBUG - Response for create_subnet : {'subnet': {'id': '92f572f1-3045-4782-8702-89dd695808c7', 'name': '', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'network_id': '2a16653c-3134-4262-bd8d-ab940f3e2158', 'ip_version': 4, 'cidr': '38.229.249.192/26', 'allocation_pools': [{'start': '38.229.249.194', 'end': '38.229.249.254'}], 'gateway_ip': '38.229.249.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '38.229.249.194', 'tags': [], 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b'}}
2025-11-03 03:12:12,096 - INFO - Created VN ctest-mgmt_vn-87523420
2025-11-03 03:12:12,107 - DEBUG - VN ctest-mgmt_vn-87523420 UUID is 2a16653c-3134-4262-bd8d-ab940f3e2158
2025-11-03 03:12:12,187 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:12,478 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:12,506 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:12,523 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:12,613 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/2a16653c-3134-4262-bd8d-ab940f3e2158
2025-11-03 03:12:12,624 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/2a16653c-3134-4262-bd8d-ab940f3e2158
2025-11-03 03:12:12,635 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/33256123-5c92-4049-8d62-222fb491aa77
2025-11-03 03:12:12,646 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/33256123-5c92-4049-8d62-222fb491aa77
2025-11-03 03:12:12,654 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/210c99ec-71d5-445d-8f53-c95889ab33f8
2025-11-03 03:12:12,661 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:12,661 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/2a16653c-3134-4262-bd8d-ab940f3e2158
2025-11-03 03:12:12,670 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/33256123-5c92-4049-8d62-222fb491aa77
2025-11-03 03:12:12,687 - INFO - Verified VN network id 16 for VN 2a16653c-3134-4262-bd8d-ab940f3e2158
2025-11-03 03:12:12,687 - INFO - Verifications in API Server for VN ctest-mgmt_vn-87523420 passed
2025-11-03 03:12:12,687 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/2a16653c-3134-4262-bd8d-ab940f3e2158
2025-11-03 03:12:12,696 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/33256123-5c92-4049-8d62-222fb491aa77
2025-11-03 03:12:12,704 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/33256123-5c92-4049-8d62-222fb491aa77
2025-11-03 03:12:12,711 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/210c99ec-71d5-445d-8f53-c95889ab33f8
2025-11-03 03:12:12,724 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3032722708278559330', 'uuid-lslong': '13658761897283821912'}, 'enable': 'true', 'created': '2025-11-03T03:12:11', 'last-modified': '2025-11-03T03:12:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.709676'}
2025-11-03 03:12:12,731 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:12,738 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3032722708278559330', 'uuid-lslong': '13658761897283821912'}, 'enable': 'true', 'created': '2025-11-03T03:12:11', 'last-modified': '2025-11-03T03:12:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.723101'}
2025-11-03 03:12:12,744 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:12,750 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3032722708278559330', 'uuid-lslong': '13658761897283821912'}, 'enable': 'true', 'created': '2025-11-03T03:12:11', 'last-modified': '2025-11-03T03:12:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.735682'}
2025-11-03 03:12:12,756 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:12,756 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-87523420 passed
2025-11-03 03:12:12,756 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-87523420 in API_Server ======
2025-11-03 03:12:12,756 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:12,762 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:12,772 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:12,874 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/2a16653c-3134-4262-bd8d-ab940f3e2158
2025-11-03 03:12:12,889 - DEBUG - =>VN ctest-mgmt_vn-87523420 has no policy to be verified
2025-11-03 03:12:12,889 - DEBUG - Verifying the vn in opserver
2025-11-03 03:12:12,889 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420 virtual network link through opserver 10.0.0.249
2025-11-03 03:12:12,889 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:12:13,195 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:12:13,258 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420?flat'}
2025-11-03 03:12:13,258 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420 virtual network link through opserver 10.0.0.61
2025-11-03 03:12:13,258 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:12:13,563 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:12:13,629 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420?flat'}
2025-11-03 03:12:13,629 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420 virtual network link through opserver 10.0.0.23
2025-11-03 03:12:13,630 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:12:13,937 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:12:13,996 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420?flat'}
2025-11-03 03:12:13,996 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-87523420 is found in opserver
2025-11-03 03:12:14,016 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:12:14,025 - DEBUG - VRF ids for VN ctest-mgmt_vn-87523420: {}
2025-11-03 03:12:14,311 - DEBUG - Response for create_network : {'network': {'id': '46d8612a-2188-47a0-905d-3637ce05c011', 'name': 'service-left-vn-68198739', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52929804', 'service-left-vn-68198739'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:12:14,574 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd4d5902c-8c8a-4b34-b9de-57034d6f6acc', 'name': '', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'network_id': '46d8612a-2188-47a0-905d-3637ce05c011', 'ip_version': 4, 'cidr': '98.106.248.0/26', 'allocation_pools': [{'start': '98.106.248.2', 'end': '98.106.248.62'}], 'gateway_ip': '98.106.248.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '98.106.248.2', 'tags': [], 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b'}}
2025-11-03 03:12:14,629 - INFO - Created VN service-left-vn-68198739
2025-11-03 03:12:14,646 - DEBUG - VN service-left-vn-68198739 UUID is 46d8612a-2188-47a0-905d-3637ce05c011
2025-11-03 03:12:14,743 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:14,752 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:14,765 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:14,870 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/46d8612a-2188-47a0-905d-3637ce05c011
2025-11-03 03:12:14,882 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/46d8612a-2188-47a0-905d-3637ce05c011
2025-11-03 03:12:14,897 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/873e59e6-4b41-4e85-9b2d-2685fb0ad416
2025-11-03 03:12:14,910 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/873e59e6-4b41-4e85-9b2d-2685fb0ad416
2025-11-03 03:12:14,919 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/269e44fc-ed0a-4a01-a003-b84449467fb9
2025-11-03 03:12:14,927 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:14,927 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/46d8612a-2188-47a0-905d-3637ce05c011
2025-11-03 03:12:14,936 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/873e59e6-4b41-4e85-9b2d-2685fb0ad416
2025-11-03 03:12:14,954 - INFO - Verified VN network id 17 for VN 46d8612a-2188-47a0-905d-3637ce05c011
2025-11-03 03:12:14,954 - INFO - Verifications in API Server for VN service-left-vn-68198739 passed
2025-11-03 03:12:14,954 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/46d8612a-2188-47a0-905d-3637ce05c011
2025-11-03 03:12:14,965 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/873e59e6-4b41-4e85-9b2d-2685fb0ad416
2025-11-03 03:12:14,973 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/873e59e6-4b41-4e85-9b2d-2685fb0ad416
2025-11-03 03:12:14,980 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/269e44fc-ed0a-4a01-a003-b84449467fb9
2025-11-03 03:12:14,992 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5104937011203557280', 'uuid-lslong': '10402530327603298321'}, 'enable': 'true', 'created': '2025-11-03T03:12:14', 'last-modified': '2025-11-03T03:12:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479707'}
2025-11-03 03:12:14,998 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:15,004 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5104937011203557280', 'uuid-lslong': '10402530327603298321'}, 'enable': 'true', 'created': '2025-11-03T03:12:14', 'last-modified': '2025-11-03T03:12:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.502866'}
2025-11-03 03:12:15,013 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:15,019 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5104937011203557280', 'uuid-lslong': '10402530327603298321'}, 'enable': 'true', 'created': '2025-11-03T03:12:14', 'last-modified': '2025-11-03T03:12:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.517245'}
2025-11-03 03:12:15,025 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:15,025 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-68198739 passed
2025-11-03 03:12:15,026 - DEBUG - ====Verifying policy data for service-left-vn-68198739 in API_Server ======
2025-11-03 03:12:15,026 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:15,032 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:15,043 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:15,137 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/46d8612a-2188-47a0-905d-3637ce05c011
2025-11-03 03:12:15,151 - DEBUG - =>VN service-left-vn-68198739 has no policy to be verified
2025-11-03 03:12:15,151 - DEBUG - Verifying the vn in opserver
2025-11-03 03:12:15,151 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739 virtual network link through opserver 10.0.0.249
2025-11-03 03:12:15,151 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:12:15,214 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739?flat'}
2025-11-03 03:12:15,214 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739 virtual network link through opserver 10.0.0.61
2025-11-03 03:12:15,214 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:12:15,277 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739?flat'}
2025-11-03 03:12:15,277 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739 virtual network link through opserver 10.0.0.23
2025-11-03 03:12:15,277 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:12:15,333 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739?flat'}
2025-11-03 03:12:15,333 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52929804:service-left-vn-68198739 is found in opserver
2025-11-03 03:12:15,352 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:12:15,362 - DEBUG - VRF ids for VN service-left-vn-68198739: {}
2025-11-03 03:12:15,640 - DEBUG - Response for create_network : {'network': {'id': '49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c', 'name': 'service-right-vn-38319972', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52929804', 'service-right-vn-38319972'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:12:15,878 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f2eb0771-b8bc-4426-98a8-d318129f1605', 'name': '', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'network_id': '49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c', 'ip_version': 4, 'cidr': '46.53.77.64/26', 'allocation_pools': [{'start': '46.53.77.66', 'end': '46.53.77.126'}], 'gateway_ip': '46.53.77.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '46.53.77.66', 'tags': [], 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b'}}
2025-11-03 03:12:15,901 - INFO - Created VN service-right-vn-38319972
2025-11-03 03:12:15,914 - DEBUG - VN service-right-vn-38319972 UUID is 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c
2025-11-03 03:12:15,995 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:16,001 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:16,014 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:16,110 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c
2025-11-03 03:12:16,124 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c
2025-11-03 03:12:16,136 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3b42b6d-592b-4ffe-894d-026fc2fdf953
2025-11-03 03:12:16,146 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3b42b6d-592b-4ffe-894d-026fc2fdf953
2025-11-03 03:12:16,155 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a1b46aef-61d0-4a58-ad3b-90f961d1e349
2025-11-03 03:12:16,166 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:16,166 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c
2025-11-03 03:12:16,177 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3b42b6d-592b-4ffe-894d-026fc2fdf953
2025-11-03 03:12:16,192 - INFO - Verified VN network id 18 for VN 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c
2025-11-03 03:12:16,192 - INFO - Verifications in API Server for VN service-right-vn-38319972 passed
2025-11-03 03:12:16,192 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c
2025-11-03 03:12:16,203 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3b42b6d-592b-4ffe-894d-026fc2fdf953
2025-11-03 03:12:16,210 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3b42b6d-592b-4ffe-894d-026fc2fdf953
2025-11-03 03:12:16,217 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a1b46aef-61d0-4a58-ad3b-90f961d1e349
2025-11-03 03:12:16,228 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5309286454422621412', 'uuid-lslong': '12542727546695759756'}, 'enable': 'true', 'created': '2025-11-03T03:12:15', 'last-modified': '2025-11-03T03:12:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.413524'}
2025-11-03 03:12:16,234 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:16,239 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5309286454422621412', 'uuid-lslong': '12542727546695759756'}, 'enable': 'true', 'created': '2025-11-03T03:12:15', 'last-modified': '2025-11-03T03:12:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.427288'}
2025-11-03 03:12:16,247 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:16,254 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5309286454422621412', 'uuid-lslong': '12542727546695759756'}, 'enable': 'true', 'created': '2025-11-03T03:12:15', 'last-modified': '2025-11-03T03:12:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433896'}
2025-11-03 03:12:16,260 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:16,260 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-38319972 passed
2025-11-03 03:12:16,260 - DEBUG - ====Verifying policy data for service-right-vn-38319972 in API_Server ======
2025-11-03 03:12:16,260 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:16,269 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:16,279 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:16,372 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c
2025-11-03 03:12:16,382 - DEBUG - =>VN service-right-vn-38319972 has no policy to be verified
2025-11-03 03:12:16,382 - DEBUG - Verifying the vn in opserver
2025-11-03 03:12:16,382 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972 virtual network link through opserver 10.0.0.249
2025-11-03 03:12:16,382 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:12:16,435 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972?flat'}
2025-11-03 03:12:16,435 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972 virtual network link through opserver 10.0.0.61
2025-11-03 03:12:16,435 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:12:16,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972?flat'}
2025-11-03 03:12:16,497 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972 virtual network link through opserver 10.0.0.23
2025-11-03 03:12:16,497 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:12:16,579 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972?flat'}
2025-11-03 03:12:16,579 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52929804:service-right-vn-38319972 is found in opserver
2025-11-03 03:12:16,601 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:12:16,613 - DEBUG - VRF ids for VN service-right-vn-38319972: {}
2025-11-03 03:12:16,675 - DEBUG - Services list from nova: [, , , ]
2025-11-03 03:12:17,723 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1)
2025-11-03 03:12:19,028 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2)
2025-11-03 03:12:19,028 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-89717166']
2025-11-03 03:12:19,322 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-89717166'] created succesfully
2025-11-03 03:12:19,691 - DEBUG - Image by name tiny_nat_fw not found
2025-11-03 03:12:19,691 - DEBUG - Installing image tiny_nat_fw
2025-11-03 03:12:19,691 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-11-03 03:12:19,691 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:12:19,691 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:12:19,691 - DEBUG - Unzip image
2025-11-03 03:12:19,691 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:12:19,709 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-11-03 03:12:19,709 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-89717166']
2025-11-03 03:12:19,819 - INFO - Service template: ['default-domain', 'ctest-service_template_1-89717166'] deleted successfully.
2025-11-03 03:12:19,819 - INFO - Skip interface_detach for VM ctest-right_vm-34310558 in state BUILD
2025-11-03 03:12:19,819 - INFO - Deleting VM ctest-right_vm-34310558
2025-11-03 03:12:19,887 - ERROR - VM ctest-right_vm-34310558 has failed to come up
2025-11-03 03:12:19,887 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:19,887 - ERROR - VM ctest-right_vm-34310558 has failed to come up
2025-11-03 03:12:19,887 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:19,974 - INFO - Skip interface_detach for VM ctest-left_vm-82399037 in state BUILD
2025-11-03 03:12:19,975 - INFO - Deleting VM ctest-left_vm-82399037
2025-11-03 03:12:19,975 - ERROR - VM ctest-left_vm-82399037 has failed to come up
2025-11-03 03:12:19,975 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:19,975 - ERROR - VM ctest-left_vm-82399037 has failed to come up
2025-11-03 03:12:19,975 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:20,066 - INFO - Deleting VN service-right-vn-38319972
2025-11-03 03:12:20,126 - DEBUG - VN 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c still in use: Unable to complete operation on network 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d5884ca7-fe5f-4566-9724-2f0e2f9e1902']
2025-11-03 03:12:20,126 - WARNING - Deleting VN service-right-vn-38319972 failed..Will retry
2025-11-03 03:12:22,173 - DEBUG - VN 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c still in use: Unable to complete operation on network 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-6ed086b3-0995-43bc-b61d-2871bc63f205']
2025-11-03 03:12:22,173 - WARNING - Deleting VN service-right-vn-38319972 failed..Will retry
2025-11-03 03:12:24,216 - DEBUG - VN 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c still in use: Unable to complete operation on network 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-4a9c1920-30f8-462c-9e10-28ec8cbff18c']
2025-11-03 03:12:24,216 - WARNING - Deleting VN service-right-vn-38319972 failed..Will retry
2025-11-03 03:12:26,267 - DEBUG - VN 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c still in use: Unable to complete operation on network 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f76e185c-3272-4f93-843a-31bd5a5080de']
2025-11-03 03:12:26,267 - WARNING - Deleting VN service-right-vn-38319972 failed..Will retry
2025-11-03 03:12:28,312 - DEBUG - VN 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c still in use: Unable to complete operation on network 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-650a80d3-534e-466b-a6d8-f2d58d4e4538']
2025-11-03 03:12:28,312 - WARNING - Deleting VN service-right-vn-38319972 failed..Will retry
2025-11-03 03:12:30,359 - DEBUG - VN 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c still in use: Unable to complete operation on network 49ae5fe6-86a7-4ce4-ae10-b83fdf4eb78c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d934e191-f76c-49bb-b8ac-a45c64955659']
2025-11-03 03:12:30,359 - WARNING - Deleting VN service-right-vn-38319972 failed..Will retry
2025-11-03 03:12:32,541 - DEBUG - Response for deleting network ()
2025-11-03 03:12:32,542 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3b42b6d-592b-4ffe-894d-026fc2fdf953
2025-11-03 03:12:32,549 - DEBUG - Response Code: 404
2025-11-03 03:12:32,549 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:32,558 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:32,574 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:32,685 - INFO - Validated that VN service-right-vn-38319972 is not found in API Server
2025-11-03 03:12:32,697 - DEBUG - VN service-right-vn-38319972 is not present in Agent 10.0.0.73
2025-11-03 03:12:32,707 - DEBUG - VN service-right-vn-38319972 is not present in Agent 10.0.0.33
2025-11-03 03:12:32,707 - INFO - Validated that VN service-right-vn-38319972 is not in any agent
2025-11-03 03:12:32,736 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-38319972 info
2025-11-03 03:12:32,736 - INFO - Deleting VN service-left-vn-68198739
2025-11-03 03:12:32,905 - DEBUG - Response for deleting network ()
2025-11-03 03:12:32,905 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/873e59e6-4b41-4e85-9b2d-2685fb0ad416
2025-11-03 03:12:32,917 - DEBUG - Response Code: 404
2025-11-03 03:12:32,918 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:32,924 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:32,938 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:33,052 - INFO - Validated that VN service-left-vn-68198739 is not found in API Server
2025-11-03 03:12:33,062 - DEBUG - VN service-left-vn-68198739 is not present in Agent 10.0.0.73
2025-11-03 03:12:33,072 - DEBUG - VN service-left-vn-68198739 is not present in Agent 10.0.0.33
2025-11-03 03:12:33,072 - INFO - Validated that VN service-left-vn-68198739 is not in any agent
2025-11-03 03:12:33,107 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-68198739 info
2025-11-03 03:12:33,107 - INFO - Deleting VN ctest-mgmt_vn-87523420
2025-11-03 03:12:33,246 - DEBUG - Response for deleting network ()
2025-11-03 03:12:33,247 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/33256123-5c92-4049-8d62-222fb491aa77
2025-11-03 03:12:33,252 - DEBUG - Response Code: 404
2025-11-03 03:12:33,252 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:33,256 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:33,277 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:33,388 - INFO - Validated that VN ctest-mgmt_vn-87523420 is not found in API Server
2025-11-03 03:12:33,399 - DEBUG - VN ctest-mgmt_vn-87523420 is not present in Agent 10.0.0.73
2025-11-03 03:12:33,414 - DEBUG - VN ctest-mgmt_vn-87523420 is not present in Agent 10.0.0.33
2025-11-03 03:12:33,414 - INFO - Validated that VN ctest-mgmt_vn-87523420 is not in any agent
2025-11-03 03:12:33,452 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-87523420 info
2025-11-03 03:12:34,739 - DEBUG - No XMPP flaps were noticed during the test
2025-11-03 03:12:34,739 - INFO -
2025-11-03 03:12:34,740 - INFO - END TEST : test_svc_CEM_22032 : SKIPPED[0:00:25]
2025-11-03 03:12:34,741 - INFO - --------------------------------------------------------------------------------
2025-11-03 03:12:34,747 - INFO - ================================================================================
2025-11-03 03:12:34,747 - INFO - STARTING TEST : test_svc_in_network_datapath
2025-11-03 03:12:36,034 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.33': {'10.20.0.17': '0', '10.20.0.193': '0'}} with
2025-11-03 03:12:36,034 - INFO - Initial checks done. Running the testcase now
2025-11-03 03:12:36,034 - INFO -
2025-11-03 03:12:36,350 - DEBUG - Response for create_network : {'network': {'id': '241e17d9-35f4-4f7e-aad9-4f73c3191caf', 'name': 'ctest-mgmt_vn-59681967', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52929804', 'ctest-mgmt_vn-59681967'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:12:36,568 - DEBUG - Response for create_subnet : {'subnet': {'id': '9e23942c-c26a-4980-b2ba-edffad9cc92a', 'name': '', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'network_id': '241e17d9-35f4-4f7e-aad9-4f73c3191caf', 'ip_version': 4, 'cidr': '76.199.55.128/26', 'allocation_pools': [{'start': '76.199.55.130', 'end': '76.199.55.190'}], 'gateway_ip': '76.199.55.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '76.199.55.130', 'tags': [], 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b'}}
2025-11-03 03:12:36,605 - INFO - Created VN ctest-mgmt_vn-59681967
2025-11-03 03:12:36,619 - DEBUG - VN ctest-mgmt_vn-59681967 UUID is 241e17d9-35f4-4f7e-aad9-4f73c3191caf
2025-11-03 03:12:36,708 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:36,715 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:36,729 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:36,815 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/241e17d9-35f4-4f7e-aad9-4f73c3191caf
2025-11-03 03:12:36,837 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/241e17d9-35f4-4f7e-aad9-4f73c3191caf
2025-11-03 03:12:36,845 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7e05789c-356d-4c5e-9cb6-93b8865a0f26
2025-11-03 03:12:36,855 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7e05789c-356d-4c5e-9cb6-93b8865a0f26
2025-11-03 03:12:36,861 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/46dfbfc3-3bc2-4660-b7c6-436037f59615
2025-11-03 03:12:36,869 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:36,869 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/241e17d9-35f4-4f7e-aad9-4f73c3191caf
2025-11-03 03:12:36,878 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7e05789c-356d-4c5e-9cb6-93b8865a0f26
2025-11-03 03:12:36,894 - INFO - Verified VN network id 16 for VN 241e17d9-35f4-4f7e-aad9-4f73c3191caf
2025-11-03 03:12:36,894 - INFO - Verifications in API Server for VN ctest-mgmt_vn-59681967 passed
2025-11-03 03:12:36,894 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/241e17d9-35f4-4f7e-aad9-4f73c3191caf
2025-11-03 03:12:36,904 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7e05789c-356d-4c5e-9cb6-93b8865a0f26
2025-11-03 03:12:36,913 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7e05789c-356d-4c5e-9cb6-93b8865a0f26
2025-11-03 03:12:36,919 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/46dfbfc3-3bc2-4660-b7c6-436037f59615
2025-11-03 03:12:36,931 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2602543856347271038', 'uuid-lslong': '12310958415006997679'}, 'enable': 'true', 'created': '2025-11-03T03:12:36', 'last-modified': '2025-11-03T03:12:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418758'}
2025-11-03 03:12:36,938 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:36,944 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2602543856347271038', 'uuid-lslong': '12310958415006997679'}, 'enable': 'true', 'created': '2025-11-03T03:12:36', 'last-modified': '2025-11-03T03:12:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433644'}
2025-11-03 03:12:36,949 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:36,962 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2602543856347271038', 'uuid-lslong': '12310958415006997679'}, 'enable': 'true', 'created': '2025-11-03T03:12:36', 'last-modified': '2025-11-03T03:12:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450578'}
2025-11-03 03:12:36,968 - DEBUG - Route Targets: ['target:64512:8000004']
2025-11-03 03:12:36,968 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-59681967 passed
2025-11-03 03:12:36,969 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-59681967 in API_Server ======
2025-11-03 03:12:36,969 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:36,975 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:36,987 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:37,096 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/241e17d9-35f4-4f7e-aad9-4f73c3191caf
2025-11-03 03:12:37,105 - DEBUG - =>VN ctest-mgmt_vn-59681967 has no policy to be verified
2025-11-03 03:12:37,105 - DEBUG - Verifying the vn in opserver
2025-11-03 03:12:37,105 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967 virtual network link through opserver 10.0.0.249
2025-11-03 03:12:37,105 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:12:37,118 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967?flat'}
2025-11-03 03:12:37,118 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967 virtual network link through opserver 10.0.0.61
2025-11-03 03:12:37,119 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:12:37,132 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967?flat'}
2025-11-03 03:12:37,132 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967 virtual network link through opserver 10.0.0.23
2025-11-03 03:12:37,132 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:12:37,145 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967?flat'}
2025-11-03 03:12:37,145 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52929804:ctest-mgmt_vn-59681967 is found in opserver
2025-11-03 03:12:37,165 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:12:37,181 - DEBUG - VRF ids for VN ctest-mgmt_vn-59681967: {}
2025-11-03 03:12:37,451 - DEBUG - Response for create_network : {'network': {'id': 'd4f4c369-0143-4a1a-b7f9-736ae0cb236c', 'name': 'ctest-left_vn-15922755', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52929804', 'ctest-left_vn-15922755'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:12:37,742 - DEBUG - Response for create_subnet : {'subnet': {'id': '79be2a8e-8830-4c6e-b98b-80e10cf57fc3', 'name': '', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'network_id': 'd4f4c369-0143-4a1a-b7f9-736ae0cb236c', 'ip_version': 4, 'cidr': '220.153.83.128/26', 'allocation_pools': [{'start': '220.153.83.130', 'end': '220.153.83.190'}], 'gateway_ip': '220.153.83.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.153.83.130', 'tags': [], 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b'}}
2025-11-03 03:12:37,768 - INFO - Created VN ctest-left_vn-15922755
2025-11-03 03:12:37,781 - DEBUG - VN ctest-left_vn-15922755 UUID is d4f4c369-0143-4a1a-b7f9-736ae0cb236c
2025-11-03 03:12:37,856 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:37,862 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:37,873 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:37,982 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d4f4c369-0143-4a1a-b7f9-736ae0cb236c
2025-11-03 03:12:38,011 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d4f4c369-0143-4a1a-b7f9-736ae0cb236c
2025-11-03 03:12:38,024 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/09be4ac7-d7eb-4595-9f01-60eb6a72e8e1
2025-11-03 03:12:38,034 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/09be4ac7-d7eb-4595-9f01-60eb6a72e8e1
2025-11-03 03:12:38,041 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/e0449a8a-382b-4525-92ab-9bca260be56b
2025-11-03 03:12:38,048 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:38,048 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d4f4c369-0143-4a1a-b7f9-736ae0cb236c
2025-11-03 03:12:38,057 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/09be4ac7-d7eb-4595-9f01-60eb6a72e8e1
2025-11-03 03:12:38,072 - INFO - Verified VN network id 17 for VN d4f4c369-0143-4a1a-b7f9-736ae0cb236c
2025-11-03 03:12:38,072 - INFO - Verifications in API Server for VN ctest-left_vn-15922755 passed
2025-11-03 03:12:38,073 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d4f4c369-0143-4a1a-b7f9-736ae0cb236c
2025-11-03 03:12:38,081 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/09be4ac7-d7eb-4595-9f01-60eb6a72e8e1
2025-11-03 03:12:38,093 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/09be4ac7-d7eb-4595-9f01-60eb6a72e8e1
2025-11-03 03:12:38,100 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/e0449a8a-382b-4525-92ab-9bca260be56b
2025-11-03 03:12:38,111 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15345104686118291994', 'uuid-lslong': '13256753881016902508'}, 'enable': 'true', 'created': '2025-11-03T03:12:37', 'last-modified': '2025-11-03T03:12:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434300'}
2025-11-03 03:12:38,119 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:38,124 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15345104686118291994', 'uuid-lslong': '13256753881016902508'}, 'enable': 'true', 'created': '2025-11-03T03:12:37', 'last-modified': '2025-11-03T03:12:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445057'}
2025-11-03 03:12:38,130 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:38,136 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15345104686118291994', 'uuid-lslong': '13256753881016902508'}, 'enable': 'true', 'created': '2025-11-03T03:12:37', 'last-modified': '2025-11-03T03:12:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.455486'}
2025-11-03 03:12:38,142 - DEBUG - Route Targets: ['target:64512:8000006']
2025-11-03 03:12:38,142 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-15922755 passed
2025-11-03 03:12:38,142 - DEBUG - ====Verifying policy data for ctest-left_vn-15922755 in API_Server ======
2025-11-03 03:12:38,142 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:38,151 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:38,162 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:38,246 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d4f4c369-0143-4a1a-b7f9-736ae0cb236c
2025-11-03 03:12:38,260 - DEBUG - =>VN ctest-left_vn-15922755 has no policy to be verified
2025-11-03 03:12:38,260 - DEBUG - Verifying the vn in opserver
2025-11-03 03:12:38,260 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755 virtual network link through opserver 10.0.0.249
2025-11-03 03:12:38,260 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:12:38,273 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755?flat'}
2025-11-03 03:12:38,273 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755 virtual network link through opserver 10.0.0.61
2025-11-03 03:12:38,273 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:12:38,286 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755?flat'}
2025-11-03 03:12:38,286 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755 virtual network link through opserver 10.0.0.23
2025-11-03 03:12:38,286 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:12:38,297 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755?flat'}
2025-11-03 03:12:38,297 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52929804:ctest-left_vn-15922755 is found in opserver
2025-11-03 03:12:38,318 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:12:38,330 - DEBUG - VRF ids for VN ctest-left_vn-15922755: {}
2025-11-03 03:12:38,627 - DEBUG - Response for create_network : {'network': {'id': '61019efb-696d-434c-a7f4-fbf831a30739', 'name': 'ctest-right_vn-62580347', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52929804', 'ctest-right_vn-62580347'], 'port_security_enabled': True, 'description': ''}}
2025-11-03 03:12:38,880 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b7807a7a-82fc-48ba-aa29-6cf41cc390e0', 'name': '', 'tenant_id': '74f0c7eb23a84759b5bd39f451d0e31b', 'network_id': '61019efb-696d-434c-a7f4-fbf831a30739', 'ip_version': 4, 'cidr': '123.175.211.128/26', 'allocation_pools': [{'start': '123.175.211.130', 'end': '123.175.211.190'}], 'gateway_ip': '123.175.211.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '123.175.211.130', 'tags': [], 'project_id': '74f0c7eb23a84759b5bd39f451d0e31b'}}
2025-11-03 03:12:38,902 - INFO - Created VN ctest-right_vn-62580347
2025-11-03 03:12:38,913 - DEBUG - VN ctest-right_vn-62580347 UUID is 61019efb-696d-434c-a7f4-fbf831a30739
2025-11-03 03:12:38,984 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:38,990 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:38,999 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:39,093 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/61019efb-696d-434c-a7f4-fbf831a30739
2025-11-03 03:12:39,107 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/61019efb-696d-434c-a7f4-fbf831a30739
2025-11-03 03:12:39,116 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fdb61dd-2db8-41b6-b76f-0cf9357d8ada
2025-11-03 03:12:39,125 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fdb61dd-2db8-41b6-b76f-0cf9357d8ada
2025-11-03 03:12:39,132 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/c1db2a0f-8cbb-416e-984d-ce75c8afaa54
2025-11-03 03:12:39,139 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:39,140 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/61019efb-696d-434c-a7f4-fbf831a30739
2025-11-03 03:12:39,151 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fdb61dd-2db8-41b6-b76f-0cf9357d8ada
2025-11-03 03:12:39,165 - INFO - Verified VN network id 18 for VN 61019efb-696d-434c-a7f4-fbf831a30739
2025-11-03 03:12:39,165 - INFO - Verifications in API Server for VN ctest-right_vn-62580347 passed
2025-11-03 03:12:39,165 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/61019efb-696d-434c-a7f4-fbf831a30739
2025-11-03 03:12:39,174 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fdb61dd-2db8-41b6-b76f-0cf9357d8ada
2025-11-03 03:12:39,180 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fdb61dd-2db8-41b6-b76f-0cf9357d8ada
2025-11-03 03:12:39,187 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/c1db2a0f-8cbb-416e-984d-ce75c8afaa54
2025-11-03 03:12:39,201 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6990042899298468684', 'uuid-lslong': '12102575142054594361'}, 'enable': 'true', 'created': '2025-11-03T03:12:38', 'last-modified': '2025-11-03T03:12:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.389440'}
2025-11-03 03:12:39,207 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:39,214 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6990042899298468684', 'uuid-lslong': '12102575142054594361'}, 'enable': 'true', 'created': '2025-11-03T03:12:38', 'last-modified': '2025-11-03T03:12:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399116'}
2025-11-03 03:12:39,219 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:39,224 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52929804', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6990042899298468684', 'uuid-lslong': '12102575142054594361'}, 'enable': 'true', 'created': '2025-11-03T03:12:38', 'last-modified': '2025-11-03T03:12:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414647'}
2025-11-03 03:12:39,230 - DEBUG - Route Targets: ['target:64512:8000007']
2025-11-03 03:12:39,230 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-62580347 passed
2025-11-03 03:12:39,230 - DEBUG - ====Verifying policy data for ctest-right_vn-62580347 in API_Server ======
2025-11-03 03:12:39,230 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:39,236 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:39,246 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:39,335 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/61019efb-696d-434c-a7f4-fbf831a30739
2025-11-03 03:12:39,350 - DEBUG - =>VN ctest-right_vn-62580347 has no policy to be verified
2025-11-03 03:12:39,350 - DEBUG - Verifying the vn in opserver
2025-11-03 03:12:39,350 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347 virtual network link through opserver 10.0.0.249
2025-11-03 03:12:39,350 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-11-03 03:12:39,364 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347?flat'}
2025-11-03 03:12:39,364 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347 virtual network link through opserver 10.0.0.61
2025-11-03 03:12:39,364 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-11-03 03:12:39,380 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347?flat'}
2025-11-03 03:12:39,380 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347 virtual network link through opserver 10.0.0.23
2025-11-03 03:12:39,380 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-11-03 03:12:39,392 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347?flat'}
2025-11-03 03:12:39,392 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52929804:ctest-right_vn-62580347 is found in opserver
2025-11-03 03:12:39,414 - DEBUG - Do not have enough data to verify VN in agent
2025-11-03 03:12:39,426 - DEBUG - VRF ids for VN ctest-right_vn-62580347: {}
2025-11-03 03:12:40,476 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2)
2025-11-03 03:12:41,710 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1)
2025-11-03 03:12:41,710 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-62813354']
2025-11-03 03:12:42,013 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-62813354'] created succesfully
2025-11-03 03:12:42,394 - DEBUG - Image by name tiny_nat_fw not found
2025-11-03 03:12:42,394 - DEBUG - Installing image tiny_nat_fw
2025-11-03 03:12:42,394 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-11-03 03:12:42,395 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:12:42,395 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:12:42,395 - DEBUG - Unzip image
2025-11-03 03:12:42,395 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-11-03 03:12:42,413 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-11-03 03:12:42,413 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-62813354']
2025-11-03 03:12:42,515 - INFO - Service template: ['default-domain', 'ctest-service_template_1-62813354'] deleted successfully.
2025-11-03 03:12:42,516 - INFO - Skip interface_detach for VM ctest-right_vm-35469219 in state BUILD
2025-11-03 03:12:42,517 - INFO - Deleting VM ctest-right_vm-35469219
2025-11-03 03:12:42,519 - ERROR - VM ctest-right_vm-35469219 has failed to come up
2025-11-03 03:12:42,520 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:42,522 - ERROR - VM ctest-right_vm-35469219 has failed to come up
2025-11-03 03:12:42,523 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:42,602 - INFO - Skip interface_detach for VM ctest-left_vm-13228249 in state BUILD
2025-11-03 03:12:42,602 - INFO - Deleting VM ctest-left_vm-13228249
2025-11-03 03:12:42,602 - ERROR - VM ctest-left_vm-13228249 has failed to come up
2025-11-03 03:12:42,602 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:42,602 - ERROR - VM ctest-left_vm-13228249 has failed to come up
2025-11-03 03:12:42,602 - ERROR - Nova failed to get host of the VM
2025-11-03 03:12:42,669 - INFO - Deleting VN ctest-right_vn-62580347
2025-11-03 03:12:42,710 - DEBUG - VN 61019efb-696d-434c-a7f4-fbf831a30739 still in use: Unable to complete operation on network 61019efb-696d-434c-a7f4-fbf831a30739. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7c665ca7-47fa-42cf-8046-9acc53f7e83c']
2025-11-03 03:12:42,710 - WARNING - Deleting VN ctest-right_vn-62580347 failed..Will retry
2025-11-03 03:12:44,871 - DEBUG - Response for deleting network ()
2025-11-03 03:12:44,871 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0fdb61dd-2db8-41b6-b76f-0cf9357d8ada
2025-11-03 03:12:44,877 - DEBUG - Response Code: 404
2025-11-03 03:12:44,877 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:44,893 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:44,908 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:45,009 - INFO - Validated that VN ctest-right_vn-62580347 is not found in API Server
2025-11-03 03:12:45,019 - DEBUG - VN ctest-right_vn-62580347 is not present in Agent 10.0.0.73
2025-11-03 03:12:45,028 - DEBUG - VN ctest-right_vn-62580347 is not present in Agent 10.0.0.33
2025-11-03 03:12:45,028 - INFO - Validated that VN ctest-right_vn-62580347 is not in any agent
2025-11-03 03:12:45,063 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-62580347 info
2025-11-03 03:12:45,063 - INFO - Deleting VN ctest-left_vn-15922755
2025-11-03 03:12:45,116 - DEBUG - VN d4f4c369-0143-4a1a-b7f9-736ae0cb236c still in use: Unable to complete operation on network d4f4c369-0143-4a1a-b7f9-736ae0cb236c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7bf0646b-e649-4f3c-a150-9605f4bcfc70']
2025-11-03 03:12:45,116 - WARNING - Deleting VN ctest-left_vn-15922755 failed..Will retry
2025-11-03 03:12:47,158 - DEBUG - VN d4f4c369-0143-4a1a-b7f9-736ae0cb236c still in use: Unable to complete operation on network d4f4c369-0143-4a1a-b7f9-736ae0cb236c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7bc2c338-af53-41d9-bd2a-317224e61ade']
2025-11-03 03:12:47,158 - WARNING - Deleting VN ctest-left_vn-15922755 failed..Will retry
2025-11-03 03:12:49,215 - DEBUG - VN d4f4c369-0143-4a1a-b7f9-736ae0cb236c still in use: Unable to complete operation on network d4f4c369-0143-4a1a-b7f9-736ae0cb236c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-aca60c3e-23db-48df-820f-faa6dbdb4c3c']
2025-11-03 03:12:49,215 - WARNING - Deleting VN ctest-left_vn-15922755 failed..Will retry
2025-11-03 03:12:51,263 - DEBUG - VN d4f4c369-0143-4a1a-b7f9-736ae0cb236c still in use: Unable to complete operation on network d4f4c369-0143-4a1a-b7f9-736ae0cb236c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-b916c34e-ea8e-4672-8d2c-3d27da288fad']
2025-11-03 03:12:51,263 - WARNING - Deleting VN ctest-left_vn-15922755 failed..Will retry
2025-11-03 03:12:53,412 - DEBUG - Response for deleting network ()
2025-11-03 03:12:53,412 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/09be4ac7-d7eb-4595-9f01-60eb6a72e8e1
2025-11-03 03:12:53,417 - DEBUG - Response Code: 404
2025-11-03 03:12:53,417 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:53,424 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:53,450 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:53,549 - INFO - Validated that VN ctest-left_vn-15922755 is not found in API Server
2025-11-03 03:12:53,559 - DEBUG - VN ctest-left_vn-15922755 is not present in Agent 10.0.0.73
2025-11-03 03:12:53,569 - DEBUG - VN ctest-left_vn-15922755 is not present in Agent 10.0.0.33
2025-11-03 03:12:53,569 - INFO - Validated that VN ctest-left_vn-15922755 is not in any agent
2025-11-03 03:12:53,599 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-15922755 info
2025-11-03 03:12:53,600 - INFO - Deleting VN ctest-mgmt_vn-59681967
2025-11-03 03:12:53,755 - DEBUG - Response for deleting network ()
2025-11-03 03:12:53,755 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7e05789c-356d-4c5e-9cb6-93b8865a0f26
2025-11-03 03:12:53,761 - DEBUG - Response Code: 404
2025-11-03 03:12:53,761 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:12:53,774 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:12:53,789 - DEBUG - Requesting: http://10.0.0.249:8082/project/74f0c7eb-23a8-4759-b5bd-39f451d0e31b
2025-11-03 03:12:53,892 - INFO - Validated that VN ctest-mgmt_vn-59681967 is not found in API Server
2025-11-03 03:12:53,907 - DEBUG - VN ctest-mgmt_vn-59681967 is not present in Agent 10.0.0.73
2025-11-03 03:12:53,923 - DEBUG - VN ctest-mgmt_vn-59681967 is not present in Agent 10.0.0.33
2025-11-03 03:12:53,923 - INFO - Validated that VN ctest-mgmt_vn-59681967 is not in any agent
2025-11-03 03:12:53,960 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-59681967 info
2025-11-03 03:12:55,278 - DEBUG - No XMPP flaps were noticed during the test
2025-11-03 03:12:55,278 - INFO -
2025-11-03 03:12:55,278 - INFO - END TEST : test_svc_in_network_datapath : SKIPPED[0:00:21]
2025-11-03 03:12:55,278 - INFO - --------------------------------------------------------------------------------
2025-11-03 03:12:55,997 - INFO - Deleted project: ctest-TestSvcRegr-52929804, ID : 74f0c7eb-23a8-4759-b5bd-39f451d0e31b