2025-05-13 12:33:25,824 - INFO - Domain Default found not creating
2025-05-13 12:33:26,024 - INFO - Project ctest-TestSvcRegr-38568322 not found, creating it
2025-05-13 12:33:26,614 - INFO - Created Project:ctest-TestSvcRegr-38568322, ID : 0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:28,442 - INFO - ================================================================================
2025-05-13 12:33:28,442 - INFO - STARTING TEST : test_svc_in_network_datapath
2025-05-13 12:33:28,714 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.254': '0'}} with
2025-05-13 12:33:28,714 - INFO - Initial checks done. Running the testcase now
2025-05-13 12:33:28,714 - INFO -
2025-05-13 12:33:29,398 - DEBUG - Response for create_network : {'network': {'id': '54d0890b-941b-4f36-b525-062a493f29b6', 'name': 'ctest-mgmt_vn-16276582', 'tenant_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'project_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-38568322', 'ctest-mgmt_vn-16276582'], 'port_security_enabled': True, 'description': ''}}
2025-05-13 12:33:29,633 - DEBUG - Response for create_subnet : {'subnet': {'id': '3492e24f-71cc-4e08-9991-5b9ef43315d9', 'name': '', 'tenant_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'network_id': '54d0890b-941b-4f36-b525-062a493f29b6', 'ip_version': 4, 'cidr': '122.106.15.0/26', 'allocation_pools': [{'start': '122.106.15.2', 'end': '122.106.15.62'}], 'gateway_ip': '122.106.15.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '122.106.15.2', 'tags': [], 'project_id': '0c2cda30445f4979a7ea6c95a845fa9f'}}
2025-05-13 12:33:29,663 - INFO - Created VN ctest-mgmt_vn-16276582
2025-05-13 12:33:29,719 - DEBUG - VN ctest-mgmt_vn-16276582 UUID is 54d0890b-941b-4f36-b525-062a493f29b6
2025-05-13 12:33:29,848 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:30,198 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:30,237 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:30,254 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:30,338 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54d0890b-941b-4f36-b525-062a493f29b6
2025-05-13 12:33:30,356 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54d0890b-941b-4f36-b525-062a493f29b6
2025-05-13 12:33:30,368 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d8875925-0682-459b-9dcb-5d11237c6fd0
2025-05-13 12:33:30,379 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d8875925-0682-459b-9dcb-5d11237c6fd0
2025-05-13 12:33:30,391 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/f4f06e9d-ebca-457b-8985-2911a9e10b9e
2025-05-13 12:33:30,402 - DEBUG - Route Targets: ['target:64512:8000005']
2025-05-13 12:33:30,402 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54d0890b-941b-4f36-b525-062a493f29b6
2025-05-13 12:33:30,415 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d8875925-0682-459b-9dcb-5d11237c6fd0
2025-05-13 12:33:30,435 - INFO - Verified VN network id 7 for VN 54d0890b-941b-4f36-b525-062a493f29b6
2025-05-13 12:33:30,435 - INFO - Verifications in API Server for VN ctest-mgmt_vn-16276582 passed
2025-05-13 12:33:30,435 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54d0890b-941b-4f36-b525-062a493f29b6
2025-05-13 12:33:30,448 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d8875925-0682-459b-9dcb-5d11237c6fd0
2025-05-13 12:33:30,458 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d8875925-0682-459b-9dcb-5d11237c6fd0
2025-05-13 12:33:30,468 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/f4f06e9d-ebca-457b-8985-2911a9e10b9e
2025-05-13 12:33:30,485 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-38568322:ctest-mgmt_vn-16276582', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-38568322', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6111535377164226358', 'uuid-lslong': '13052845873690519990'}, 'enable': 'true', 'created': '2025-05-13T12:33:29', 'last-modified': '2025-05-13T12:33:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.896224'}
2025-05-13 12:33:30,494 - DEBUG - Route Targets: ['target:64512:8000005']
2025-05-13 12:33:30,494 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-16276582 passed
2025-05-13 12:33:30,494 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-16276582 in API_Server ======
2025-05-13 12:33:30,494 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:30,502 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:30,517 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:30,604 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54d0890b-941b-4f36-b525-062a493f29b6
2025-05-13 12:33:30,616 - DEBUG - =>VN ctest-mgmt_vn-16276582 has no policy to be verified
2025-05-13 12:33:30,616 - DEBUG - Verifying the vn in opserver
2025-05-13 12:33:30,617 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-38568322:ctest-mgmt_vn-16276582 virtual network link through opserver 10.0.0.33
2025-05-13 12:33:30,617 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2025-05-13 12:33:30,965 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2025-05-13 12:33:31,107 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-38568322:ctest-mgmt_vn-16276582', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-38568322:ctest-mgmt_vn-16276582?flat'}
2025-05-13 12:33:31,107 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-38568322:ctest-mgmt_vn-16276582 is found in opserver
2025-05-13 12:33:31,124 - DEBUG - Do not have enough data to verify VN in agent
2025-05-13 12:33:31,133 - DEBUG - VRF ids for VN ctest-mgmt_vn-16276582: {}
2025-05-13 12:33:31,485 - DEBUG - Response for create_network : {'network': {'id': 'ca06547b-6a32-456b-abfd-a5d0938c95ae', 'name': 'ctest-left_vn-94791192', 'tenant_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'project_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-38568322', 'ctest-left_vn-94791192'], 'port_security_enabled': True, 'description': ''}}
2025-05-13 12:33:31,695 - DEBUG - Response for create_subnet : {'subnet': {'id': '81d7a1ce-e993-4b6a-a3d6-26c62653dcbf', 'name': '', 'tenant_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'network_id': 'ca06547b-6a32-456b-abfd-a5d0938c95ae', 'ip_version': 4, 'cidr': '186.22.246.64/26', 'allocation_pools': [{'start': '186.22.246.66', 'end': '186.22.246.126'}], 'gateway_ip': '186.22.246.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '186.22.246.66', 'tags': [], 'project_id': '0c2cda30445f4979a7ea6c95a845fa9f'}}
2025-05-13 12:33:31,724 - INFO - Created VN ctest-left_vn-94791192
2025-05-13 12:33:31,783 - DEBUG - VN ctest-left_vn-94791192 UUID is ca06547b-6a32-456b-abfd-a5d0938c95ae
2025-05-13 12:33:31,915 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:31,925 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:31,944 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:32,037 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ca06547b-6a32-456b-abfd-a5d0938c95ae
2025-05-13 12:33:32,055 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ca06547b-6a32-456b-abfd-a5d0938c95ae
2025-05-13 12:33:32,069 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/338c2dd9-8917-447c-b883-17c4ad8d888a
2025-05-13 12:33:32,080 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/338c2dd9-8917-447c-b883-17c4ad8d888a
2025-05-13 12:33:32,090 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/0945765f-3ded-46e7-8ee4-d2b5fe322761
2025-05-13 12:33:32,102 - DEBUG - Route Targets: ['target:64512:8000006']
2025-05-13 12:33:32,102 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ca06547b-6a32-456b-abfd-a5d0938c95ae
2025-05-13 12:33:32,116 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/338c2dd9-8917-447c-b883-17c4ad8d888a
2025-05-13 12:33:32,140 - INFO - Verified VN network id 8 for VN ca06547b-6a32-456b-abfd-a5d0938c95ae
2025-05-13 12:33:32,140 - INFO - Verifications in API Server for VN ctest-left_vn-94791192 passed
2025-05-13 12:33:32,140 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ca06547b-6a32-456b-abfd-a5d0938c95ae
2025-05-13 12:33:32,154 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/338c2dd9-8917-447c-b883-17c4ad8d888a
2025-05-13 12:33:32,164 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/338c2dd9-8917-447c-b883-17c4ad8d888a
2025-05-13 12:33:32,174 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/0945765f-3ded-46e7-8ee4-d2b5fe322761
2025-05-13 12:33:32,191 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-38568322:ctest-left_vn-94791192', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-38568322', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14557415734561097067', 'uuid-lslong': '12393244064840717742'}, 'enable': 'true', 'created': '2025-05-13T12:33:31', 'last-modified': '2025-05-13T12:33:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.539556'}
2025-05-13 12:33:32,199 - DEBUG - Route Targets: ['target:64512:8000006']
2025-05-13 12:33:32,199 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-94791192 passed
2025-05-13 12:33:32,199 - DEBUG - ====Verifying policy data for ctest-left_vn-94791192 in API_Server ======
2025-05-13 12:33:32,199 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:32,208 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:32,225 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:32,310 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ca06547b-6a32-456b-abfd-a5d0938c95ae
2025-05-13 12:33:32,322 - DEBUG - =>VN ctest-left_vn-94791192 has no policy to be verified
2025-05-13 12:33:32,322 - DEBUG - Verifying the vn in opserver
2025-05-13 12:33:32,322 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-38568322:ctest-left_vn-94791192 virtual network link through opserver 10.0.0.33
2025-05-13 12:33:32,322 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2025-05-13 12:33:32,336 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-38568322:ctest-left_vn-94791192', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-38568322:ctest-left_vn-94791192?flat'}
2025-05-13 12:33:32,336 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-38568322:ctest-left_vn-94791192 is found in opserver
2025-05-13 12:33:32,350 - DEBUG - Do not have enough data to verify VN in agent
2025-05-13 12:33:32,357 - DEBUG - VRF ids for VN ctest-left_vn-94791192: {}
2025-05-13 12:33:32,599 - DEBUG - Response for create_network : {'network': {'id': '3914702c-c268-4cfe-8446-644747c7f027', 'name': 'ctest-right_vn-89672040', 'tenant_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'project_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-38568322', 'ctest-right_vn-89672040'], 'port_security_enabled': True, 'description': ''}}
2025-05-13 12:33:32,789 - DEBUG - Response for create_subnet : {'subnet': {'id': '0520ea75-3a24-4fff-a8a9-d86145352fd2', 'name': '', 'tenant_id': '0c2cda30445f4979a7ea6c95a845fa9f', 'network_id': '3914702c-c268-4cfe-8446-644747c7f027', 'ip_version': 4, 'cidr': '157.104.240.128/26', 'allocation_pools': [{'start': '157.104.240.130', 'end': '157.104.240.190'}], 'gateway_ip': '157.104.240.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '157.104.240.130', 'tags': [], 'project_id': '0c2cda30445f4979a7ea6c95a845fa9f'}}
2025-05-13 12:33:32,815 - INFO - Created VN ctest-right_vn-89672040
2025-05-13 12:33:32,871 - DEBUG - VN ctest-right_vn-89672040 UUID is 3914702c-c268-4cfe-8446-644747c7f027
2025-05-13 12:33:32,999 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:33,007 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:33,024 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:33,108 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3914702c-c268-4cfe-8446-644747c7f027
2025-05-13 12:33:33,122 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3914702c-c268-4cfe-8446-644747c7f027
2025-05-13 12:33:33,136 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d0e855d-a997-4a97-8712-ce9164b2dca9
2025-05-13 12:33:33,147 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d0e855d-a997-4a97-8712-ce9164b2dca9
2025-05-13 12:33:33,158 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/6535c7b3-1254-4b06-b36b-c7209172c682
2025-05-13 12:33:33,169 - DEBUG - Route Targets: ['target:64512:8000007']
2025-05-13 12:33:33,169 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3914702c-c268-4cfe-8446-644747c7f027
2025-05-13 12:33:33,187 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d0e855d-a997-4a97-8712-ce9164b2dca9
2025-05-13 12:33:33,206 - INFO - Verified VN network id 9 for VN 3914702c-c268-4cfe-8446-644747c7f027
2025-05-13 12:33:33,206 - INFO - Verifications in API Server for VN ctest-right_vn-89672040 passed
2025-05-13 12:33:33,206 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3914702c-c268-4cfe-8446-644747c7f027
2025-05-13 12:33:33,219 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d0e855d-a997-4a97-8712-ce9164b2dca9
2025-05-13 12:33:33,230 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d0e855d-a997-4a97-8712-ce9164b2dca9
2025-05-13 12:33:33,240 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/6535c7b3-1254-4b06-b36b-c7209172c682
2025-05-13 12:33:33,257 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-38568322:ctest-right_vn-89672040', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-38568322', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4113035697238592766', 'uuid-lslong': '9531415918685974567'}, 'enable': 'true', 'created': '2025-05-13T12:33:32', 'last-modified': '2025-05-13T12:33:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.515568'}
2025-05-13 12:33:33,266 - DEBUG - Route Targets: ['target:64512:8000007']
2025-05-13 12:33:33,267 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-89672040 passed
2025-05-13 12:33:33,267 - DEBUG - ====Verifying policy data for ctest-right_vn-89672040 in API_Server ======
2025-05-13 12:33:33,267 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:33,275 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:33,292 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:33,376 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3914702c-c268-4cfe-8446-644747c7f027
2025-05-13 12:33:33,389 - DEBUG - =>VN ctest-right_vn-89672040 has no policy to be verified
2025-05-13 12:33:33,389 - DEBUG - Verifying the vn in opserver
2025-05-13 12:33:33,390 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-38568322:ctest-right_vn-89672040 virtual network link through opserver 10.0.0.33
2025-05-13 12:33:33,390 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2025-05-13 12:33:33,406 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-38568322:ctest-right_vn-89672040', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-38568322:ctest-right_vn-89672040?flat'}
2025-05-13 12:33:33,406 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-38568322:ctest-right_vn-89672040 is found in opserver
2025-05-13 12:33:33,420 - DEBUG - Do not have enough data to verify VN in agent
2025-05-13 12:33:33,428 - DEBUG - VRF ids for VN ctest-right_vn-89672040: {}
2025-05-13 12:33:33,566 - DEBUG - Services list from nova: [<Service: 1>, <Service: 1>, <Service: 2>]
2025-05-13 12:33:34,941 - INFO - VM ([<Server: ctest-left_vm-67656865>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3307-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3307-1)
2025-05-13 12:33:36,328 - INFO - VM ([<Server: ctest-right_vm-65366597>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3307-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3307-1)
2025-05-13 12:33:36,328 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-55169806']
2025-05-13 12:33:36,707 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-55169806'] created succesfully
2025-05-13 12:33:37,014 - DEBUG - Image by name cirros_in_net not found
2025-05-13 12:33:37,014 - DEBUG - Installing image cirros_in_net
2025-05-13 12:33:37,014 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-05-13 12:33:37,015 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz
2025-05-13 12:33:37,015 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz
2025-05-13 12:33:37,030 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz
2025-05-13 12:33:37,208 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz
2025-05-13 12:33:37,208 - DEBUG - Unzip image
2025-05-13 12:33:37,208 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz
2025-05-13 12:33:37,381 - DEBUG - Try to create image in user context
2025-05-13 12:33:37,652 - DEBUG - Image has been created in user context
2025-05-13 12:33:37,653 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk
2025-05-13 12:33:37,674 - DEBUG - Downloaded image has been removed
2025-05-13 12:33:37,692 - DEBUG - Uploaded image status = active
2025-05-13 12:33:38,988 - INFO - VM ([<Server: ctest-pt_svm0-68883411>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3307-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3307-1)
2025-05-13 12:33:38,988 - INFO - Waiting for VM ctest-pt_svm0-68883411 to be up..
2025-05-13 12:33:39,058 - DEBUG - VM <Server: ctest-pt_svm0-68883411> is in ERROR state now
2025-05-13 12:33:39,059 - ERROR - VM in error state.
2025-05-13 12:33:39,059 - ERROR - VM is not in ACTIVE state
2025-05-13 12:33:39,174 - ERROR - Fatal Nova Exception while getting VM detail
2025-05-13 12:33:39,175 - DEBUG - None
2025-05-13 12:33:39,179 - INFO - Skip interface_detach for VM ctest-pt_svm0-68883411 in state ERROR
2025-05-13 12:33:39,179 - INFO - Deleting VM ctest-pt_svm0-68883411
2025-05-13 12:33:39,205 - ERROR - VM ctest-pt_svm0-68883411 has failed to come up
2025-05-13 12:33:39,205 - ERROR - Fault seen in nova show <vm-uuid> is: {'code': 500, 'created': '2025-05-13T12:33:38Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2025-05-13 12:33:39,205 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-55169806']
2025-05-13 12:33:39,294 - INFO - Service template: ['default-domain', 'ctest-service_template_1-55169806'] deleted successfully.
2025-05-13 12:33:39,295 - INFO - Skip interface_detach for VM ctest-right_vm-65366597 in state BUILD
2025-05-13 12:33:39,295 - INFO - Deleting VM ctest-right_vm-65366597
2025-05-13 12:33:39,295 - ERROR - VM ctest-right_vm-65366597 has failed to come up
2025-05-13 12:33:39,295 - ERROR - Nova failed to get host of the VM
2025-05-13 12:33:39,522 - INFO - Skip interface_detach for VM ctest-left_vm-67656865 in state BUILD
2025-05-13 12:33:39,522 - INFO - Deleting VM ctest-left_vm-67656865
2025-05-13 12:33:39,522 - ERROR - VM ctest-left_vm-67656865 has failed to come up
2025-05-13 12:33:39,522 - ERROR - Nova failed to get host of the VM
2025-05-13 12:33:39,716 - INFO - Deleting VN ctest-right_vn-89672040
2025-05-13 12:33:39,850 - DEBUG - Response for deleting network ()
2025-05-13 12:33:39,850 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d0e855d-a997-4a97-8712-ce9164b2dca9
2025-05-13 12:33:39,857 - DEBUG - Response Code: 404
2025-05-13 12:33:39,857 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:39,865 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:39,892 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:39,974 - INFO - Validated that VN ctest-right_vn-89672040 is not found in API Server
2025-05-13 12:33:39,990 - DEBUG - VN ctest-right_vn-89672040 is not present in Agent 10.0.0.33
2025-05-13 12:33:39,990 - INFO - Validated that VN ctest-right_vn-89672040 is not in any agent
2025-05-13 12:33:40,017 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-89672040 info
2025-05-13 12:33:40,017 - INFO - Deleting VN ctest-left_vn-94791192
2025-05-13 12:33:40,152 - DEBUG - Response for deleting network ()
2025-05-13 12:33:40,152 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/338c2dd9-8917-447c-b883-17c4ad8d888a
2025-05-13 12:33:40,163 - DEBUG - Response Code: 404
2025-05-13 12:33:40,163 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:40,170 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:40,229 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:40,314 - INFO - Validated that VN ctest-left_vn-94791192 is not found in API Server
2025-05-13 12:33:40,328 - DEBUG - VN ctest-left_vn-94791192 is not present in Agent 10.0.0.33
2025-05-13 12:33:40,329 - INFO - Validated that VN ctest-left_vn-94791192 is not in any agent
2025-05-13 12:33:40,350 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-94791192 info
2025-05-13 12:33:40,350 - INFO - Deleting VN ctest-mgmt_vn-16276582
2025-05-13 12:33:40,483 - DEBUG - Response for deleting network ()
2025-05-13 12:33:40,484 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d8875925-0682-459b-9dcb-5d11237c6fd0
2025-05-13 12:33:40,492 - DEBUG - Response Code: 404
2025-05-13 12:33:40,493 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-05-13 12:33:40,502 - DEBUG - Requesting: http://10.0.0.33:8082/domain/d8647435-a91a-4a47-800f-d6024ca4dfb1
2025-05-13 12:33:40,561 - DEBUG - Requesting: http://10.0.0.33:8082/project/0c2cda30-445f-4979-a7ea-6c95a845fa9f
2025-05-13 12:33:40,643 - INFO - Validated that VN ctest-mgmt_vn-16276582 is not found in API Server
2025-05-13 12:33:40,657 - DEBUG - VN ctest-mgmt_vn-16276582 is not present in Agent 10.0.0.33
2025-05-13 12:33:40,657 - INFO - Validated that VN ctest-mgmt_vn-16276582 is not in any agent
2025-05-13 12:33:40,678 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-16276582 info
2025-05-13 12:33:40,935 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Tue May 13 12:33:39 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function = <function TestSvcRegr.test_svc_in_network_datapath>
self = <scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>
args = ()
kwargs = {}
/contrail-test/scripts/svc_firewall/test_svc_fw.py in test_svc_in_network_datapath(self=<scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>)
24 def test_svc_in_network_datapath(self):
25 return self.verify_svc_chain(svc_img_name='cirros_in_net', service_mode='in-network',
26 create_svms=True)
27
28
create_svms undefined
/contrail-test/common/servicechain/verify.py in verify_svc_chain(self=<scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>, *args=(), **kwargs={'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'})
318 def verify_svc_chain(self, *args, **kwargs):
319 svc_chain_info = kwargs.get('svc_chain_info')
320 ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
321 proto = kwargs.get('proto', 'any')
322 left_vn_fq_name = ret_dict.get('left_vn_fixture').vn_fq_name
ret_dict undefined
svc_chain_info = None
self = <scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>
self.config_svc_chain = <bound method ConfigSvcChain.config_svc_chain of...n_network_datapath[ci_sanity] id=0x7fba2a51d438>>
args = ()
kwargs = {'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'}
/contrail-test/common/servicechain/config.py in config_svc_chain(self=<scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>, service_mode='in-network', service_type='firewall', max_inst=1, proto='any', svc_chain_type='parallel', src_ports=[0, 65535], dst_ports=[0, 65535], svc_img_name='cirros_in_net', st_version=2, mgmt_vn_name='ctest-mgmt_vn-16276582', mgmt_vn_subnets=['122.106.15.0/26'], mgmt_vn_fixture=<vn_test.VNFixture object>, left_vn_name='ctest-left_vn-94791192', left_vn_subnets=['186.22.246.64/26'], left_vn_fixture=<vn_test.VNFixture object>, right_vn_name='ctest-right_vn-89672040', right_vn_subnets=['157.104.240.128/26'], right_vn_fixture=<vn_test.VNFixture object>, left_lr_child_vn_fixture=None, right_lr_child_vn_fixture=None, left_vm_name='ctest-left_vm-67656865', left_vm_fixture=<VMFixture: ctest-left_vm-67656865>, right_vm_name='ctest-right_vm-65366597', right_vm_fixture=<VMFixture: ctest-right_vm-65366597>, image_name='cirros', policy_fixture=None, st_fixture=<svc_template_fixture.SvcTemplateFixture object>, si_fixture=None, port_tuples_props=None, static_route=None, svm_fixtures=[], create_svms=True, evpn=False, modify_rules=False, policy_action='pass', hosts=[], **kwargs={})
531 service_type=service_type,
532 hosts=hosts,
533 max_inst=max_inst)
534 if svc_chain_type == 'serial':
535 svm_fixtures2 = self.create_service_vms(vns,
max_inst = 1
/contrail-test/common/servicechain/config.py in create_service_vms(self=<scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>, vns=[<vn_test.VNFixture object>, <vn_test.VNFixture object>, <vn_test.VNFixture object>], service_mode='in-network', max_inst=1, svc_img_name='cirros_in_net', service_type='firewall', hosts=[])
337 if service_type == 'analyzer':
338 svm_fixture.disable_interface_policy()
339 self.verify_vms(svm_fixtures)
340 return svm_fixtures
341 # end create_service_vms
self = <scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>
self.verify_vms = <bound method ConfigSvcChain.verify_vms of <scri...n_network_datapath[ci_sanity] id=0x7fba2a51d438>>
svm_fixtures = [<VMFixture: ctest-pt_svm0-68883411>]
/contrail-test/common/servicechain/config.py in verify_vms(self=<scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>, vm_fixtures=[<VMFixture: ctest-pt_svm0-68883411>])
169 def verify_vms(self, vm_fixtures):
170 for vm in vm_fixtures:
171 self.verify_vm(vm)
172 # end verify_vms
173
self = <scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>
self.verify_vm = <bound method ConfigSvcChain.verify_vm of <scrip...n_network_datapath[ci_sanity] id=0x7fba2a51d438>>
vm = <VMFixture: ctest-pt_svm0-68883411>
/contrail-test/common/servicechain/config.py in verify_vm(self=<scripts.svc_firewall.test_svc_fw.TestSvcRegr.te...in_network_datapath[ci_sanity] id=0x7fba2a51d438>, vm_fixture=<VMFixture: ctest-pt_svm0-68883411>)
173
174 def verify_vm(self, vm_fixture):
175 assert vm_fixture.wait_till_vm_is_up(), 'VM does not seem to be up'
176 # end verify_vm
177
vm_fixture = <VMFixture: ctest-pt_svm0-68883411>
vm_fixture.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-pt_svm0-68883411>>
AssertionError: VM does not seem to be up
__cause__ = None
__class__ = <class 'AssertionError'>
__context__ = None
__delattr__ = <method-wrapper '__delattr__' of AssertionError object>
__dict__ = {}
__dir__ = <built-in method __dir__ of AssertionError object>
__doc__ = 'Assertion failed.'
__eq__ = <method-wrapper '__eq__' of AssertionError object>
__format__ = <built-in method __format__ of AssertionError object>
__ge__ = <method-wrapper '__ge__' of AssertionError object>
__getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
__gt__ = <method-wrapper '__gt__' of AssertionError object>
__hash__ = <method-wrapper '__hash__' of AssertionError object>
__init__ = <method-wrapper '__init__' of AssertionError object>
__init_subclass__ = <built-in method __init_subclass__ of type object>
__le__ = <method-wrapper '__le__' of AssertionError object>
__lt__ = <method-wrapper '__lt__' of AssertionError object>
__ne__ = <method-wrapper '__ne__' of AssertionError object>
__new__ = <built-in method __new__ of type object>
__reduce__ = <built-in method __reduce__ of AssertionError object>
__reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
__repr__ = <method-wrapper '__repr__' of AssertionError object>
__setattr__ = <method-wrapper '__setattr__' of AssertionError object>
__setstate__ = <built-in method __setstate__ of AssertionError object>
__sizeof__ = <built-in method __sizeof__ of AssertionError object>
__str__ = <method-wrapper '__str__' of AssertionError object>
__subclasshook__ = <built-in method __subclasshook__ of type object>
__suppress_context__ = False
__traceback__ = <traceback object>
args = ('VM does not seem to be up',)
with_traceback = <built-in method with_traceback of AssertionError object>
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 26, in test_svc_in_network_datapath
create_svms=True)
File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
max_inst=max_inst)
File "/contrail-test/common/servicechain/config.py", line 339, in create_service_vms
self.verify_vms(svm_fixtures)
File "/contrail-test/common/servicechain/config.py", line 171, in verify_vms
self.verify_vm(vm)
File "/contrail-test/common/servicechain/config.py", line 175, in verify_vm
assert vm_fixture.wait_till_vm_is_up(), 'VM does not seem to be up'
AssertionError: VM does not seem to be up
2025-05-13 12:33:40,943 - DEBUG - No XMPP flaps were noticed during the test
2025-05-13 12:33:40,943 - INFO -
2025-05-13 12:33:40,943 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:00:12]
2025-05-13 12:33:40,943 - INFO - --------------------------------------------------------------------------------
2025-05-13 12:33:41,776 - INFO - Deleted project: ctest-TestSvcRegr-38568322, ID : 0c2cda30-445f-4979-a7ea-6c95a845fa9f