2026-03-27 21:28:30,669 - DEBUG - [10.0.0.249]: Running cmd : hostname 2026-03-27 21:28:31,432 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5557-1 2026-03-27 21:28:31,433 - DEBUG - [10.0.0.249]: Running cmd : hostname -f 2026-03-27 21:28:31,518 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5557-1. 2026-03-27 21:28:31,518 - DEBUG - [10.0.0.249]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2026-03-27 21:28:31,646 - DEBUG - Output : NAMES contrail_test_inOjKztmo vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_control_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_nodemgr_1 config_api_1 config_schema_1 config_dnsmasq_1 config_svcmonitor_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_api_cfn heat_api nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb mariadb_clustercheck cron kolla_toolbox fluentd 2026-03-27 21:28:31,647 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.0.0.249 | head -n 1 | awk '{print $2}' 2026-03-27 21:28:31,760 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5557-1. 2026-03-27 21:28:31,760 - DEBUG - [10.0.0.249]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2026-03-27 21:28:31,830 - DEBUG - Output : 127.0.0.1/8 10.0.0.249/24 172.17.0.1/16 10.20.0.17/24 2026-03-27 21:28:31,830 - DEBUG - [10.0.0.249]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2026-03-27 21:28:31,904 - DEBUG - Output : 10.20.0.17/24 2026-03-27 21:28:31,904 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}' 2026-03-27 21:28:31,980 - DEBUG - Output : 2026-03-27 21:28:33,025 - DEBUG - Not creating keypair since it exists 2026-03-27 21:28:33,140 - INFO - Domain Default found not creating 2026-03-27 21:28:33,770 - INFO - Project ctest-TestRbac-98660915 not found, creating it 2026-03-27 21:28:34,603 - INFO - Created Project:ctest-TestRbac-98660915, ID : 96a65716-1254-4242-8184-51d84ef9b21d 2026-03-27 21:28:36,634 - DEBUG - [10.0.0.249]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2026-03-27 21:28:36,899 - DEBUG - Output : rbac 2026-03-27 21:28:39,413 - INFO - ================================================================================ 2026-03-27 21:28:39,413 - INFO - STARTING TEST : test_perms2_global_share 2026-03-27 21:28:39,413 - INFO - TEST DESCRIPTION : Test perms2 global shared property of an object steps: 1. Add user1 as role1 in project1 and project2 2. Add *.* role1:CRUD to domain acl 3. Create a Shared virtual-network in project1 4. Verify global shared flag is set on VN's perms2 4. Using shared VN try to launch a VM in project2 2026-03-27 21:28:39,559 - DEBUG - Skipping xmpp flap check 2026-03-27 21:28:39,560 - DEBUG - Requesting: http://10.0.0.249:8082/aaa-mode 2026-03-27 21:28:39,898 - DEBUG - Requesting: http://10.0.0.249:8082/aaa-mode 2026-03-27 21:28:39,952 - INFO - Initial checks done. Running the testcase now 2026-03-27 21:28:39,952 - INFO - 2026-03-27 21:28:40,363 - INFO - Project ctest-TestRbac-52911499 not found, creating it 2026-03-27 21:28:40,895 - INFO - Created Project:ctest-TestRbac-52911499, ID : 3656d310-a9e3-473b-a697-43ae527960d9 2026-03-27 21:28:41,321 - INFO - Project ctest-TestRbac-83816821 not found, creating it 2026-03-27 21:28:41,970 - INFO - Created Project:ctest-TestRbac-83816821, ID : 70f039e5-8a92-41c3-87e4-c2495050d6ed 2026-03-27 21:28:44,174 - DEBUG - Requesting: http://10.0.0.249:8082/api-access-list/e7d0a2c0-a31e-4230-84a3-3a5f805e0279 2026-03-27 21:28:44,551 - DEBUG - Requesting: http://10.0.0.249:8082/api-access-list/e7d0a2c0-a31e-4230-84a3-3a5f805e0279 2026-03-27 21:28:44,622 - DEBUG - API access-list (e7d0a2c0-a31e-4230-84a3-3a5f805e0279) found in api server 2026-03-27 21:28:44,622 - INFO - API access-list e7d0a2c0-a31e-4230-84a3-3a5f805e0279 verify on api server passed 2026-03-27 21:28:45,318 - INFO - Created VN ctest-TestRbac-52911499-37680183, UUID :829b6dcd-64ed-490f-80a1-8ab1589816c9 2026-03-27 21:28:45,596 - DEBUG - Requesting: http://10.0.0.249:8082/api-access-list/e7d0a2c0-a31e-4230-84a3-3a5f805e0279 2026-03-27 21:28:45,605 - DEBUG - Response Code: 404 2026-03-27 21:28:45,606 - INFO - API access-list (e7d0a2c0-a31e-4230-84a3-3a5f805e0279) got deleted in api server 2026-03-27 21:28:46,758 - INFO - Deleted project: ctest-TestRbac-83816821, ID : 70f039e5-8a92-41c3-87e4-c2495050d6ed 2026-03-27 21:28:46,882 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:28:49,034 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:28:51,199 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:28:53,370 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:28:55,518 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:28:57,654 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:28:59,807 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:01,959 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:04,142 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:06,323 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:08,467 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:10,607 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:12,730 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:14,915 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:17,050 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:19,218 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:21,334 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:23,474 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:25,623 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:27,796 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:29,998 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:32,154 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:34,290 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:36,426 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:38,587 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:40,734 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:42,882 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:45,014 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:47,167 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:49,311 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:51,487 - WARNING - Project ctest-TestRbac-52911499 still has VNs [{'to': ['default-domain', 'ctest-TestRbac-52911499', 'ctest-TestRbac-52911499-37680183'], 'uuid': '829b6dcd-64ed-490f-80a1-8ab1589816c9', 'href': 'http://10.0.0.249:8082/virtual-network/829b6dcd-64ed-490f-80a1-8ab1589816c9'}] before deletion 2026-03-27 21:29:51,487 - WARNING - One or more references still present, will not delete the project ctest-TestRbac-52911499 2026-03-27 21:29:51,661 - ERROR - ConnectFailure Python 3.9.25: /usr/bin/python3 Fri Mar 27 21:28:45 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/rbac/test_rbac.py in test_perms2_global_share(self=) 48 }] 49 domain_rbac = self.create_rbac_acl(rules=rules, parent_type='domain') 50 vn = self.create_vn(connections=u1_p1_conn, shared=True, verify=False) 51 assert vn, 'VN creation failed' 52 obj = self.read_vn(connections=u1_p1_conn, uuid=vn.uuid) vn undefined self = self.create_vn = > connections undefined u1_p1_conn = shared undefined verify undefined /contrail-test/serial_scripts/rbac/base.py in create_vn(self=, connections=, verify=False, option='contrail', **kwargs={'shared': True}) 214 def create_vn(self, connections=None, verify=True, option='contrail', **kwargs): 215 connections = connections or self.connections 216 vn_fixture = self.create_fixture(VNFixture, connections=connections, 217 option=option, **kwargs) 218 if vn_fixture and verify: vn_fixture undefined self = self.create_fixture = > global VNFixture = connections = option = 'contrail' kwargs = {'shared': True} /contrail-test/serial_scripts/rbac/base.py in create_fixture(self=, fixturecls=, **kwargs={'connections': , 'option': 'contrail', 'shared': True}) 352 def create_fixture(self, fixturecls, **kwargs): 353 try: 354 return self.useFixture(fixturecls(**kwargs)) 355 except (PermissionDenied, neutron_forbidden): 356 return None self = self.useFixture = > fixturecls = kwargs = {'connections': , 'option': 'contrail', 'shared': True} /usr/local/lib/python3.9/site-packages/testtools/testcase.py in useFixture(self=, fixture=) 754 # Gather_details worked, so raise the exception setUp 755 # encountered. 756 reraise(*exc_info) 757 else: 758 self.addCleanup(fixture.cleanUp) global reraise = exc_info = (, ConnectFailure("Unable to establish connection t...w connection: [Errno 111] Connection refused'))"), ) /usr/local/lib/python3.9/site-packages/testtools/_compat3x.py in reraise(exc_class=, exc_obj=ConnectFailure("Unable to establish connection t...w connection: [Errno 111] Connection refused'))"), exc_tb=, _marker=) 13 14 def reraise(exc_class, exc_obj, exc_tb, _marker=object()): 15 """Re-raise an exception received from sys.exc_info() or similar.""" 16 raise exc_obj.with_traceback(exc_tb) 17 exc_obj = ConnectFailure("Unable to establish connection t...w connection: [Errno 111] Connection refused'))") exc_obj.with_traceback = exc_tb = /usr/local/lib/python3.9/site-packages/testtools/testcase.py in useFixture(self=, fixture=) 729 """ 730 try: 731 fixture.setUp() 732 except MultipleExceptions as e: 733 if (fixtures is not None and fixture = fixture.setUp = > /contrail-test/fixtures/vn_test.py in setUp(self=) 437 def setUp(self): 438 super(VNFixture, self).setUp() 439 self.create() 440 441 def create(self): self = self.create = > /contrail-test/fixtures/vn_test.py in create(self=) 448 self.webui.create_vn(self) 449 elif (self.option == 'contrail'): 450 self._create_vn_api(self.vn_name, self.project_obj) 451 else: 452 self._create_vn_orch() self = self._create_vn_api = > self.vn_name = 'ctest-TestRbac-52911499-37680183' self.project_obj = /contrail-test/fixtures/vn_test.py in _create_vn_api(self=, vn_name='ctest-TestRbac-52911499-37680183', project_obj=) 425 self.logger.info('Permission denied to create/update VirtualNetwork') 426 raise 427 self.obj = self._orch_call('get_vn_obj_from_id', self.uuid) 428 if self.obj is None: 429 raise ValueError('could not find %s in orchestrator' % (self.vn_name)) self = self.obj = None self._orch_call = > self.uuid = '829b6dcd-64ed-490f-80a1-8ab1589816c9' /contrail-test/fixtures/vn_test.py in _orch_call(self=, method='get_vn_obj_from_id', *args=('829b6dcd-64ed-490f-80a1-8ab1589816c9',), **kwargs={}) 155 def _orch_call(self, method, *args, **kwargs): 156 if self.orchestrator: 157 return getattr(self.orchestrator, method)(*args, **kwargs) 158 else: 159 return getattr(self.vnc_lib_fixture, method)(*args, **kwargs) builtingetattr = self = self.orchestrator = method = 'get_vn_obj_from_id' args = ('829b6dcd-64ed-490f-80a1-8ab1589816c9',) kwargs = {} /contrail-test/fixtures/openstack.py in get_vn_obj_from_id(self=, vn_id='829b6dcd-64ed-490f-80a1-8ab1589816c9') 185 186 def get_vn_obj_from_id(self, vn_id): 187 return self.quantum_h.get_vn_obj_from_id(vn_id) 188 189 def get_vn_list(self, **kwargs): self = self.quantum_h = self.quantum_h.get_vn_obj_from_id = > vn_id = '829b6dcd-64ed-490f-80a1-8ab1589816c9' /contrail-test/fixtures/quantum_test.py in get_vn_obj_from_id(self=, uuid='829b6dcd-64ed-490f-80a1-8ab1589816c9') 286 def get_vn_obj_from_id(self, uuid): 287 try: 288 return self.obj.show_network(network=uuid) 289 except CommonNetworkClientException as e: 290 self.logger.exception( self = self.obj = self.obj.show_network = > network undefined uuid = '829b6dcd-64ed-490f-80a1-8ab1589816c9' /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in show_network(self=, network='829b6dcd-64ed-490f-80a1-8ab1589816c9', **_params={}) 820 def show_network(self, network, **_params): 821 """Fetches information of a certain network.""" 822 return self.get(self.network_path % (network), params=_params) 823 824 def create_network(self, body=None): self = self.get = > self.network_path = '/networks/%s' network = '829b6dcd-64ed-490f-80a1-8ab1589816c9' params undefined _params = {} /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in get(self=, action='/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', body=None, headers=None, params={}) 351 352 def get(self, action, body=None, headers=None, params=None): 353 return self.retry_request("GET", action, body=body, 354 headers=headers, params=params) 355 self = self.retry_request = > action = '/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9' body = None headers = None params = {} /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in retry_request(self=, method='GET', action='/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', body=None, headers=None, params={}) 328 for i in range(max_attempts): 329 try: 330 return self.do_request(method, action, body=body, 331 headers=headers, params=params) 332 except (exceptions.ConnectionFailed, ksa_exc.ConnectionError): self = self.do_request = > method = 'GET' action = '/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9' body = None headers = None params = {} /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in do_request(self=, method='GET', action='/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', body=None, headers=None, params={}) 279 body = self.serialize(body) 280 281 resp, replybody = self.httpclient.do_request(action, method, body=body, 282 headers=headers) 283 resp undefined replybody undefined self = self.httpclient = self.httpclient.do_request = > action = '/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9' method = 'GET' body = None headers = None /usr/local/lib/python3.9/site-packages/neutronclient/client.py in do_request(self=, url='/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', method='GET', **kwargs={'authenticated': True, 'body': None, 'headers': None}) 338 kwargs.setdefault('authenticated', True) 339 self._check_uri_length(url) 340 return self.request(url, method, **kwargs) 341 342 @property self = self.request = > url = '/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9' method = 'GET' kwargs = {'authenticated': True, 'body': None, 'headers': None} /usr/local/lib/python3.9/site-packages/neutronclient/client.py in request(self=, *args=('/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', 'GET'), **kwargs={'authenticated': True, 'data': None, 'headers': {'Accept': 'application/json', 'User-Agent': 'python-neutronclient', 'X-Auth-Token': 'gAAAAABpxvaK_kI-aPYKD_omN6GxgEm-5lTw4L-sj7PhvVGF...sMdX9abd1td6MSsb3pcLp8l6KDPHVH2NqA1Y1Ta3OH8tvzhVY'}, 'raise_exc': False}) 326 327 kwargs['headers'] = headers 328 resp = super(SessionClient, self).request(*args, **kwargs) 329 return resp, resp.text 330 resp undefined builtinsuper = global SessionClient = self = ).request = > args = ('/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', 'GET') kwargs = {'authenticated': True, 'data': None, 'headers': {'Accept': 'application/json', 'User-Agent': 'python-neutronclient', 'X-Auth-Token': 'gAAAAABpxvaK_kI-aPYKD_omN6GxgEm-5lTw4L-sj7PhvVGF...sMdX9abd1td6MSsb3pcLp8l6KDPHVH2NqA1Y1Ta3OH8tvzhVY'}, 'raise_exc': False} /usr/local/lib/python3.9/site-packages/keystoneauth1/adapter.py in request(self=, url='/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', method='GET', **kwargs={'authenticated': True, 'data': None, 'endpoint_filter': {'interface': 'public', 'region_name': 'RegionOne', 'service_type': 'network'}, 'headers': {'Accept': 'application/json', 'User-Agent': 'python-neutronclient', 'X-Auth-Token': 'gAAAAABpxvaK_kI-aPYKD_omN6GxgEm-5lTw4L-sj7PhvVGF...sMdX9abd1td6MSsb3pcLp8l6KDPHVH2NqA1Y1Ta3OH8tvzhVY'}, 'raise_exc': False, 'rate_semaphore': , 'user_agent': 'python-neutronclient'}) 246 kwargs.setdefault('raise_exc', self.raise_exc) 247 248 return self.session.request(url, method, **kwargs) 249 250 def get_token(self, auth=None): self = self.session = self.session.request = > url = '/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9' method = 'GET' kwargs = {'authenticated': True, 'data': None, 'endpoint_filter': {'interface': 'public', 'region_name': 'RegionOne', 'service_type': 'network'}, 'headers': {'Accept': 'application/json', 'User-Agent': 'python-neutronclient', 'X-Auth-Token': 'gAAAAABpxvaK_kI-aPYKD_omN6GxgEm-5lTw4L-sj7PhvVGF...sMdX9abd1td6MSsb3pcLp8l6KDPHVH2NqA1Y1Ta3OH8tvzhVY'}, 'raise_exc': False, 'rate_semaphore': , 'user_agent': 'python-neutronclient'} /usr/local/lib/python3.9/site-packages/keystoneauth1/session.py in request(self=, url='http://10.0.0.249:9696/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', method='GET', json=None, original_ip=None, user_agent='python-neutronclient', redirect=30, authenticated=True, endpoint_filter={'interface': 'public', 'region_name': 'RegionOne', 'service_type': 'network'}, auth=None, requests_auth=None, raise_exc=False, allow_reauth=True, log=True, endpoint_override=None, connect_retries=0, logger=, allow=None, client_name=None, client_version=None, microversion=None, microversion_service_type=None, status_code_retries=0, retriable_status_codes=[503], rate_semaphore=, global_request_id=None, connect_retry_delay=None, status_code_retry_delay=None, **kwargs={'allow_redirects': False, 'cert': (None, None), 'data': None, 'headers': {'Accept': 'application/json', 'User-Agent': 'python-neutronclient', 'X-Auth-Token': 'gAAAAABpxvaK_kI-aPYKD_omN6GxgEm-5lTw4L-sj7PhvVGF...sMdX9abd1td6MSsb3pcLp8l6KDPHVH2NqA1Y1Ta3OH8tvzhVY'}, 'verify': False}) 911 kwargs.update(connection_params) 912 913 resp = send(**kwargs) 914 915 # log callee and caller request-id for each api call resp undefined send = functools.partial() kwargs = {'allow_redirects': False, 'cert': (None, None), 'data': None, 'headers': {'Accept': 'application/json', 'User-Agent': 'python-neutronclient', 'X-Auth-Token': 'gAAAAABpxvaK_kI-aPYKD_omN6GxgEm-5lTw4L-sj7PhvVGF...sMdX9abd1td6MSsb3pcLp8l6KDPHVH2NqA1Y1Ta3OH8tvzhVY'}, 'verify': False} /usr/local/lib/python3.9/site-packages/keystoneauth1/session.py in _send_request(self=, url='http://10.0.0.249:9696/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9', method='GET', redirect=30, log=True, logger=, split_loggers=None, connect_retries=0, status_code_retries=0, retriable_status_codes=[503], rate_semaphore=, connect_retry_delays=, status_code_retry_delays=, **kwargs={'allow_redirects': False, 'cert': (None, None), 'data': None, 'headers': {'Accept': 'application/json', 'User-Agent': 'python-neutronclient', 'X-Auth-Token': 'gAAAAABpxvaK_kI-aPYKD_omN6GxgEm-5lTw4L-sj7PhvVGF...sMdX9abd1td6MSsb3pcLp8l6KDPHVH2NqA1Y1Ta3OH8tvzhVY'}, 'verify': False}) 1018 # and firewall blocking. 1019 msg = 'Unable to establish connection to %s: %s' % (url, e) 1020 raise exceptions.ConnectFailure(msg) 1021 except requests.exceptions.RequestException as e: 1022 msg = 'Unexpected exception for %(url)s: %(error)s' % { global exceptions = exceptions.ConnectFailure = msg = "Unable to establish connection to http://10.0.0....new connection: [Errno 111] Connection refused'))" ConnectFailure: Unable to establish connection to http://10.0.0.249:9696/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9: HTTPConnectionPool(host='10.0.0.249', port=9696): Max retries exceeded with url: /v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) __cause__ = None __class__ = __context__ = ConnectionError(MaxRetryError("HTTPConnectionPoo... connection: [Errno 111] Connection refused'))")) __delattr__ = __dict__ = {'message': "Unable to establish connection to http://10.0.0....new connection: [Errno 111] Connection refused'))"} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'keystoneauth1.exceptions.connection' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ("Unable to establish connection to http://10.0.0....new connection: [Errno 111] Connection refused'))",) message = "Unable to establish connection to http://10.0.0....new connection: [Errno 111] Connection refused'))" with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 159, in _new_conn conn = connection.create_connection( File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 84, in create_connection raise err File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 74, in create_connection sock.connect(sa) File "/usr/local/lib64/python3.9/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/usr/local/lib64/python3.9/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 670, in urlopen httplib_response = self._make_request( File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 392, in _make_request conn.request(method, url, **httplib_request_kw) File "/usr/lib64/python3.9/http/client.py", line 1285, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1331, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1280, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1040, in _send_output self.send(msg) File "/usr/lib64/python3.9/http/client.py", line 980, in send self.connect() File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 187, in connect conn = self._new_conn() File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 171, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 439, in send resp = conn.urlopen( File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 726, in urlopen retries = retries.increment( File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 446, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='10.0.0.249', port=9696): Max retries exceeded with url: /v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/keystoneauth1/session.py", line 1004, in _send_request resp = self.session.request(method, url, **kwargs) File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 533, in request resp = self.send(prep, **send_kwargs) File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 646, in send r = adapter.send(request, **kwargs) File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 516, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='10.0.0.249', port=9696): Max retries exceeded with url: /v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/rbac/test_rbac.py", line 50, in test_perms2_global_share vn = self.create_vn(connections=u1_p1_conn, shared=True, verify=False) File "/contrail-test/serial_scripts/rbac/base.py", line 216, in create_vn vn_fixture = self.create_fixture(VNFixture, connections=connections, File "/contrail-test/serial_scripts/rbac/base.py", line 354, in create_fixture return self.useFixture(fixturecls(**kwargs)) File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 756, in useFixture reraise(*exc_info) File "/usr/local/lib/python3.9/site-packages/testtools/_compat3x.py", line 16, in reraise raise exc_obj.with_traceback(exc_tb) File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 731, in useFixture fixture.setUp() File "/contrail-test/fixtures/vn_test.py", line 439, in setUp self.create() File "/contrail-test/fixtures/vn_test.py", line 450, in create self._create_vn_api(self.vn_name, self.project_obj) File "/contrail-test/fixtures/vn_test.py", line 427, in _create_vn_api self.obj = self._orch_call('get_vn_obj_from_id', self.uuid) File "/contrail-test/fixtures/vn_test.py", line 157, in _orch_call return getattr(self.orchestrator, method)(*args, **kwargs) File "/contrail-test/fixtures/openstack.py", line 187, in get_vn_obj_from_id return self.quantum_h.get_vn_obj_from_id(vn_id) File "/contrail-test/fixtures/quantum_test.py", line 288, in get_vn_obj_from_id return self.obj.show_network(network=uuid) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 822, in show_network return self.get(self.network_path % (network), params=_params) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get return self.retry_request("GET", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request return self.do_request(method, action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 281, in do_request resp, replybody = self.httpclient.do_request(action, method, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/client.py", line 340, in do_request return self.request(url, method, **kwargs) File "/usr/local/lib/python3.9/site-packages/neutronclient/client.py", line 328, in request resp = super(SessionClient, self).request(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 248, in request return self.session.request(url, method, **kwargs) File "/usr/local/lib/python3.9/site-packages/keystoneauth1/session.py", line 913, in request resp = send(**kwargs) File "/usr/local/lib/python3.9/site-packages/keystoneauth1/session.py", line 1020, in _send_request raise exceptions.ConnectFailure(msg) keystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to http://10.0.0.249:9696/v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9: HTTPConnectionPool(host='10.0.0.249', port=9696): Max retries exceeded with url: /v2.0/networks/829b6dcd-64ed-490f-80a1-8ab1589816c9 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) 2026-03-27 21:29:51,664 - DEBUG - Skipping xmpp flap check 2026-03-27 21:29:51,664 - INFO -
2026-03-27 21:29:51,664 - INFO - END TEST : test_perms2_global_share : FAILED[0:01:12]
2026-03-27 21:29:51,664 - INFO - -------------------------------------------------------------------------------- 2026-03-27 21:29:53,481 - INFO - Deleted project: ctest-TestRbac-98660915, ID : 96a65716-1254-4242-8184-51d84ef9b21d 2026-03-27 21:29:56,241 - DEBUG - [10.0.0.249]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2026-03-27 21:29:56,408 - DEBUG - Output : rbac 2026-03-27 21:29:58,887 - DEBUG - Requesting: http://10.0.0.249:8082/aaa-mode 2026-03-27 21:31:10,786 - DEBUG - Requesting: http://10.0.0.249:8082/aaa-mode 2026-03-27 21:32:22,126 - DEBUG - [10.0.0.249]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2026-03-27 21:32:22,244 - DEBUG - Output : contrail_test_inOjKztmo vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_provisioner_1 control_control_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_nodemgr_1 config_api_1 config_schema_1 config_dnsmasq_1 config_provisioner_1 config_svcmonitor_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_api_cfn heat_api nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb mariadb_clustercheck cron kolla_toolbox fluentd