Test Results

Designed for use with JUnit and Ant.

Properties


Summary

TestsFailuresErrorsSkippedSuccess rateTime
2740482.61%493.993
Note: failures are anticipated and checked for with assertions while errors are unanticipated.

Packages

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.
NameTestsErrorsFailuresSkippedTime(s)
27044493.993

Package

NameTestsErrorsFailuresSkippedTime(s)
20041405.746
700388.247
Back to top


TestCase

NameStatusTypeTime(s)LogFile
test_contrail_status[cb_sanity,ci_sanity,dev_sanity_dpdk,sanity]Success0.555
test_verify_object_logs[ci_sanity,dev_sanity_dpdk,sanity,suite1]Success23.624
test_db_manage[cb_sanity,ci_sanity,dev_sanity_dpdk,sanity]Success4.718
test_floating_ip[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,sanity,suite1,vrouter_gw]Success24.069
test_heat_stacks_list[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity]Success0.665
test_router_crud[ci_sanity,dev_sanity_dpdk,sanity]Success5.794
test_ports_bindings[ci_sanity,dev_sanity_dpdk,sanity]Success2.343
test_ports_specific_subnet_ip[ci_sanity,dev_sanity_dpdk,sanity]Success23.625
test_basic_router_behavior[ci_sanity,dev_sanity_dpdk,sanity]Success38.426
test_basic_snat_behavior_without_external_connectivity[ci_sanity,dev_sanity_dpdk,sanity,suite1]Success25.285
test_basic_policy_allow_deny[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,sanity,suite1]SkippedDisabling v6 tests for CI5.237
test_remove_policy_with_ref[ci_sanity,sanity]Success4.342
test_basic_policy_allow_deny[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,sanity,suite1]Success29.456
test_rp_interface[ci_sanity,sanity]Success23.920
test_svc_in_network_datapath[ci_sanity]Success74.027
test_vdns_ping_same_vn[ci_sanity,sanity,suite1]Success51.860
test_vm_file_trf_scp_tests[ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,vrouter_gw]FailureDetails

Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
File "/contrail-test/tcutils/util.py", line 1041, in wrapper
return f(self, *func_args, **func_kwargs)
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: AssertionError
Python 3.9.21: /usr/bin/python3
Thu Aug 28 16:51:56 2025

A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.

/contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.vm_regression.test_vm.TestBasicVMVNx.te...anity,quick_sanity,vrouter_gw] id=0x7f84d5757520>, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function = <function TestBasicVMVNx.test_vm_file_trf_scp_tests>
self = <scripts.vm_regression.test_vm.TestBasicVMVNx.te...anity,quick_sanity,vrouter_gw] id=0x7f84d5757520>
args = ()
kwargs = {}

/contrail-test/scripts/vm_regression/test_vm.py in test_vm_file_trf_scp_tests(self=<scripts.vm_regression.test_vm.TestBasicVMVNx.te...anity,quick_sanity,vrouter_gw] id=0x7f84d5757520>)
2865 vm2_fixture = self.create_vm(vn_fixture=vn_fixture,
2866 image_name='ubuntu-sshpass')
2867 assert vm1_fixture.wait_till_vm_is_up()
2868 assert vm2_fixture.wait_till_vm_is_up()
2869 for size in scp_test_file_sizes:
vm1_fixture = <VMFixture: ctest-TestBasicVMVNx-77327315-07520752>
vm1_fixture.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-TestBasicVMVNx-77327315-07520752>>
AssertionError:
__cause__ = None
__class__ = <class 'AssertionError'>
__context__ = None
__delattr__ = <method-wrapper '__delattr__' of AssertionError object>
__dict__ = {}
__dir__ = <built-in method __dir__ of AssertionError object>
__doc__ = 'Assertion failed.'
__eq__ = <method-wrapper '__eq__' of AssertionError object>
__format__ = <built-in method __format__ of AssertionError object>
__ge__ = <method-wrapper '__ge__' of AssertionError object>
__getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
__gt__ = <method-wrapper '__gt__' of AssertionError object>
__hash__ = <method-wrapper '__hash__' of AssertionError object>
__init__ = <method-wrapper '__init__' of AssertionError object>
__init_subclass__ = <built-in method __init_subclass__ of type object>
__le__ = <method-wrapper '__le__' of AssertionError object>
__lt__ = <method-wrapper '__lt__' of AssertionError object>
__ne__ = <method-wrapper '__ne__' of AssertionError object>
__new__ = <built-in method __new__ of type object>
__reduce__ = <built-in method __reduce__ of AssertionError object>
__reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
__repr__ = <method-wrapper '__repr__' of AssertionError object>
__setattr__ = <method-wrapper '__setattr__' of AssertionError object>
__setstate__ = <built-in method __setstate__ of AssertionError object>
__sizeof__ = <built-in method __sizeof__ of AssertionError object>
__str__ = <method-wrapper '__str__' of AssertionError object>
__subclasshook__ = <built-in method __subclasshook__ of type object>
__suppress_context__ = False
__traceback__ = <traceback object>
args = ()
with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program. Here is
the original traceback:

Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm.py", line 2867, in test_vm_file_trf_scp_tests
assert vm1_fixture.wait_till_vm_is_up()
AssertionError

4.337 Log File
test_generic_link_local_service[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,dev_sanity_dpdk,sanity,suite1]FailureDetails

Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: <pre>Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 290, in test_generic_link_local_service
compute_user = self.inputs.host_data[vm1_fixture.vm_node_ip]['username']
File "/contrail-test/fixtures/vm_test.py", line 386, in vm_node_ip
self.get_host_of_vm(refresh=True))
File "/contrail-test/fixtures/vm_test.py", line 400, in get_host_of_vm
assert self.wait_till_vm_is_active()
AssertionError
</pre>

3.107 Log File
test_metadata_service[cb_sanity,ci_sanity,sanity,suite1]FailureDetails

Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: AssertionError
Python 3.9.21: /usr/bin/python3
Thu Aug 28 16:52:05 2025

A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.

/contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f84d57577c0>, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function = <function TestBasicVMVN.test_metadata_service>
self = <scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f84d57577c0>
args = ()
kwargs = {}

/contrail-test/scripts/vm_regression/test_vm_basic.py in test_metadata_service(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f84d57577c0>)
55 image_name='cirros',
56 userdata='/tmp/metadata_script.txt')
57 assert vm1_fixture.wait_till_vm_is_up()
58
59 cmd = 'cat /tmp/output.txt'
vm1_fixture = <VMFixture: ctest-TestBasicVMVN-15249564-53111775>
vm1_fixture.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-TestBasicVMVN-15249564-53111775>>
AssertionError:
__cause__ = None
__class__ = <class 'AssertionError'>
__context__ = None
__delattr__ = <method-wrapper '__delattr__' of AssertionError object>
__dict__ = {}
__dir__ = <built-in method __dir__ of AssertionError object>
__doc__ = 'Assertion failed.'
__eq__ = <method-wrapper '__eq__' of AssertionError object>
__format__ = <built-in method __format__ of AssertionError object>
__ge__ = <method-wrapper '__ge__' of AssertionError object>
__getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
__gt__ = <method-wrapper '__gt__' of AssertionError object>
__hash__ = <method-wrapper '__hash__' of AssertionError object>
__init__ = <method-wrapper '__init__' of AssertionError object>
__init_subclass__ = <built-in method __init_subclass__ of type object>
__le__ = <method-wrapper '__le__' of AssertionError object>
__lt__ = <method-wrapper '__lt__' of AssertionError object>
__ne__ = <method-wrapper '__ne__' of AssertionError object>
__new__ = <built-in method __new__ of type object>
__reduce__ = <built-in method __reduce__ of AssertionError object>
__reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
__repr__ = <method-wrapper '__repr__' of AssertionError object>
__setattr__ = <method-wrapper '__setattr__' of AssertionError object>
__setstate__ = <built-in method __setstate__ of AssertionError object>
__sizeof__ = <built-in method __sizeof__ of AssertionError object>
__str__ = <method-wrapper '__str__' of AssertionError object>
__subclasshook__ = <built-in method __subclasshook__ of type object>
__suppress_context__ = False
__traceback__ = <traceback object>
args = ()
with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program. Here is
the original traceback:

Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 57, in test_metadata_service
assert vm1_fixture.wait_till_vm_is_up()
AssertionError

2.792 Log File
test_ping_within_vn_two_vms_two_different_subnets[ci_contrail_go_kolla_ocata_sanity,ci_sanity,sanity,suite1]FailureDetails

Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: AssertionError
Python 3.9.21: /usr/bin/python3
Thu Aug 28 16:52:10 2025

A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.

/contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f84d5757be0>, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function = <function TestBasicVMVN.test_ping_within_vn_two_vms_two_different_subnets>
self = <scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f84d5757be0>
args = ()
kwargs = {}

/contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f84d5757be0>)
145 assert ipam_obj.verify_on_setup()
146 assert vn1_fixture.verify_on_setup()
147 assert vm1.wait_till_vm_is_up()
148 assert vm2.wait_till_vm_is_up()
149 assert vm3.wait_till_vm_is_up()
vm1 = <VMFixture: ctest-TestBasicVMVN-15249564-04878155>
vm1.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-TestBasicVMVN-15249564-04878155>>
AssertionError:
__cause__ = None
__class__ = <class 'AssertionError'>
__context__ = None
__delattr__ = <method-wrapper '__delattr__' of AssertionError object>
__dict__ = {}
__dir__ = <built-in method __dir__ of AssertionError object>
__doc__ = 'Assertion failed.'
__eq__ = <method-wrapper '__eq__' of AssertionError object>
__format__ = <built-in method __format__ of AssertionError object>
__ge__ = <method-wrapper '__ge__' of AssertionError object>
__getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
__gt__ = <method-wrapper '__gt__' of AssertionError object>
__hash__ = <method-wrapper '__hash__' of AssertionError object>
__init__ = <method-wrapper '__init__' of AssertionError object>
__init_subclass__ = <built-in method __init_subclass__ of type object>
__le__ = <method-wrapper '__le__' of AssertionError object>
__lt__ = <method-wrapper '__lt__' of AssertionError object>
__ne__ = <method-wrapper '__ne__' of AssertionError object>
__new__ = <built-in method __new__ of type object>
__reduce__ = <built-in method __reduce__ of AssertionError object>
__reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
__repr__ = <method-wrapper '__repr__' of AssertionError object>
__setattr__ = <method-wrapper '__setattr__' of AssertionError object>
__setstate__ = <built-in method __setstate__ of AssertionError object>
__sizeof__ = <built-in method __sizeof__ of AssertionError object>
__str__ = <method-wrapper '__str__' of AssertionError object>
__subclasshook__ = <built-in method __subclasshook__ of type object>
__suppress_context__ = False
__traceback__ = <traceback object>
args = ()
with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program. Here is
the original traceback:

Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 147, in test_ping_within_vn_two_vms_two_different_subnets
assert vm1.wait_till_vm_is_up()
AssertionError

5.942 Log File
Properties »

Back to top

TestCase

NameStatusTypeTime(s)LogFile
test_perms2_global_share[ci_sanity,sanity]Success48.490
test_perms2_owner[ci_sanity,sanity,suite1]Success8.722
test_rbac_acl_different_roles[ci_sanity,sanity,suite1]Success9.788
test_contrail_status[cb_sanity,ci_sanity,dev_sanity_dpdk,sanity]Success0.421
test_communication_between_two_sriov_vm[ci_sanity]SkippedSkipped as test is not supported if sriov_cluster=False 0.003
test_communication_between_two_sriov_vm_with_large_mtu[ci_sanity]SkippedSkipped as test is not supported if sriov_cluster=False 0.002
test_virtual_function_exhaustion_and_resue[ci_sanity]SkippedSkipped as test is not supported if sriov_cluster=False 0.002
Properties »

Back to top