2026-01-26 04:05:58,646 - INFO - Domain Default found not creating 2026-01-26 04:05:58,838 - INFO - Project ctest-TestBasicVMVN0-02721824 not found, creating it 2026-01-26 04:05:59,415 - INFO - Created Project:ctest-TestBasicVMVN0-02721824, ID : b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:01,260 - INFO - ================================================================================ 2026-01-26 04:06:01,260 - INFO - STARTING TEST : test_control_node_switchover 2026-01-26 04:06:01,260 - INFO - TEST DESCRIPTION : Stop the control node and check peering with agent fallback to other control node. 1. Pick one VN from respource pool which has 2 VM's in it 2. Verify ping between VM's 3. Find active control node in cluster by agent inspect 4. Stop control service on active control node 5. Verify agents are connected to new active control-node using xmpp connections 6. Bring back control service on previous active node 7. Verify ping between VM's again after bringing up control serveice Pass criteria: Step 2,5 and 7 should pass 2026-01-26 04:06:02,570 - DEBUG - Skipping xmpp flap check 2026-01-26 04:06:02,570 - INFO - Initial checks done. Running the testcase now 2026-01-26 04:06:02,570 - INFO - 2026-01-26 04:06:03,289 - DEBUG - Response for create_network : {'network': {'id': 'dc642921-0c0e-4526-b5d7-f4784ef5dc6b', 'name': 'ctest-vn1-55889174', 'tenant_id': 'b1b668a2ea344879b84ffd634c75be58', 'project_id': 'b1b668a2ea344879b84ffd634c75be58', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN0-02721824', 'ctest-vn1-55889174'], 'port_security_enabled': True, 'description': ''}} 2026-01-26 04:06:03,559 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f3736798-2e5e-412b-8c67-8510bf42d24b', 'name': '', 'tenant_id': 'b1b668a2ea344879b84ffd634c75be58', 'network_id': 'dc642921-0c0e-4526-b5d7-f4784ef5dc6b', 'ip_version': 4, 'cidr': '192.168.1.0/24', 'allocation_pools': [{'start': '192.168.1.2', 'end': '192.168.1.254'}], 'gateway_ip': '192.168.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '192.168.1.2', 'tags': [], 'project_id': 'b1b668a2ea344879b84ffd634c75be58'}} 2026-01-26 04:06:03,589 - INFO - Created VN ctest-vn1-55889174 2026-01-26 04:06:03,607 - DEBUG - VN ctest-vn1-55889174 UUID is dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:03,681 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:03,985 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:04,017 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:04,035 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:04,129 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:04,141 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:04,151 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:04,158 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:04,166 - DEBUG - Route Targets: [] 2026-01-26 04:06:04,166 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:09,167 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:09,174 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:09,186 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:09,278 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:09,289 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:09,298 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:09,306 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:09,313 - DEBUG - Route Targets: [] 2026-01-26 04:06:09,313 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:14,313 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:14,321 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:14,333 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:14,426 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:14,435 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:14,448 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:14,456 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:14,463 - DEBUG - Route Targets: [] 2026-01-26 04:06:14,463 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:19,463 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:19,470 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:19,481 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:19,569 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:19,579 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:19,589 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:19,597 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:19,606 - DEBUG - Route Targets: [] 2026-01-26 04:06:19,606 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:24,607 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:24,619 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:24,633 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:24,729 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:24,741 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:24,753 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:24,763 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:24,778 - DEBUG - Route Targets: [] 2026-01-26 04:06:24,778 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:29,778 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:29,785 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:29,795 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:29,891 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:29,899 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:29,907 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:29,914 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:29,921 - DEBUG - Route Targets: [] 2026-01-26 04:06:29,921 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:34,921 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:34,930 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:34,943 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:35,033 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:35,043 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:35,053 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:35,060 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:35,067 - DEBUG - Route Targets: [] 2026-01-26 04:06:35,067 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:40,067 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:40,074 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:40,087 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:40,175 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:40,185 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:40,194 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:40,200 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:40,208 - DEBUG - Route Targets: [] 2026-01-26 04:06:40,208 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:45,209 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:45,218 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:45,231 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:45,323 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:45,334 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:45,346 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:45,357 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:45,368 - DEBUG - Route Targets: [] 2026-01-26 04:06:45,368 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:50,369 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:50,376 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:50,387 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:50,475 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:50,484 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:50,492 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:50,498 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:50,505 - DEBUG - Route Targets: [] 2026-01-26 04:06:50,505 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:55,506 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:55,514 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:55,526 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:55,615 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:55,626 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dc642921-0c0e-4526-b5d7-f4784ef5dc6b 2026-01-26 04:06:55,635 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:55,644 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6bfbded2-698f-4e4e-a18a-59e2172db6c3 2026-01-26 04:06:55,652 - DEBUG - Route Targets: [] 2026-01-26 04:06:55,652 - DEBUG - RT names not yet present for VN ctest-vn1-55889174 2026-01-26 04:06:55,652 - ERROR - One or more verifications in API Server for VN ctest-vn1-55889174 failed 2026-01-26 04:06:55,655 - INFO - Deleting VN ctest-vn1-55889174 2026-01-26 04:06:55,798 - DEBUG - Response for deleting network () 2026-01-26 04:06:57,082 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Jan 26 04:06:55 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_control_node_switchover(self=) 632 vn1_vm2_name = get_random_name('vn1_vm2') 633 vn1_fixture = self.create_vn(vn1_name, vn1_subnets) 634 assert vn1_fixture.verify_on_setup() 635 vm1_fixture = self.create_vm(vn1_fixture, vn1_vm1_name) 636 vm2_fixture = self.create_vm(vn1_fixture, vn1_vm2_name) vn1_fixture = vn1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 634, in test_control_node_switchover assert vn1_fixture.verify_on_setup() AssertionError 2026-01-26 04:06:57,082 - DEBUG - Skipping xmpp flap check 2026-01-26 04:06:57,082 - INFO -
2026-01-26 04:06:57,082 - INFO - END TEST : test_control_node_switchover : FAILED[0:00:56]
2026-01-26 04:06:57,083 - INFO - -------------------------------------------------------------------------------- 2026-01-26 04:06:57,085 - INFO - ================================================================================ 2026-01-26 04:06:57,085 - INFO - STARTING TEST : test_process_restart_in_policy_between_vns 2026-01-26 04:06:57,085 - INFO - TEST DESCRIPTION : Test to validate that with policy having rule to check icmp fwding between VMs on different VNs , ping between VMs should pass with process restarts 1. Pick 2 VN's from resource pool which has one VM each 2. Create policy with icmp allow rule between those VN's and bind it networks 3. Ping from one VM to another VM 4. Restart process 'vrouter' and 'control' on setup 5. Ping again between VM's after process restart Pass criteria: Step 2,3,4 and 5 should pass 2026-01-26 04:06:58,357 - DEBUG - Skipping xmpp flap check 2026-01-26 04:06:58,358 - INFO - Initial checks done. Running the testcase now 2026-01-26 04:06:58,358 - INFO - 2026-01-26 04:06:58,365 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-02721824:ctest-vn1-84238573, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-02721824:ctest-vn2-43302949, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-01-26 04:06:58,653 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-02721824:ctest-vn2-43302949, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-02721824:ctest-vn1-84238573, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-01-26 04:06:59,232 - INFO - Created VN ctest-vn1-84238573, UUID :d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:06:59,554 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:06:59,562 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:06:59,577 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:06:59,684 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:06:59,695 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:06:59,704 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:06:59,714 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:06:59,727 - DEBUG - Route Targets: [] 2026-01-26 04:06:59,727 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:04,727 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:04,734 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:04,747 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:04,839 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:04,850 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:04,858 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:04,866 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:04,873 - DEBUG - Route Targets: [] 2026-01-26 04:07:04,873 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:09,874 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:09,881 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:09,892 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:09,985 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:09,999 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:10,010 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:10,018 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:10,026 - DEBUG - Route Targets: [] 2026-01-26 04:07:10,026 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:15,026 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:15,034 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:15,045 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:15,138 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:15,151 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:15,162 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:15,170 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:15,177 - DEBUG - Route Targets: [] 2026-01-26 04:07:15,177 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:20,177 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:20,184 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:20,197 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:20,282 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:20,292 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:20,302 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:20,309 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:20,316 - DEBUG - Route Targets: [] 2026-01-26 04:07:20,316 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:25,317 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:25,325 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:25,338 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:25,439 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:25,451 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:25,460 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:25,467 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:25,475 - DEBUG - Route Targets: [] 2026-01-26 04:07:25,475 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:30,476 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:30,483 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:30,494 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:30,588 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:30,598 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:30,606 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:30,613 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:30,619 - DEBUG - Route Targets: [] 2026-01-26 04:07:30,619 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:35,619 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:35,627 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:35,639 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:35,727 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:35,744 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:35,753 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:35,761 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:35,767 - DEBUG - Route Targets: [] 2026-01-26 04:07:35,767 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:40,768 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:40,774 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:40,785 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:40,872 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:40,881 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:40,889 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:40,896 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:40,902 - DEBUG - Route Targets: [] 2026-01-26 04:07:40,902 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:45,902 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:45,909 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:45,920 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:46,028 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:46,043 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:46,058 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:46,066 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:46,073 - DEBUG - Route Targets: [] 2026-01-26 04:07:46,073 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:51,073 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:07:51,081 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:07:51,093 - DEBUG - Requesting: http://10.0.0.141:8082/project/b1b668a2-ea34-4879-b84f-fd634c75be58 2026-01-26 04:07:51,188 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:51,197 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0abef7d-4a09-4183-8594-05e5c379d0a5 2026-01-26 04:07:51,207 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:51,217 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2137f6e3-41f7-454e-a721-2e1ffcec9eb5 2026-01-26 04:07:51,224 - DEBUG - Route Targets: [] 2026-01-26 04:07:51,224 - DEBUG - RT names not yet present for VN ctest-vn1-84238573 2026-01-26 04:07:51,224 - ERROR - One or more verifications in API Server for VN ctest-vn1-84238573 failed 2026-01-26 04:07:51,226 - INFO - Deleting VN ctest-vn1-84238573 2026-01-26 04:07:51,395 - INFO - Deleted policy policy2 2026-01-26 04:07:51,438 - INFO - Deleted policy policy1 2026-01-26 04:07:52,714 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Jan 26 04:07:51 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_process_restart_in_policy_between_vns(self=) 389 connections=self.connections)) 390 vn1_fixture = self.create_vn(vn1_name, vn1_subnets, option='contrail') 391 assert vn1_fixture.verify_on_setup() 392 vn1_fixture.bind_policies( 393 [policy1_fixture.policy_fq_name], vn1_fixture.vn_id) vn1_fixture = vn1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 391, in test_process_restart_in_policy_between_vns assert vn1_fixture.verify_on_setup() AssertionError 2026-01-26 04:07:52,714 - DEBUG - Skipping xmpp flap check 2026-01-26 04:07:52,715 - INFO -
2026-01-26 04:07:52,715 - INFO - END TEST : test_process_restart_in_policy_between_vns : FAILED[0:00:55]
2026-01-26 04:07:52,715 - INFO - -------------------------------------------------------------------------------- 2026-01-26 04:07:52,719 - INFO - ================================================================================ 2026-01-26 04:07:52,719 - INFO - STARTING TEST : test_underlay_broadcast_traffic_handling 2026-01-26 04:07:52,719 - INFO - TEST DESCRIPTION : Test the underlay brocast traffic handling by vrouter. (Bug-1545229). 1. Send broadcast traffic from one compute node. 2. Other compute in same subnet should receive that traffic. 3. Receiving compute should treat this traffic as underlay. 4. Compute should not replicate the packet and send the copy back. Pass criteria: Step 3-4 should pass Maintainer : chhandak@juniper.net 2026-01-26 04:07:54,005 - DEBUG - Skipping xmpp flap check 2026-01-26 04:07:54,005 - INFO - Initial checks done. Running the testcase now 2026-01-26 04:07:54,006 - INFO - 2026-01-26 04:07:54,399 - INFO - Agent interface name: ens6 2026-01-26 04:07:54,481 - DEBUG - Executing command: sudo tcpdump -nni ens6 -U host 10.20.0.255 -w /tmp/ens6_ctest-random-01119998.pcap 2026-01-26 04:07:59,854 - INFO - Pinging broacast address 10.20.0.255 from compute 10.20.0.249 2026-01-26 04:08:14,149 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2026-01-26 04:08:16,291 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/ens6_ctest-random-01119998.pcap | grep -c length 2026-01-26 04:08:16,305 - DEBUG - STDOUT: 10 2026-01-26 04:08:16,305 - DEBUG - STDERR: reading from file /tmp/ens6_ctest-random-01119998.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-01-26 04:08:16,305 - INFO - 10 packets are found in tcpdump output as expected 2026-01-26 04:08:16,305 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2026-01-26 04:08:18,351 - INFO - Packet count matched: Compute 10.0.0.130 has receive only 10 packet from source IP 10.20.0.255. No duplicate packet seen 2026-01-26 04:08:19,626 - DEBUG - Skipping xmpp flap check
2026-01-26 04:08:19,626 - INFO - END TEST : test_underlay_broadcast_traffic_handling : PASSED[0:00:27]
2026-01-26 04:08:19,626 - INFO - -------------------------------------------------------------------------------- 2026-01-26 04:08:20,395 - INFO - Deleted project: ctest-TestBasicVMVN0-02721824, ID : b1b668a2-ea34-4879-b84f-fd634c75be58