is in ACTIVE state now
2025-12-08 04:24:47,306 - INFO - VM name : ctest-FatFlowAggrIpv6Serial-64755610-60288414
2025-12-08 04:24:47,395 - DEBUG - VM ctest-FatFlowAggrIpv6Serial-64755610-60288414 ID is 6270ecf4-55d3-4299-be7a-6f30f4827709
2025-12-08 04:24:47,396 - DEBUG - VM ctest-FatFlowAggrIpv6Serial-64755610-60288414 launched on Node an-jenkins-deploy-platform-ansible-os-4854-1
2025-12-08 04:24:47,494 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/6270ecf4-55d3-4299-be7a-6f30f4827709
2025-12-08 04:24:47,506 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/5b58c892-a8ff-4818-9b88-613aea3a1a6e
2025-12-08 04:24:47,644 - INFO - Deleting VM ctest-FatFlowAggrIpv6Serial-64755610-60288414
2025-12-08 04:24:47,731 - INFO - Detaching port 963a4598-4df1-4cc8-976e-5179729dce4a from VM client2_vm
2025-12-08 04:24:47,765 - INFO - Deleting VM client2_vm
2025-12-08 04:24:48,063 - INFO - Deleted port 963a4598-4df1-4cc8-976e-5179729dce4a
2025-12-08 04:24:48,064 - INFO - Deleting VM ctest-FatFlowAggrIpv6Serial-64755610-17547342
2025-12-08 04:24:48,160 - INFO - Deleting VN ctest-vn-77229109
2025-12-08 04:24:48,217 - DEBUG - VN 330ef124-3fd6-4790-b3e6-4e482707f26a still in use: Unable to complete operation on network 330ef124-3fd6-4790-b3e6-4e482707f26a. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-421a6151-988c-4d0f-b150-5ef850932eb5']
2025-12-08 04:24:48,217 - WARNING - Deleting VN ctest-vn-77229109 failed..Will retry
2025-12-08 04:24:50,384 - DEBUG - Response for deleting network ()
2025-12-08 04:24:50,384 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/f9ff95d6-263b-4857-9c56-5ad4a789d748
2025-12-08 04:24:50,390 - DEBUG - Response Code: 404
2025-12-08 04:24:50,390 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-12-08 04:24:50,397 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8
2025-12-08 04:24:50,411 - DEBUG - Requesting: http://10.0.0.23:8082/project/deb9dcc8-556d-4b8e-91d5-363342be3413
2025-12-08 04:24:50,530 - INFO - Validated that VN ctest-vn-77229109 is not found in API Server
2025-12-08 04:24:50,541 - DEBUG - VN ctest-vn-77229109 is not present in Agent 10.0.0.41
2025-12-08 04:24:50,551 - DEBUG - VN ctest-vn-77229109 is not present in Agent 10.0.0.129
2025-12-08 04:24:50,551 - INFO - Validated that VN ctest-vn-77229109 is not in any agent
2025-12-08 04:24:50,580 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-77229109 info
2025-12-08 04:24:50,581 - INFO - Deleting VN ctest-vn-11044596
2025-12-08 04:24:50,743 - DEBUG - Response for deleting network ()
2025-12-08 04:24:50,744 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/81acfee6-edd9-4198-ac20-eabb5d1ba91c
2025-12-08 04:24:50,750 - DEBUG - Response Code: 404
2025-12-08 04:24:50,750 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-12-08 04:24:50,757 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8
2025-12-08 04:24:50,770 - DEBUG - Requesting: http://10.0.0.23:8082/project/deb9dcc8-556d-4b8e-91d5-363342be3413
2025-12-08 04:24:50,864 - INFO - Validated that VN ctest-vn-11044596 is not found in API Server
2025-12-08 04:24:50,875 - DEBUG - VN ctest-vn-11044596 is not present in Agent 10.0.0.41
2025-12-08 04:24:50,885 - DEBUG - VN ctest-vn-11044596 is not present in Agent 10.0.0.129
2025-12-08 04:24:50,885 - INFO - Validated that VN ctest-vn-11044596 is not in any agent
2025-12-08 04:24:50,915 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-11044596 info
2025-12-08 04:24:52,727 - ERROR - Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 58, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node
self.fat_flow_with_prefix_aggr(prefix_length=prefix_length,
File "/contrail-test/common/vrouter/base.py", line 424, in fat_flow_with_prefix_aggr
assert server.wait_till_vm_is_up()
File "/contrail-test/fixtures/vm_test.py", line 2328, in wait_till_vm_is_up
status = self.wait_till_vm_up()
File "/contrail-test/fixtures/vm_test.py", line 2370, in wait_till_vm_up
result = result and self._gather_details()
File "/contrail-test/fixtures/vm_test.py", line 2776, in _gather_details
self.get_local_ip(refresh=True)
File "/contrail-test/fixtures/vm_test.py", line 939, in get_local_ip
if self.ping_vm_from_host(vn_fq_name):
File "/contrail-test/tcutils/util.py", line 84, in f_retry
result = f(*args, **kwargs) # first attempt
File "/contrail-test/fixtures/vm_test.py", line 1193, in ping_vm_from_host
output = safe_run('ping %s -c 2 -W %s' %
File "/contrail-test/tcutils/util.py", line 84, in f_retry
result = f(*args, **kwargs) # first attempt
File "/contrail-test/tcutils/util.py", line 205, in safe_run
output = run(cmd, timeout=timeout)
File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1092, in run
return _run_command(
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command
channel=default_channel(), command=wrapped_command, pty=pty,
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel
chan = _open_session()
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session
session = transport.open_session(timeout=env.timeout)
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session
return self.open_channel(
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1050, in open_channel
raise e
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 2109, in run
ptype, m = self.packetizer.read_message()
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 459, in read_message
header = self.read_all(self.__block_size_in, check_rekey=True)
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 301, in read_all
x = self.__socket.recv(n)
File "/usr/local/lib64/python3.9/site-packages/gevent/_socketcommon.py", line 660, in recv
return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer
2025-12-08 04:24:52,728 - DEBUG - Skipping xmpp flap check
2025-12-08 04:24:52,728 - INFO -
2025-12-08 04:24:52,728 - INFO - END TEST : test_fat_flow_aggr_dest_udp_inter_vn_inter_node : FAILED[0:02:41]
2025-12-08 04:24:52,728 - INFO - --------------------------------------------------------------------------------
2025-12-08 04:24:53,983 - ERROR - TestFailed
Python 3.9.21: /usr/bin/python3
Mon Dec 8 04:24:52 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py in test_fat_flow_aggr_dest_udp_inter_vn_inter_node(self=)
91
92 """
93 self.inputs.set_af('dual')
94 super(FatFlowAggrIpv6Serial, self).test_fat_flow_aggr_dest_udp_inter_vn_inter_node()
95
builtinsuper =
global FatFlowAggrIpv6Serial =
self =
).test_fat_flow_aggr_dest_udp_inter_vn_inter_node = >
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
174 if 'ci_image' in list(os.environ.keys()):
175 os.environ['stop_execution_flag'] = 'set'
176 raise TestFailed("\n ".join(errmsg))
177 elif testskip:
178 log.info('')
global TestFailed =
"\n ".join undefined
errmsg = ['Test failed: Traceback (most recent call la...ror: [Errno 104] Connection reset by peer\n
\n']
TestFailed: Test failed: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 58, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node
self.fat_flow_with_prefix_aggr(prefix_length=prefix_length,
File "/contrail-test/common/vrouter/base.py", line 424, in fat_flow_with_prefix_aggr
assert server.wait_till_vm_is_up()
File "/contrail-test/fixtures/vm_test.py", line 2328, in wait_till_vm_is_up
status = self.wait_till_vm_up()
File "/contrail-test/fixtures/vm_test.py", line 2370, in wait_till_vm_up
result = result and self._gather_details()
File "/contrail-test/fixtures/vm_test.py", line 2776, in _gather_details
self.get_local_ip(refresh=True)
File "/contrail-test/fixtures/vm_test.py", line 939, in get_local_ip
if self.ping_vm_from_host(vn_fq_name):
File "/contrail-test/tcutils/util.py", line 84, in f_retry
result = f(*args, **kwargs) # first attempt
File "/contrail-test/fixtures/vm_test.py", line 1193, in ping_vm_from_host
output = safe_run('ping %s -c 2 -W %s' %
File "/contrail-test/tcutils/util.py", line 84, in f_retry
result = f(*args, **kwargs) # first attempt
File "/contrail-test/tcutils/util.py", line 205, in safe_run
output = run(cmd, timeout=timeout)
File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1092, in run
return _run_command(
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command
channel=default_channel(), command=wrapped_command, pty=pty,
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel
chan = _open_session()
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session
session = transport.open_session(timeout=env.timeout)
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session
return self.open_channel(
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1050, in open_channel
raise e
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 2109, in run
ptype, m = self.packetizer.read_message()
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 459, in read_message
header = self.read_all(self.__block_size_in, check_rekey=True)
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 301, in read_all
x = self.__socket.recv(n)
File "/usr/local/lib64/python3.9/site-packages/gevent/_socketcommon.py", line 660, in recv
return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = None
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__module__ = 'tcutils.cores'
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
__weakref__ = None
args = ('Test failed: Traceback (most recent call la...ror: [Errno 104] Connection reset by peer\n
\n',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 94, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node
super(FatFlowAggrIpv6Serial, self).test_fat_flow_aggr_dest_udp_inter_vn_inter_node()
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 58, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node
self.fat_flow_with_prefix_aggr(prefix_length=prefix_length,
File "/contrail-test/common/vrouter/base.py", line 424, in fat_flow_with_prefix_aggr
assert server.wait_till_vm_is_up()
File "/contrail-test/fixtures/vm_test.py", line 2328, in wait_till_vm_is_up
status = self.wait_till_vm_up()
File "/contrail-test/fixtures/vm_test.py", line 2370, in wait_till_vm_up
result = result and self._gather_details()
File "/contrail-test/fixtures/vm_test.py", line 2776, in _gather_details
self.get_local_ip(refresh=True)
File "/contrail-test/fixtures/vm_test.py", line 939, in get_local_ip
if self.ping_vm_from_host(vn_fq_name):
File "/contrail-test/tcutils/util.py", line 84, in f_retry
result = f(*args, **kwargs) # first attempt
File "/contrail-test/fixtures/vm_test.py", line 1193, in ping_vm_from_host
output = safe_run('ping %s -c 2 -W %s' %
File "/contrail-test/tcutils/util.py", line 84, in f_retry
result = f(*args, **kwargs) # first attempt
File "/contrail-test/tcutils/util.py", line 205, in safe_run
output = run(cmd, timeout=timeout)
File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1092, in run
return _run_command(
File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command
channel=default_channel(), command=wrapped_command, pty=pty,
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel
chan = _open_session()
File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session
session = transport.open_session(timeout=env.timeout)
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session
return self.open_channel(
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1050, in open_channel
raise e
File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 2109, in run
ptype, m = self.packetizer.read_message()
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 459, in read_message
header = self.read_all(self.__block_size_in, check_rekey=True)
File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 301, in read_all
x = self.__socket.recv(n)
File "/usr/local/lib64/python3.9/site-packages/gevent/_socketcommon.py", line 660, in recv
return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer
2025-12-08 04:24:53,984 - DEBUG - Skipping xmpp flap check
2025-12-08 04:24:53,984 - INFO -
2025-12-08 04:24:53,984 - INFO - END TEST : test_fat_flow_aggr_dest_udp_inter_vn_inter_node : FAILED[0:02:44]
2025-12-08 04:24:53,984 - INFO - --------------------------------------------------------------------------------
2025-12-08 04:24:54,787 - INFO - Deleted project: ctest-FatFlowAggrIpv6Serial-64755610, ID : deb9dcc8-556d-4b8e-91d5-363342be3413