2025-07-23 18:12:52,764 - INFO - Domain Default found not creating 2025-07-23 18:12:52,899 - INFO - Project ctest-FatFlowAggrIpv6Serial-36699524 not found, creating it 2025-07-23 18:12:53,481 - INFO - Created Project:ctest-FatFlowAggrIpv6Serial-36699524, ID : c8b4b2ea-3306-4be8-9ab7-744fde37cae3 2025-07-23 18:12:54,879 - INFO - ================================================================================ 2025-07-23 18:12:54,879 - INFO - STARTING TEST : test_fat_flow_aggr_dest_udp_inter_vn_inter_node 2025-07-23 18:12:54,879 - INFO - TEST DESCRIPTION : Description: Verify fat flow prefix aggr dest (IPv6) for intra-vn inter-node Steps: 1. Create 2 VNs with IPv6 subnets and launch 3 VMs.2 client VMs in VN1 on same node and server VM in VN2 on different node. Client 1 in subnet 1, Client 2 in the next subnet. Policy p1 configured to allow udp traffic between VN1 and VN2. 2. On server VM, config fat flow aggr prefix dest IPv6 len 125 for UDP port 55. 3. From both the client VMs, send ICMP6 traffic to the server VM twice with diff. src ports Pass criteria: 1. On the remote CN, expect 2 pairs ( 1 for client 1, 1 for client 2) of IPv6 fat flows with prefix aggregated for the src IPs (VM to fabric, Prefix Aggr Dest: Aggregation happens for SRC IPs) 2. On client VM compute nodes, expect 4 pairs of IPv6 flows and on server compute, expect 2 pairs of IPv6 flows 3. On server compute node, flow's source port should be 0 for fat flows Maintainer: Ankitja@juniper.net 2025-07-23 18:12:56,211 - DEBUG - Skipping xmpp flap check 2025-07-23 18:12:56,211 - INFO - Initial checks done. Running the testcase now 2025-07-23 18:12:56,211 - INFO - 2025-07-23 18:12:56,211 - INFO - ================================================================================ 2025-07-23 18:12:56,211 - INFO - STARTING TEST : test_fat_flow_aggr_dest_udp_inter_vn_inter_node 2025-07-23 18:12:56,211 - INFO - TEST DESCRIPTION : : Description: Verify fat flow prefix aggr dest (IPv4) for intra-vn inter-node Steps: 1. Create 2 VNs and launch 3 VMs.2 client VMs in VN1 on same node and server VM in VN2 on different node. Client 1 in subnet 1, Client 2 in the next subnet. Policy p1 configured to allow udp traffic between VN1 and VN2. 2. On server VM, config fat flow aggr prefix dest len 29 for UDP port 55. 3. From both the client VMs, send ICMP traffic to the server VM twice with diff. src ports Pass criteria: 1. On the remote CN, expect 2 pairs ( 1 for client 1, 1 for client 2) of fat flows with prefix aggregated for the src IPs (VM to fabric, Prefix Aggr Dest: Aggregation happens for SRC IPs) 2. On client VM compute nodes, expect 4 pairs of flows and on server compute, expect 2 pairs of flows 3. On server compute node, flow's source port should be 0 for fat flows Maintainer: Ankitja@juniper.net 2025-07-23 18:12:57,509 - DEBUG - Skipping xmpp flap check 2025-07-23 18:12:57,509 - INFO - Initial checks done. Running the testcase now 2025-07-23 18:12:57,509 - INFO - 2025-07-23 18:12:57,533 - DEBUG - Services list from nova: [, , , ] 2025-07-23 18:12:57,533 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3704-2', 'an-jenkins-deploy-platform-ansible-os-3704-1']} 2025-07-23 18:12:58,223 - DEBUG - Response for create_network : {'network': {'id': 'db173507-a3d5-4fa6-9653-46774d95b311', 'name': 'ctest-vn-55327471', 'tenant_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'project_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowAggrIpv6Serial-36699524', 'ctest-vn-55327471'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 18:12:58,466 - DEBUG - Response for create_subnet : {'subnet': {'id': '27abefaf-049e-4df0-9b7a-fee376ef0b2b', 'name': '', 'tenant_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'network_id': 'db173507-a3d5-4fa6-9653-46774d95b311', 'ip_version': 4, 'cidr': '139.186.38.0/26', 'allocation_pools': [{'start': '139.186.38.2', 'end': '139.186.38.62'}], 'gateway_ip': '139.186.38.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.186.38.2', 'tags': [], 'project_id': 'c8b4b2ea33064be89ab7744fde37cae3'}} 2025-07-23 18:12:58,666 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e68d9d63-d770-4dd0-9a8b-042b1842e07d', 'name': '', 'tenant_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'network_id': 'db173507-a3d5-4fa6-9653-46774d95b311', 'ip_version': 6, 'cidr': '2c01:24a1:dfe8:9f9d:ed08:9a1f::/96', 'allocation_pools': [{'start': '2c01:24a1:dfe8:9f9d:ed08:9a1f:0:2', 'end': '2c01:24a1:dfe8:9f9d:ed08:9a1f:ffff:fffe'}], 'gateway_ip': '2c01:24a1:dfe8:9f9d:ed08:9a1f:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2c01:24a1:dfe8:9f9d:ed08:9a1f:0:2', 'tags': [], 'project_id': 'c8b4b2ea33064be89ab7744fde37cae3'}} 2025-07-23 18:12:58,690 - INFO - Created VN ctest-vn-55327471 2025-07-23 18:12:58,705 - DEBUG - VN ctest-vn-55327471 UUID is db173507-a3d5-4fa6-9653-46774d95b311 2025-07-23 18:12:59,086 - DEBUG - Response for create_network : {'network': {'id': '2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09', 'name': 'ctest-vn-69433243', 'tenant_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'project_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowAggrIpv6Serial-36699524', 'ctest-vn-69433243'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 18:12:59,300 - DEBUG - Response for create_subnet : {'subnet': {'id': '580a6699-c46e-43d3-9c53-f115346c11a8', 'name': '', 'tenant_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'network_id': '2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09', 'ip_version': 4, 'cidr': '151.136.19.0/26', 'allocation_pools': [{'start': '151.136.19.2', 'end': '151.136.19.62'}], 'gateway_ip': '151.136.19.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '151.136.19.2', 'tags': [], 'project_id': 'c8b4b2ea33064be89ab7744fde37cae3'}} 2025-07-23 18:12:59,516 - DEBUG - Response for create_subnet : {'subnet': {'id': '51cec828-78cd-4140-bda4-4960a41c6c92', 'name': '', 'tenant_id': 'c8b4b2ea33064be89ab7744fde37cae3', 'network_id': '2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09', 'ip_version': 6, 'cidr': '3156:88ca:c8e3:471:b9bc:c270::/96', 'allocation_pools': [{'start': '3156:88ca:c8e3:471:b9bc:c270:0:2', 'end': '3156:88ca:c8e3:471:b9bc:c270:ffff:fffe'}], 'gateway_ip': '3156:88ca:c8e3:471:b9bc:c270:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3156:88ca:c8e3:471:b9bc:c270:0:2', 'tags': [], 'project_id': 'c8b4b2ea33064be89ab7744fde37cae3'}} 2025-07-23 18:12:59,542 - INFO - Created VN ctest-vn-69433243 2025-07-23 18:12:59,559 - DEBUG - VN ctest-vn-69433243 UUID is 2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09 2025-07-23 18:12:59,650 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 18:12:59,944 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 18:12:59,973 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 18:12:59,994 - DEBUG - Requesting: http://10.0.0.23:8082/project/c8b4b2ea-3306-4be8-9ab7-744fde37cae3 2025-07-23 18:13:00,093 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/db173507-a3d5-4fa6-9653-46774d95b311 2025-07-23 18:13:00,106 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/db173507-a3d5-4fa6-9653-46774d95b311 2025-07-23 18:13:00,118 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea801a08-5f9a-4a7e-9b8a-e59cb6ed4e46 2025-07-23 18:13:00,128 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea801a08-5f9a-4a7e-9b8a-e59cb6ed4e46 2025-07-23 18:13:00,137 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c6aeb804-ad05-4856-b460-aba1510cfdc7 2025-07-23 18:13:00,145 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 18:13:00,145 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/db173507-a3d5-4fa6-9653-46774d95b311 2025-07-23 18:13:00,156 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea801a08-5f9a-4a7e-9b8a-e59cb6ed4e46 2025-07-23 18:13:00,172 - INFO - Verified VN network id 7 for VN db173507-a3d5-4fa6-9653-46774d95b311 2025-07-23 18:13:00,172 - INFO - Verifications in API Server for VN ctest-vn-55327471 passed 2025-07-23 18:13:00,173 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/db173507-a3d5-4fa6-9653-46774d95b311 2025-07-23 18:13:00,183 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea801a08-5f9a-4a7e-9b8a-e59cb6ed4e46 2025-07-23 18:13:00,191 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea801a08-5f9a-4a7e-9b8a-e59cb6ed4e46 2025-07-23 18:13:00,199 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c6aeb804-ad05-4856-b460-aba1510cfdc7 2025-07-23 18:13:00,214 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggrIpv6Serial-36699524', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15787145325700272038', 'uuid-lslong': '10832079006972883729'}, 'enable': 'true', 'created': '2025-07-23T18:12:58', 'last-modified': '2025-07-23T18:12:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.608642'} 2025-07-23 18:13:00,221 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 18:13:00,227 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggrIpv6Serial-36699524', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15787145325700272038', 'uuid-lslong': '10832079006972883729'}, 'enable': 'true', 'created': '2025-07-23T18:12:58', 'last-modified': '2025-07-23T18:12:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.626963'} 2025-07-23 18:13:00,234 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 18:13:00,240 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggrIpv6Serial-36699524', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15787145325700272038', 'uuid-lslong': '10832079006972883729'}, 'enable': 'true', 'created': '2025-07-23T18:12:58', 'last-modified': '2025-07-23T18:12:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.636951'} 2025-07-23 18:13:00,248 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 18:13:00,248 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-55327471 passed 2025-07-23 18:13:00,248 - DEBUG - ====Verifying policy data for ctest-vn-55327471 in API_Server ====== 2025-07-23 18:13:00,249 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 18:13:00,255 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 18:13:00,268 - DEBUG - Requesting: http://10.0.0.23:8082/project/c8b4b2ea-3306-4be8-9ab7-744fde37cae3 2025-07-23 18:13:00,364 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/db173507-a3d5-4fa6-9653-46774d95b311 2025-07-23 18:13:00,377 - DEBUG - =>VN ctest-vn-55327471 has no policy to be verified 2025-07-23 18:13:00,377 - DEBUG - Verifying the vn in opserver 2025-07-23 18:13:00,377 - DEBUG - Verifying the default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471 virtual network link through opserver 10.0.0.23 2025-07-23 18:13:00,377 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 18:13:00,672 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 18:13:00,738 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471?flat'} 2025-07-23 18:13:00,738 - DEBUG - Verifying the default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471 virtual network link through opserver 10.0.0.249 2025-07-23 18:13:00,739 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 18:13:01,036 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 18:13:01,110 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471?flat'} 2025-07-23 18:13:01,110 - DEBUG - Verifying the default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471 virtual network link through opserver 10.0.0.73 2025-07-23 18:13:01,110 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 18:13:01,415 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 18:13:01,536 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471?flat'} 2025-07-23 18:13:01,536 - INFO - Validated that VN default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-55327471 is found in opserver 2025-07-23 18:13:01,576 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 18:13:01,595 - DEBUG - VRF ids for VN ctest-vn-55327471: {} 2025-07-23 18:13:01,595 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 18:13:01,609 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 18:13:01,624 - DEBUG - Requesting: http://10.0.0.23:8082/project/c8b4b2ea-3306-4be8-9ab7-744fde37cae3 2025-07-23 18:13:01,744 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09 2025-07-23 18:13:01,763 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09 2025-07-23 18:13:01,773 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4112fef9-4d6f-4df0-8dd9-da3b2eed83f1 2025-07-23 18:13:01,788 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4112fef9-4d6f-4df0-8dd9-da3b2eed83f1 2025-07-23 18:13:01,835 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6d454673-2cdf-45bd-a897-98fde8166fdf 2025-07-23 18:13:01,856 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 18:13:01,856 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09 2025-07-23 18:13:01,871 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4112fef9-4d6f-4df0-8dd9-da3b2eed83f1 2025-07-23 18:13:01,906 - INFO - Verified VN network id 8 for VN 2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09 2025-07-23 18:13:01,907 - INFO - Verifications in API Server for VN ctest-vn-69433243 passed 2025-07-23 18:13:01,907 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09 2025-07-23 18:13:01,930 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4112fef9-4d6f-4df0-8dd9-da3b2eed83f1 2025-07-23 18:13:01,945 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4112fef9-4d6f-4df0-8dd9-da3b2eed83f1 2025-07-23 18:13:01,952 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6d454673-2cdf-45bd-a897-98fde8166fdf 2025-07-23 18:13:01,966 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggrIpv6Serial-36699524', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3331633401019846078', 'uuid-lslong': '12397071329152113417'}, 'enable': 'true', 'created': '2025-07-23T18:12:59', 'last-modified': '2025-07-23T18:12:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.512668'} 2025-07-23 18:13:01,982 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 18:13:01,990 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggrIpv6Serial-36699524', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3331633401019846078', 'uuid-lslong': '12397071329152113417'}, 'enable': 'true', 'created': '2025-07-23T18:12:59', 'last-modified': '2025-07-23T18:12:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.541095'} 2025-07-23 18:13:02,007 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 18:13:02,016 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggrIpv6Serial-36699524', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3331633401019846078', 'uuid-lslong': '12397071329152113417'}, 'enable': 'true', 'created': '2025-07-23T18:12:59', 'last-modified': '2025-07-23T18:12:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.563767'} 2025-07-23 18:13:02,026 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 18:13:02,026 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-69433243 passed 2025-07-23 18:13:02,026 - DEBUG - ====Verifying policy data for ctest-vn-69433243 in API_Server ====== 2025-07-23 18:13:02,026 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 18:13:02,033 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 18:13:02,052 - DEBUG - Requesting: http://10.0.0.23:8082/project/c8b4b2ea-3306-4be8-9ab7-744fde37cae3 2025-07-23 18:13:02,147 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2e3c56ed-2d9d-4dbe-ac0b-3eb0fd4a9b09 2025-07-23 18:13:02,163 - DEBUG - =>VN ctest-vn-69433243 has no policy to be verified 2025-07-23 18:13:02,163 - DEBUG - Verifying the vn in opserver 2025-07-23 18:13:02,163 - DEBUG - Verifying the default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243 virtual network link through opserver 10.0.0.23 2025-07-23 18:13:02,163 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 18:13:02,215 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243?flat'} 2025-07-23 18:13:02,215 - DEBUG - Verifying the default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243 virtual network link through opserver 10.0.0.249 2025-07-23 18:13:02,215 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 18:13:02,267 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243?flat'} 2025-07-23 18:13:02,267 - DEBUG - Verifying the default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243 virtual network link through opserver 10.0.0.73 2025-07-23 18:13:02,267 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 18:13:02,324 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243?flat'} 2025-07-23 18:13:02,324 - INFO - Validated that VN default-domain:ctest-FatFlowAggrIpv6Serial-36699524:ctest-vn-69433243 is found in opserver 2025-07-23 18:13:02,363 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 18:13:02,383 - DEBUG - VRF ids for VN ctest-vn-69433243: {} 2025-07-23 18:13:02,456 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3704-2', 'an-jenkins-deploy-platform-ansible-os-3704-1']} 2025-07-23 18:14:42,857 - DEBUG - Installing image ubuntu 2025-07-23 18:14:42,857 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-07-23 18:14:42,858 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-23 18:14:42,858 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-23 18:14:42,858 - DEBUG - Unzip image 2025-07-23 18:14:42,858 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-23 18:14:42,875 - DEBUG - Try to create image in user context 2025-07-23 18:14:42,944 - INFO - Deleting VN ctest-vn-69433243 2025-07-23 18:14:43,146 - DEBUG - Response for deleting network () 2025-07-23 18:14:43,146 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4112fef9-4d6f-4df0-8dd9-da3b2eed83f1 2025-07-23 18:14:43,169 - DEBUG - Response Code: 404 2025-07-23 18:14:43,170 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 18:14:43,182 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 18:14:43,205 - DEBUG - Requesting: http://10.0.0.23:8082/project/c8b4b2ea-3306-4be8-9ab7-744fde37cae3 2025-07-23 18:14:43,297 - INFO - Validated that VN ctest-vn-69433243 is not found in API Server 2025-07-23 18:14:43,325 - DEBUG - VN ctest-vn-69433243 is not present in Agent 10.0.0.50 2025-07-23 18:14:43,336 - DEBUG - VN ctest-vn-69433243 is not present in Agent 10.0.0.130 2025-07-23 18:14:43,336 - INFO - Validated that VN ctest-vn-69433243 is not in any agent 2025-07-23 18:14:43,379 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-69433243 info 2025-07-23 18:14:43,379 - INFO - Deleting VN ctest-vn-55327471 2025-07-23 18:14:43,582 - DEBUG - Response for deleting network () 2025-07-23 18:14:43,582 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ea801a08-5f9a-4a7e-9b8a-e59cb6ed4e46 2025-07-23 18:14:43,589 - DEBUG - Response Code: 404 2025-07-23 18:14:43,589 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 18:14:43,596 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 18:14:43,608 - DEBUG - Requesting: http://10.0.0.23:8082/project/c8b4b2ea-3306-4be8-9ab7-744fde37cae3 2025-07-23 18:14:43,711 - INFO - Validated that VN ctest-vn-55327471 is not found in API Server 2025-07-23 18:14:43,742 - DEBUG - VN ctest-vn-55327471 is not present in Agent 10.0.0.50 2025-07-23 18:14:43,754 - DEBUG - VN ctest-vn-55327471 is not present in Agent 10.0.0.130 2025-07-23 18:14:43,754 - INFO - Validated that VN ctest-vn-55327471 is not in any agent 2025-07-23 18:14:43,802 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-55327471 info 2025-07-23 18:14:45,129 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 61, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node
    dual=ipv6, prefix_length6=prefix_length6, only_v6=only_v6)
  File "/contrail-test/common/vrouter/base.py", line 383, in fat_flow_with_prefix_aggr
    node_name=compute_hosts[0])
  File "/contrail-test/common/vrouter/base.py", line 179, in create_vms
    *args, **kwargs
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-23 18:14:45,129 - DEBUG - Skipping xmpp flap check 2025-07-23 18:14:45,129 - INFO - 2025-07-23 18:14:45,129 - INFO - END TEST : test_fat_flow_aggr_dest_udp_inter_vn_inter_node : FAILED[0:01:49] 2025-07-23 18:14:45,129 - INFO - -------------------------------------------------------------------------------- 2025-07-23 18:14:46,457 - ERROR - TestFailed Python 3.6.8: /usr/bin/python3 Wed Jul 23 18:14:45 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py in test_fat_flow_aggr_dest_udp_inter_vn_inter_node(self=) 91 92 """ 93 self.inputs.set_af('dual') 94 super(FatFlowAggrIpv6Serial, self).test_fat_flow_aggr_dest_udp_inter_vn_inter_node() 95 builtinsuper = global FatFlowAggrIpv6Serial = self = ).test_fat_flow_aggr_dest_udp_inter_vn_inter_node = > /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 174 if 'ci_image' in list(os.environ.keys()): 175 os.environ['stop_execution_flag'] = 'set' 176 raise TestFailed("\n ".join(errmsg)) 177 elif testskip: 178 log.info('') global TestFailed = "\n ".join undefined errmsg = ["Test failed: 
Traceback (most recent call la...tory: '/contrail-test/images/ubuntu.vmdk'\n
\n"] TestFailed: Test failed: 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 61, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node
    dual=ipv6, prefix_length6=prefix_length6, only_v6=only_v6)
  File "/contrail-test/common/vrouter/base.py", line 383, in fat_flow_with_prefix_aggr
    node_name=compute_hosts[0])
  File "/contrail-test/common/vrouter/base.py", line 179, in create_vms
    *args, **kwargs
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
__cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'tcutils.cores' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ("Test failed: 
Traceback (most recent call la...tory: '/contrail-test/images/ubuntu.vmdk'\n
\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 94, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node super(FatFlowAggrIpv6Serial, self).test_fat_flow_aggr_dest_udp_inter_vn_inter_node() File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper raise TestFailed("\n ".join(errmsg)) tcutils.cores.TestFailed: Test failed: 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/serial_scripts/vrouter/test_fat_flow_aggr_serial.py", line 61, in test_fat_flow_aggr_dest_udp_inter_vn_inter_node
    dual=ipv6, prefix_length6=prefix_length6, only_v6=only_v6)
  File "/contrail-test/common/vrouter/base.py", line 383, in fat_flow_with_prefix_aggr
    node_name=compute_hosts[0])
  File "/contrail-test/common/vrouter/base.py", line 179, in create_vms
    *args, **kwargs
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-23 18:14:46,459 - DEBUG - Skipping xmpp flap check 2025-07-23 18:14:46,459 - INFO - 2025-07-23 18:14:46,460 - INFO - END TEST : test_fat_flow_aggr_dest_udp_inter_vn_inter_node : FAILED[0:01:52] 2025-07-23 18:14:46,460 - INFO - -------------------------------------------------------------------------------- 2025-07-23 18:14:47,167 - INFO - Deleted project: ctest-FatFlowAggrIpv6Serial-36699524, ID : c8b4b2ea-3306-4be8-9ab7-744fde37cae3