2025-08-07 03:38:20,423 - INFO - Domain Default found not creating
2025-08-07 03:38:20,593 - INFO - Project ctest-FatFlowAggr-17320683 not found, creating it
2025-08-07 03:38:21,212 - INFO - Created Project:ctest-FatFlowAggr-17320683, ID : 42d0d1e5-80e3-4d11-8554-a363b7834f42
2025-08-07 03:38:22,868 - INFO - ================================================================================
2025-08-07 03:38:22,868 - INFO - STARTING TEST : test_fat_flow_aggr_dest_icmp_intra_vn_inter_node
2025-08-07 03:38:22,869 - INFO - TEST DESCRIPTION : :
Description: Verify fat flow prefix aggr dest (IPv4) for intra-vn inter-node
Steps:
1. Create 1 VN and launch 3 VMs.2 client VMs on same node and server VM on different node.
Client 1 in subnet 1, Client 2 in the next subnet.
2. On server VM, config fat flow aggr prefix dest len 25 for ICMP port 0.
3. From both the client VMs, send ICMP traffic to the server VM twice with diff. src ports
Pass criteria:
1. On the remote CN, expect 2 pairs ( 1 for client 1, 1 for client 2)
of fat flows with prefix aggregated for the src IPs
(VM to fabric, Prefix Aggr Dest: Aggregation happens for SRC IPs)
2. On client VM compute nodes, expect 4 pairs of flows and on server compute,
expect 2 pairs of flows
3. On server compute node, flow's source port should be 0 for fat flows
Maintainer: Ankitja@juniper.net
2025-08-07 03:38:24,158 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with
2025-08-07 03:38:24,158 - INFO - Initial checks done. Running the testcase now
2025-08-07 03:38:24,158 - INFO -
2025-08-07 03:38:24,193 - DEBUG - Services list from nova: [, , , ]
2025-08-07 03:38:24,194 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3767-2', 'an-jenkins-deploy-platform-ansible-os-3767-1']}
2025-08-07 03:38:25,132 - DEBUG - Response for create_network : {'network': {'id': '34d5c14d-4f67-4952-ace9-2968d7338d0b', 'name': 'ctest-vn-33856346', 'tenant_id': '42d0d1e580e34d118554a363b7834f42', 'project_id': '42d0d1e580e34d118554a363b7834f42', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowAggr-17320683', 'ctest-vn-33856346'], 'port_security_enabled': True, 'description': ''}}
2025-08-07 03:38:25,473 - DEBUG - Response for create_subnet : {'subnet': {'id': '20d7b389-3c52-4cd4-ba7f-fdc13f7f6d0b', 'name': '', 'tenant_id': '42d0d1e580e34d118554a363b7834f42', 'network_id': '34d5c14d-4f67-4952-ace9-2968d7338d0b', 'ip_version': 4, 'cidr': '78.71.101.128/26', 'allocation_pools': [{'start': '78.71.101.130', 'end': '78.71.101.190'}], 'gateway_ip': '78.71.101.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '78.71.101.130', 'tags': [], 'project_id': '42d0d1e580e34d118554a363b7834f42'}}
2025-08-07 03:38:25,514 - INFO - Created VN ctest-vn-33856346
2025-08-07 03:38:25,531 - DEBUG - VN ctest-vn-33856346 UUID is 34d5c14d-4f67-4952-ace9-2968d7338d0b
2025-08-07 03:38:25,861 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:38:26,211 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:38:26,243 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:38:26,276 - DEBUG - Requesting: http://10.0.0.56:8082/project/42d0d1e5-80e3-4d11-8554-a363b7834f42
2025-08-07 03:38:26,393 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/34d5c14d-4f67-4952-ace9-2968d7338d0b
2025-08-07 03:38:26,414 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/34d5c14d-4f67-4952-ace9-2968d7338d0b
2025-08-07 03:38:26,427 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bfdc7685-4072-4867-8cb5-fe595d2d7bdd
2025-08-07 03:38:26,445 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bfdc7685-4072-4867-8cb5-fe595d2d7bdd
2025-08-07 03:38:26,460 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/87e5d0b5-bf97-4811-ae41-35a1dd9d9ca5
2025-08-07 03:38:26,473 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/96ab3f76-227a-44b6-a7eb-814e6f8f2f0b
2025-08-07 03:38:26,486 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-07 03:38:26,486 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/34d5c14d-4f67-4952-ace9-2968d7338d0b
2025-08-07 03:38:26,506 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bfdc7685-4072-4867-8cb5-fe595d2d7bdd
2025-08-07 03:38:26,527 - INFO - Verified VN network id 12 for VN 34d5c14d-4f67-4952-ace9-2968d7338d0b
2025-08-07 03:38:26,527 - INFO - Verifications in API Server for VN ctest-vn-33856346 passed
2025-08-07 03:38:26,527 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/34d5c14d-4f67-4952-ace9-2968d7338d0b
2025-08-07 03:38:26,545 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bfdc7685-4072-4867-8cb5-fe595d2d7bdd
2025-08-07 03:38:26,557 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bfdc7685-4072-4867-8cb5-fe595d2d7bdd
2025-08-07 03:38:26,569 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/87e5d0b5-bf97-4811-ae41-35a1dd9d9ca5
2025-08-07 03:38:26,585 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/96ab3f76-227a-44b6-a7eb-814e6f8f2f0b
2025-08-07 03:38:26,605 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-17320683', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3807161597800434002', 'uuid-lslong': '12459535374361005323'}, 'enable': 'true', 'created': '2025-08-07T03:38:25', 'last-modified': '2025-08-07T03:38:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.892936'}
2025-08-07 03:38:26,618 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-07 03:38:26,626 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-17320683', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3807161597800434002', 'uuid-lslong': '12459535374361005323'}, 'enable': 'true', 'created': '2025-08-07T03:38:25', 'last-modified': '2025-08-07T03:38:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.922525'}
2025-08-07 03:38:26,642 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-07 03:38:26,649 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-17320683', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3807161597800434002', 'uuid-lslong': '12459535374361005323'}, 'enable': 'true', 'created': '2025-08-07T03:38:25', 'last-modified': '2025-08-07T03:38:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.952509'}
2025-08-07 03:38:26,664 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-07 03:38:26,664 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-33856346 passed
2025-08-07 03:38:26,664 - DEBUG - ====Verifying policy data for ctest-vn-33856346 in API_Server ======
2025-08-07 03:38:26,664 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:38:26,674 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:38:26,695 - DEBUG - Requesting: http://10.0.0.56:8082/project/42d0d1e5-80e3-4d11-8554-a363b7834f42
2025-08-07 03:38:26,854 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/34d5c14d-4f67-4952-ace9-2968d7338d0b
2025-08-07 03:38:26,877 - DEBUG - =>VN ctest-vn-33856346 has no policy to be verified
2025-08-07 03:38:26,877 - DEBUG - Verifying the vn in opserver
2025-08-07 03:38:26,877 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346 virtual network link through opserver 10.0.0.56
2025-08-07 03:38:26,877 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:38:27,207 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:38:27,301 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346?flat'}
2025-08-07 03:38:27,301 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346 virtual network link through opserver 10.0.0.130
2025-08-07 03:38:27,301 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:38:27,669 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:38:27,743 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346?flat'}
2025-08-07 03:38:27,743 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346 virtual network link through opserver 10.0.0.249
2025-08-07 03:38:27,743 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:38:28,082 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:38:28,163 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346?flat'}
2025-08-07 03:38:28,163 - INFO - Validated that VN default-domain:ctest-FatFlowAggr-17320683:ctest-vn-33856346 is found in opserver
2025-08-07 03:38:28,194 - DEBUG - Do not have enough data to verify VN in agent
2025-08-07 03:38:28,208 - DEBUG - VRF ids for VN ctest-vn-33856346: {}
2025-08-07 03:38:28,268 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3767-2', 'an-jenkins-deploy-platform-ansible-os-3767-1']}
2025-08-07 03:38:28,348 - DEBUG - Image by name ubuntu not found
2025-08-07 03:38:28,348 - DEBUG - Installing image ubuntu
2025-08-07 03:38:28,348 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-08-07 03:38:28,349 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz
2025-08-07 03:38:28,349 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz
2025-08-07 03:38:28,349 - DEBUG - Unzip image
2025-08-07 03:38:28,349 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz
2025-08-07 03:38:28,372 - INFO - image /contrail-test/images/ubuntu.vmdk is not found
2025-08-07 03:38:28,373 - DEBUG - Deleting RT for VN ctest-vn-33856346
2025-08-07 03:38:28,534 - INFO - Deleting VN ctest-vn-33856346
2025-08-07 03:38:28,739 - DEBUG - Response for deleting network ()
2025-08-07 03:38:28,740 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bfdc7685-4072-4867-8cb5-fe595d2d7bdd
2025-08-07 03:38:28,747 - DEBUG - Response Code: 404
2025-08-07 03:38:28,747 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:38:28,758 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:38:28,775 - DEBUG - Requesting: http://10.0.0.56:8082/project/42d0d1e5-80e3-4d11-8554-a363b7834f42
2025-08-07 03:38:28,876 - INFO - Validated that VN ctest-vn-33856346 is not found in API Server
2025-08-07 03:38:28,897 - DEBUG - VN ctest-vn-33856346 is not present in Agent 10.0.0.41
2025-08-07 03:38:28,910 - DEBUG - VN ctest-vn-33856346 is not present in Agent 10.0.0.61
2025-08-07 03:38:28,910 - INFO - Validated that VN ctest-vn-33856346 is not in any agent
2025-08-07 03:38:28,958 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-33856346 info
2025-08-07 03:38:30,239 - DEBUG - No XMPP flaps were noticed during the test
2025-08-07 03:38:30,239 - INFO -
2025-08-07 03:38:30,239 - INFO - END TEST : test_fat_flow_aggr_dest_icmp_intra_vn_inter_node : SKIPPED[0:00:08]
2025-08-07 03:38:30,240 - INFO - --------------------------------------------------------------------------------
2025-08-07 03:38:31,069 - INFO - Deleted project: ctest-FatFlowAggr-17320683, ID : 42d0d1e5-80e3-4d11-8554-a363b7834f42