2025-08-07 04:46:58,593 - INFO - Domain Default found not creating
2025-08-07 04:46:58,805 - INFO - Project ctest-FatFlowSerialIpv6-74369923 not found, creating it
2025-08-07 04:46:59,373 - INFO - Created Project:ctest-FatFlowSerialIpv6-74369923, ID : 8f9aa7bb-5aa0-4b76-aaf4-7e206829ffd4
2025-08-07 04:47:01,143 - INFO - ================================================================================
2025-08-07 04:47:01,144 - INFO - STARTING TEST : test_fat_flow_intra_vn_inter_node
2025-08-07 04:47:01,144 - INFO - TEST DESCRIPTION :
Description: Verify Fat flow for intra-VN inter-Node traffic
Steps:
1. create 1 VN and launch 3 VMs in it.client VMs on same node and server VM on different node.
2. on server VM, config Fat flow for udp port 53.
3. from both client VM, send UDP traffic to server on port 53 twice with diff. src ports
Pass criteria:
1. on client VMs compute, 4 set of flows and on server compute, 2 set of flows should be created
2. on server compute, flow's source port should be 0 for Fat flow
2025-08-07 04:47:02,478 - DEBUG - Skipping xmpp flap check
2025-08-07 04:47:02,478 - INFO - Initial checks done. Running the testcase now
2025-08-07 04:47:02,479 - INFO -
2025-08-07 04:47:03,253 - DEBUG - Response for create_network : {'network': {'id': '62889387-7956-48e4-bf06-662534d42b71', 'name': 'ctest-vn-28099231', 'tenant_id': '8f9aa7bb5aa04b76aaf47e206829ffd4', 'project_id': '8f9aa7bb5aa04b76aaf47e206829ffd4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowSerialIpv6-74369923', 'ctest-vn-28099231'], 'port_security_enabled': True, 'description': ''}}
2025-08-07 04:47:03,633 - DEBUG - Response for create_subnet : {'subnet': {'id': '132ef1b7-4a44-4a8b-99d1-baa41c59695e', 'name': '', 'tenant_id': '8f9aa7bb5aa04b76aaf47e206829ffd4', 'network_id': '62889387-7956-48e4-bf06-662534d42b71', 'ip_version': 4, 'cidr': '213.28.154.0/26', 'allocation_pools': [{'start': '213.28.154.2', 'end': '213.28.154.62'}], 'gateway_ip': '213.28.154.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '213.28.154.2', 'tags': [], 'project_id': '8f9aa7bb5aa04b76aaf47e206829ffd4'}}
2025-08-07 04:47:03,916 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bf469645-a5e0-484f-9dcc-f5e826c8174c', 'name': '', 'tenant_id': '8f9aa7bb5aa04b76aaf47e206829ffd4', 'network_id': '62889387-7956-48e4-bf06-662534d42b71', 'ip_version': 6, 'cidr': '35ba:a440:1f0:dafd:ca1a:4c6e::/96', 'allocation_pools': [{'start': '35ba:a440:1f0:dafd:ca1a:4c6e:0:2', 'end': '35ba:a440:1f0:dafd:ca1a:4c6e:ffff:fffe'}], 'gateway_ip': '35ba:a440:1f0:dafd:ca1a:4c6e:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35ba:a440:1f0:dafd:ca1a:4c6e:0:2', 'tags': [], 'project_id': '8f9aa7bb5aa04b76aaf47e206829ffd4'}}
2025-08-07 04:47:03,954 - INFO - Created VN ctest-vn-28099231
2025-08-07 04:47:03,974 - DEBUG - VN ctest-vn-28099231 UUID is 62889387-7956-48e4-bf06-662534d42b71
2025-08-07 04:47:04,112 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 04:47:04,434 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 04:47:04,470 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 04:47:04,492 - DEBUG - Requesting: http://10.0.0.56:8082/project/8f9aa7bb-5aa0-4b76-aaf4-7e206829ffd4
2025-08-07 04:47:04,608 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/62889387-7956-48e4-bf06-662534d42b71
2025-08-07 04:47:04,632 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/62889387-7956-48e4-bf06-662534d42b71
2025-08-07 04:47:04,650 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a4a500f3-f39e-46c6-bed0-ae50ccb6def6
2025-08-07 04:47:04,661 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a4a500f3-f39e-46c6-bed0-ae50ccb6def6
2025-08-07 04:47:04,672 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/b3a2d932-5eab-48dd-8e79-e4b1ca217cf9
2025-08-07 04:47:04,682 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 04:47:04,682 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/62889387-7956-48e4-bf06-662534d42b71
2025-08-07 04:47:04,698 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a4a500f3-f39e-46c6-bed0-ae50ccb6def6
2025-08-07 04:47:04,722 - INFO - Verified VN network id 7 for VN 62889387-7956-48e4-bf06-662534d42b71
2025-08-07 04:47:04,722 - INFO - Verifications in API Server for VN ctest-vn-28099231 passed
2025-08-07 04:47:04,722 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/62889387-7956-48e4-bf06-662534d42b71
2025-08-07 04:47:04,737 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a4a500f3-f39e-46c6-bed0-ae50ccb6def6
2025-08-07 04:47:04,748 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a4a500f3-f39e-46c6-bed0-ae50ccb6def6
2025-08-07 04:47:04,757 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/b3a2d932-5eab-48dd-8e79-e4b1ca217cf9
2025-08-07 04:47:04,779 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-74369923', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7100087022615152868', 'uuid-lslong': '13764801621090642801'}, 'enable': 'true', 'created': '2025-08-07T04:47:03', 'last-modified': '2025-08-07T04:47:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.929656'}
2025-08-07 04:47:04,787 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 04:47:04,796 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-74369923', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7100087022615152868', 'uuid-lslong': '13764801621090642801'}, 'enable': 'true', 'created': '2025-08-07T04:47:03', 'last-modified': '2025-08-07T04:47:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.946077'}
2025-08-07 04:47:04,807 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 04:47:04,816 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-74369923', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7100087022615152868', 'uuid-lslong': '13764801621090642801'}, 'enable': 'true', 'created': '2025-08-07T04:47:03', 'last-modified': '2025-08-07T04:47:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.964522'}
2025-08-07 04:47:04,826 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 04:47:04,827 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-28099231 passed
2025-08-07 04:47:04,827 - DEBUG - ====Verifying policy data for ctest-vn-28099231 in API_Server ======
2025-08-07 04:47:04,827 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 04:47:04,835 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 04:47:04,852 - DEBUG - Requesting: http://10.0.0.56:8082/project/8f9aa7bb-5aa0-4b76-aaf4-7e206829ffd4
2025-08-07 04:47:04,973 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/62889387-7956-48e4-bf06-662534d42b71
2025-08-07 04:47:04,995 - DEBUG - =>VN ctest-vn-28099231 has no policy to be verified
2025-08-07 04:47:04,995 - DEBUG - Verifying the vn in opserver
2025-08-07 04:47:04,995 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231 virtual network link through opserver 10.0.0.56
2025-08-07 04:47:04,996 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 04:47:05,324 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 04:47:05,401 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231?flat'}
2025-08-07 04:47:05,401 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231 virtual network link through opserver 10.0.0.130
2025-08-07 04:47:05,401 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 04:47:05,727 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 04:47:05,803 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231?flat'}
2025-08-07 04:47:05,803 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231 virtual network link through opserver 10.0.0.249
2025-08-07 04:47:05,803 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 04:47:06,108 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 04:47:06,177 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231?flat'}
2025-08-07 04:47:06,177 - INFO - Validated that VN default-domain:ctest-FatFlowSerialIpv6-74369923:ctest-vn-28099231 is found in opserver
2025-08-07 04:47:06,208 - DEBUG - Do not have enough data to verify VN in agent
2025-08-07 04:47:06,225 - DEBUG - VRF ids for VN ctest-vn-28099231: {}
2025-08-07 04:47:06,259 - DEBUG - Services list from nova: [