2025-08-11 17:56:32,783 - INFO - Domain Default found not creating 2025-08-11 17:56:32,909 - INFO - Project ctest-TestMd5testsOnControl-58512595 not found, creating it 2025-08-11 17:56:33,387 - INFO - Created Project:ctest-TestMd5testsOnControl-58512595, ID : f0be8015-365a-4639-85d5-db4705b5a1e7 2025-08-11 17:56:35,395 - DEBUG - Response for create_network : {'network': {'id': '545c77a2-cd12-4f5b-920d-e04cf33d7f99', 'name': 'test_vnv6sr', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'test_vnv6sr'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:56:35,619 - DEBUG - Response for create_subnet : {'subnet': {'id': '94ad8a1f-bd24-4c52-8965-f245e1569a5a', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '545c77a2-cd12-4f5b-920d-e04cf33d7f99', 'ip_version': 6, 'cidr': '2001::101:0/120', 'allocation_pools': [{'start': '2001::101:2', 'end': '2001::101:fe'}], 'gateway_ip': '2001::101:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::101:2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:56:36,107 - DEBUG - Response for create_subnet : {'subnet': {'id': '2810a6e3-6476-4606-8837-617c04d50919', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '545c77a2-cd12-4f5b-920d-e04cf33d7f99', 'ip_version': 4, 'cidr': '64.80.182.0/26', 'allocation_pools': [{'start': '64.80.182.2', 'end': '64.80.182.62'}], 'gateway_ip': '64.80.182.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '64.80.182.2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:56:36,131 - INFO - Created VN test_vnv6sr 2025-08-11 17:56:36,141 - DEBUG - VN test_vnv6sr UUID is 545c77a2-cd12-4f5b-920d-e04cf33d7f99 2025-08-11 17:56:36,513 - DEBUG - Response for create_network : {'network': {'id': 'f838f5d2-fff5-4c67-a4ee-a14825d58df4', 'name': 'test_vnv6dn', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'test_vnv6dn'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:56:36,798 - DEBUG - Response for create_subnet : {'subnet': {'id': '69a1c4c0-d6a9-48a2-af5b-fd2969c65854', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': 'f838f5d2-fff5-4c67-a4ee-a14825d58df4', 'ip_version': 6, 'cidr': '2001::201:0/120', 'allocation_pools': [{'start': '2001::201:2', 'end': '2001::201:fe'}], 'gateway_ip': '2001::201:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::201:2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:56:37,036 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c41266ee-e35b-4a32-a788-0ae84fe83eba', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': 'f838f5d2-fff5-4c67-a4ee-a14825d58df4', 'ip_version': 4, 'cidr': '67.20.239.0/26', 'allocation_pools': [{'start': '67.20.239.2', 'end': '67.20.239.62'}], 'gateway_ip': '67.20.239.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '67.20.239.2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:56:37,069 - INFO - Created VN test_vnv6dn 2025-08-11 17:56:37,080 - DEBUG - VN test_vnv6dn UUID is f838f5d2-fff5-4c67-a4ee-a14825d58df4 2025-08-11 17:56:37,231 - DEBUG - Services list from nova: [, , , ] 2025-08-11 17:56:38,281 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-2) 2025-08-11 17:56:39,533 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-1) 2025-08-11 17:56:39,533 - INFO - Waiting for VM source_vm to be up.. 2025-08-11 17:56:39,611 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-11 17:56:44,707 - DEBUG - VM is in ACTIVE state now 2025-08-11 17:56:44,707 - INFO - VM name : source_vm 2025-08-11 17:56:44,855 - DEBUG - VM source_vm ID is e84159d2-4ca6-46fa-94a7-c0ccfdcce320 2025-08-11 17:56:44,904 - DEBUG - VM source_vm launched on Node an-jenkins-deploy-platform-ansible-os-3816-2 2025-08-11 17:56:44,996 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e84159d2-4ca6-46fa-94a7-c0ccfdcce320 2025-08-11 17:56:45,308 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e84159d2-4ca6-46fa-94a7-c0ccfdcce320 2025-08-11 17:56:45,337 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/631077db-5c8f-4dad-9a9a-2c8c21e0372f 2025-08-11 17:56:48,625 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms') 2025-08-11 17:56:48,626 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM source_vm failed! 2025-08-11 17:56:48,639 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6sr is 2001::101:1 and allocation pool is NOT set 2025-08-11 17:56:48,639 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6sr is 64.80.182.1 and allocation pool is NOT set 2025-08-11 17:56:50,711 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.17 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.37 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.367/2.769/4.171/1.402 ms') 2025-08-11 17:56:50,711 - INFO - Ping to Metadata IP 169.254.0.3 of VM source_vm passed 2025-08-11 17:56:50,827 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 17:56:50,827 - DEBUG - Waiting to SSH to VM source_vm, IP 64.80.182.3, Port 22 2025-08-11 17:56:50,881 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-11 17:56:50,987 - DEBUG - VM source_vm is NOT ready for SSH connections, VM status: ACTIVE 2025-08-11 17:56:55,989 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 17:56:55,989 - DEBUG - Waiting to SSH to VM source_vm, IP 64.80.182.3, Port 22 2025-08-11 17:56:56,145 - DEBUG - VM source_vm is ready for SSH connections 2025-08-11 17:56:56,145 - INFO - Waiting for VM dest_vm to be up.. 2025-08-11 17:56:56,218 - DEBUG - VM is in ACTIVE state now 2025-08-11 17:56:56,218 - INFO - VM name : dest_vm 2025-08-11 17:56:56,302 - DEBUG - VM dest_vm ID is ab02e7c0-20bf-4e4e-b8ba-4f249d443def 2025-08-11 17:56:56,302 - DEBUG - VM dest_vm launched on Node an-jenkins-deploy-platform-ansible-os-3816-1 2025-08-11 17:56:56,371 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/ab02e7c0-20bf-4e4e-b8ba-4f249d443def 2025-08-11 17:56:56,380 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/8d473502-6fb0-4f84-b6f9-9897990eddf3 2025-08-11 17:56:57,579 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.67 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.321 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.321/1.495/2.669/1.174 ms') 2025-08-11 17:56:57,579 - INFO - Ping to Metadata IP 169.254.0.3 of VM dest_vm passed 2025-08-11 17:56:57,690 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 17:56:57,690 - DEBUG - Waiting to SSH to VM dest_vm, IP 67.20.239.3, Port 22 2025-08-11 17:56:57,843 - DEBUG - VM dest_vm is ready for SSH connections 2025-08-11 17:56:57,849 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6sr, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6dn, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-11 17:56:58,180 - INFO - Attaching policy allow_all to vn test_vnv6sr 2025-08-11 17:56:58,524 - INFO - Attaching policy allow_all to vn test_vnv6dn 2025-08-11 17:56:58,772 - INFO - Configure the policy with allow any 2025-08-11 17:56:59,069 - DEBUG - Response for create_network : {'network': {'id': '89ccb9f2-4213-47a7-9d2a-18d18cfff948', 'name': 'vn1', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'vn1'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:56:59,305 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aaa9677a-70c7-4254-9ee3-936cb6707a4a', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '89ccb9f2-4213-47a7-9d2a-18d18cfff948', 'ip_version': 4, 'cidr': '10.1.1.0/24', 'allocation_pools': [{'start': '10.1.1.2', 'end': '10.1.1.254'}], 'gateway_ip': '10.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.1.1.2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:56:59,324 - INFO - Created VN vn1 2025-08-11 17:56:59,335 - DEBUG - VN vn1 UUID is 89ccb9f2-4213-47a7-9d2a-18d18cfff948 2025-08-11 17:56:59,677 - DEBUG - Response for create_network : {'network': {'id': '2761170f-2859-4626-a39e-642d4e3cf87e', 'name': 'vn2', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'vn2'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:56:59,922 - DEBUG - Response for create_subnet : {'subnet': {'id': '3e28cc1b-62fa-4f8a-9aa2-4750a9baa514', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '2761170f-2859-4626-a39e-642d4e3cf87e', 'ip_version': 4, 'cidr': '20.1.1.0/24', 'allocation_pools': [{'start': '20.1.1.2', 'end': '20.1.1.254'}], 'gateway_ip': '20.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.1.1.2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:56:59,942 - INFO - Created VN vn2 2025-08-11 17:56:59,957 - DEBUG - VN vn2 UUID is 2761170f-2859-4626-a39e-642d4e3cf87e 2025-08-11 17:57:00,062 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:vn1, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:vn2, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-11 17:57:00,387 - INFO - Attaching policy sec_grp_policy_ctest-random-39658983 to vn vn1 2025-08-11 17:57:00,724 - INFO - Attaching policy sec_grp_policy_ctest-random-39658983 to vn vn2 2025-08-11 17:57:02,139 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-2) 2025-08-11 17:57:03,397 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-1) 2025-08-11 17:57:03,457 - INFO - ================================================================================ 2025-08-11 17:57:03,457 - INFO - STARTING TEST : test_check_per_peer_on_control 2025-08-11 17:57:03,457 - INFO - TEST DESCRIPTION : Description: Verify per peer md5 and specific protocol on all ports and policy with allow all between VN's 2025-08-11 17:57:04,718 - DEBUG - Skipping xmpp flap check 2025-08-11 17:57:04,718 - INFO - Initial checks done. Running the testcase now 2025-08-11 17:57:04,718 - INFO - 2025-08-11 17:57:04,718 - INFO - config per peer with auth_data None 2025-08-11 17:57:05,238 - INFO - configure MD5 on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:57:05,318 - INFO - config per peer with auth_data None 2025-08-11 17:57:05,850 - INFO - configure MD5 on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:57:05,938 - INFO - config per peer with auth_data None 2025-08-11 17:57:06,468 - INFO - configure MD5 on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:57:06,542 - INFO - check BGP peering is up before setting md5 config 2025-08-11 17:57:06,542 - INFO - Check BGP staus between peers 2025-08-11 17:57:06,552 - INFO - config per peer with auth_data {'key_items': [{'key': 'juniper', 'key_id': 0}], 'key_type': 'md5'} 2025-08-11 17:57:07,116 - INFO - Check BGP staus between peers 2025-08-11 17:57:07,128 - DEBUG - Check the BGP connection on 10.0.0.27 2025-08-11 17:57:07,128 - DEBUG - Check the BGP connection on 10.0.0.27 2025-08-11 17:57:17,129 - INFO - Check BGP staus between peers 2025-08-11 17:57:17,140 - INFO - remove md5 configured on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:57:17,140 - INFO - config per peer with auth_data None 2025-08-11 17:57:17,739 - INFO - configure MD5 on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:57:17,830 - INFO - remove md5 configured on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:57:17,831 - INFO - config per peer with auth_data None 2025-08-11 17:57:18,449 - INFO - configure MD5 on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:57:18,546 - INFO - remove md5 configured on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:57:18,546 - INFO - config per peer with auth_data None 2025-08-11 17:57:19,110 - INFO - configure MD5 on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:57:19,194 - INFO - Skip interface_detach for VM vn2_vm_0 in state BUILD 2025-08-11 17:57:19,194 - INFO - Deleting VM vn2_vm_0 2025-08-11 17:57:19,195 - ERROR - VM vn2_vm_0 has failed to come up 2025-08-11 17:57:19,195 - ERROR - Nova failed to get host of the VM 2025-08-11 17:57:19,195 - ERROR - VM vn2_vm_0 has failed to come up 2025-08-11 17:57:19,195 - ERROR - Nova failed to get host of the VM 2025-08-11 17:57:19,258 - INFO - Skip interface_detach for VM vn1_vm_0 in state BUILD 2025-08-11 17:57:19,258 - INFO - Deleting VM vn1_vm_0 2025-08-11 17:57:19,259 - ERROR - VM vn1_vm_0 has failed to come up 2025-08-11 17:57:19,259 - ERROR - Nova failed to get host of the VM 2025-08-11 17:57:19,259 - ERROR - VM vn1_vm_0 has failed to come up 2025-08-11 17:57:19,259 - ERROR - Nova failed to get host of the VM 2025-08-11 17:57:19,317 - INFO - Dettaching policy sec_grp_policy_ctest-random-39658983 from vn vn2 2025-08-11 17:57:19,489 - INFO - Dettaching policy sec_grp_policy_ctest-random-39658983 from vn vn1 2025-08-11 17:57:19,764 - INFO - Deleted policy sec_grp_policy_ctest-random-39658983 2025-08-11 17:57:19,764 - INFO - Deleting VN vn2 2025-08-11 17:57:19,816 - DEBUG - VN 2761170f-2859-4626-a39e-642d4e3cf87e still in use: Unable to complete operation on network 2761170f-2859-4626-a39e-642d4e3cf87e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7a17c4e7-f702-40a6-8ce1-796cb2d0cce8'] 2025-08-11 17:57:19,816 - WARNING - Deleting VN vn2 failed..Will retry 2025-08-11 17:57:21,945 - DEBUG - Response for deleting network () 2025-08-11 17:57:21,945 - INFO - Deleting VN vn1 2025-08-11 17:57:22,078 - DEBUG - Response for deleting network () 2025-08-11 17:57:22,078 - INFO - Dettaching policy allow_all from vn test_vnv6dn 2025-08-11 17:57:22,249 - INFO - Dettaching policy allow_all from vn test_vnv6sr 2025-08-11 17:57:22,508 - INFO - Deleted policy allow_all 2025-08-11 17:57:22,508 - INFO - Deleting VM dest_vm 2025-08-11 17:57:22,582 - INFO - Deleting VM source_vm 2025-08-11 17:57:22,653 - INFO - Deleting VN test_vnv6dn 2025-08-11 17:57:22,692 - DEBUG - VN f838f5d2-fff5-4c67-a4ee-a14825d58df4 still in use: Unable to complete operation on network f838f5d2-fff5-4c67-a4ee-a14825d58df4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ce8a2266-a296-4b22-aaf0-3c60fec1c605'] 2025-08-11 17:57:22,692 - WARNING - Deleting VN test_vnv6dn failed..Will retry 2025-08-11 17:57:24,846 - DEBUG - Response for deleting network () 2025-08-11 17:57:24,846 - INFO - Deleting VN test_vnv6sr 2025-08-11 17:57:25,074 - DEBUG - Response for deleting network () 2025-08-11 17:57:26,318 - DEBUG - Skipping xmpp flap check 2025-08-11 17:57:26,319 - INFO - END TEST : test_check_per_peer_on_control : PASSED[0:00:23] 2025-08-11 17:57:26,319 - INFO - -------------------------------------------------------------------------------- 2025-08-11 17:57:26,565 - DEBUG - Response for create_network : {'network': {'id': '7ddc9d13-cd77-4b80-aef1-91fdfb54f2fc', 'name': 'test_vnv6sr', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'test_vnv6sr'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:57:26,835 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a6d14fb5-927b-447a-967e-f583c28d6daf', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '7ddc9d13-cd77-4b80-aef1-91fdfb54f2fc', 'ip_version': 6, 'cidr': '2001::101:0/120', 'allocation_pools': [{'start': '2001::101:2', 'end': '2001::101:fe'}], 'gateway_ip': '2001::101:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::101:2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:57:27,057 - DEBUG - Response for create_subnet : {'subnet': {'id': '3df6cb01-6b27-4b52-b876-efedb6ffe3cc', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '7ddc9d13-cd77-4b80-aef1-91fdfb54f2fc', 'ip_version': 4, 'cidr': '191.7.217.192/26', 'allocation_pools': [{'start': '191.7.217.194', 'end': '191.7.217.254'}], 'gateway_ip': '191.7.217.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.7.217.194', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:57:27,081 - INFO - Created VN test_vnv6sr 2025-08-11 17:57:27,092 - DEBUG - VN test_vnv6sr UUID is 7ddc9d13-cd77-4b80-aef1-91fdfb54f2fc 2025-08-11 17:57:27,439 - DEBUG - Response for create_network : {'network': {'id': '9ce4f6f5-d8ba-4480-81c6-7c9121bfaefa', 'name': 'test_vnv6dn', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'test_vnv6dn'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:57:27,650 - DEBUG - Response for create_subnet : {'subnet': {'id': '1ba81c72-6fe6-4908-a992-8d5dc7e5e693', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '9ce4f6f5-d8ba-4480-81c6-7c9121bfaefa', 'ip_version': 6, 'cidr': '2001::201:0/120', 'allocation_pools': [{'start': '2001::201:2', 'end': '2001::201:fe'}], 'gateway_ip': '2001::201:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::201:2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:57:27,854 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dad80d3d-a226-4206-8fee-c398b9ffbc02', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '9ce4f6f5-d8ba-4480-81c6-7c9121bfaefa', 'ip_version': 4, 'cidr': '103.108.239.64/26', 'allocation_pools': [{'start': '103.108.239.66', 'end': '103.108.239.126'}], 'gateway_ip': '103.108.239.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '103.108.239.66', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:57:27,876 - INFO - Created VN test_vnv6dn 2025-08-11 17:57:27,888 - DEBUG - VN test_vnv6dn UUID is 9ce4f6f5-d8ba-4480-81c6-7c9121bfaefa 2025-08-11 17:57:28,916 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-2) 2025-08-11 17:57:30,127 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-1) 2025-08-11 17:57:30,127 - INFO - Waiting for VM source_vm to be up.. 2025-08-11 17:57:30,209 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-11 17:57:35,281 - DEBUG - VM is in ACTIVE state now 2025-08-11 17:57:35,281 - INFO - VM name : source_vm 2025-08-11 17:57:35,347 - DEBUG - VM source_vm ID is c0bc27e3-1d89-4a49-9712-50350b0b86fb 2025-08-11 17:57:35,347 - DEBUG - VM source_vm launched on Node an-jenkins-deploy-platform-ansible-os-3816-2 2025-08-11 17:57:35,417 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/c0bc27e3-1d89-4a49-9712-50350b0b86fb 2025-08-11 17:57:35,426 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/78f09b95-d375-4753-9106-523fb887a50d 2025-08-11 17:57:38,641 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-08-11 17:57:38,642 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM source_vm failed! 2025-08-11 17:57:38,655 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6sr is 2001::101:1 and allocation pool is NOT set 2025-08-11 17:57:38,655 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6sr is 191.7.217.193 and allocation pool is NOT set 2025-08-11 17:57:40,718 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.10 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.09 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.087/2.592/4.097/1.505 ms') 2025-08-11 17:57:40,718 - INFO - Ping to Metadata IP 169.254.0.3 of VM source_vm passed 2025-08-11 17:57:40,826 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 17:57:40,826 - DEBUG - Waiting to SSH to VM source_vm, IP 191.7.217.195, Port 22 2025-08-11 17:57:40,982 - DEBUG - VM source_vm is ready for SSH connections 2025-08-11 17:57:40,982 - INFO - Waiting for VM dest_vm to be up.. 2025-08-11 17:57:41,066 - DEBUG - VM is in ACTIVE state now 2025-08-11 17:57:41,066 - INFO - VM name : dest_vm 2025-08-11 17:57:41,155 - DEBUG - VM dest_vm ID is 8f85f17c-e8d2-4908-851a-e8abb698281c 2025-08-11 17:57:41,155 - DEBUG - VM dest_vm launched on Node an-jenkins-deploy-platform-ansible-os-3816-1 2025-08-11 17:57:41,241 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/8f85f17c-e8d2-4908-851a-e8abb698281c 2025-08-11 17:57:41,253 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/00c6eb3a-d54e-4282-b053-6f75e5f6af44 2025-08-11 17:57:42,463 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.16 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.339 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.339/1.748/3.158/1.409 ms') 2025-08-11 17:57:42,464 - INFO - Ping to Metadata IP 169.254.0.3 of VM dest_vm passed 2025-08-11 17:57:42,578 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 17:57:42,578 - DEBUG - Waiting to SSH to VM dest_vm, IP 103.108.239.67, Port 22 2025-08-11 17:57:42,730 - DEBUG - VM dest_vm is ready for SSH connections 2025-08-11 17:57:42,736 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6sr, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:test_vnv6dn, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-11 17:57:43,056 - INFO - Attaching policy allow_all to vn test_vnv6sr 2025-08-11 17:57:43,400 - INFO - Attaching policy allow_all to vn test_vnv6dn 2025-08-11 17:57:43,697 - INFO - Configure the policy with allow any 2025-08-11 17:57:44,011 - DEBUG - Response for create_network : {'network': {'id': 'a9ff4fd5-41b9-47c8-951d-4bf626b90a90', 'name': 'vn1', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'vn1'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:57:44,207 - DEBUG - Response for create_subnet : {'subnet': {'id': '123b66d6-0112-4ac3-a2dd-8be4369c8579', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': 'a9ff4fd5-41b9-47c8-951d-4bf626b90a90', 'ip_version': 4, 'cidr': '10.1.1.0/24', 'allocation_pools': [{'start': '10.1.1.2', 'end': '10.1.1.254'}], 'gateway_ip': '10.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.1.1.2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:57:44,229 - INFO - Created VN vn1 2025-08-11 17:57:44,242 - DEBUG - VN vn1 UUID is a9ff4fd5-41b9-47c8-951d-4bf626b90a90 2025-08-11 17:57:44,607 - DEBUG - Response for create_network : {'network': {'id': '18f1ff40-daf6-431e-9772-e37ac5d3e663', 'name': 'vn2', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'project_id': 'f0be8015365a463985d5db4705b5a1e7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-58512595', 'vn2'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:57:44,872 - DEBUG - Response for create_subnet : {'subnet': {'id': '0413ddff-49a2-4af7-b8a9-99b6b3e81fab', 'name': '', 'tenant_id': 'f0be8015365a463985d5db4705b5a1e7', 'network_id': '18f1ff40-daf6-431e-9772-e37ac5d3e663', 'ip_version': 4, 'cidr': '20.1.1.0/24', 'allocation_pools': [{'start': '20.1.1.2', 'end': '20.1.1.254'}], 'gateway_ip': '20.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.1.1.2', 'tags': [], 'project_id': 'f0be8015365a463985d5db4705b5a1e7'}} 2025-08-11 17:57:44,891 - INFO - Created VN vn2 2025-08-11 17:57:44,903 - DEBUG - VN vn2 UUID is 18f1ff40-daf6-431e-9772-e37ac5d3e663 2025-08-11 17:57:45,010 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:vn1, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-58512595:vn2, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-11 17:57:45,329 - INFO - Attaching policy sec_grp_policy_ctest-random-46475835 to vn vn1 2025-08-11 17:57:45,674 - INFO - Attaching policy sec_grp_policy_ctest-random-46475835 to vn vn2 2025-08-11 17:57:47,153 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-2) 2025-08-11 17:57:48,371 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-1) 2025-08-11 17:57:48,429 - INFO - ================================================================================ 2025-08-11 17:57:48,430 - INFO - STARTING TEST : test_create_md5_on_control 2025-08-11 17:57:48,430 - INFO - TEST DESCRIPTION : Description: Verify md5 with allow specific protocol on all ports and policy with allow all between VN's 2025-08-11 17:57:49,710 - DEBUG - Skipping xmpp flap check 2025-08-11 17:57:49,710 - INFO - Initial checks done. Running the testcase now 2025-08-11 17:57:49,710 - INFO - 2025-08-11 17:57:49,710 - INFO - config md5 on each host with auth_data None 2025-08-11 17:57:49,710 - INFO - config per peer with auth_data None 2025-08-11 17:57:50,266 - INFO - configure MD5 on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:57:50,350 - INFO - config per peer with auth_data None 2025-08-11 17:57:50,954 - INFO - configure MD5 on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:57:51,042 - INFO - config per peer with auth_data None 2025-08-11 17:57:51,590 - INFO - configure MD5 on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:57:51,674 - INFO - check if BGP between peers are up before setting md5 2025-08-11 17:57:51,674 - INFO - Check BGP staus between peers 2025-08-11 17:57:51,685 - INFO - setting MD5 config on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:57:51,685 - INFO - configure MD5 on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:57:51,770 - INFO - setting MD5 config on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:57:51,771 - INFO - configure MD5 on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:57:51,846 - INFO - setting MD5 config on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:57:51,847 - INFO - configure MD5 on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:57:51,926 - INFO - check if BGP peering is up after md5 config 2025-08-11 17:57:51,926 - INFO - Check BGP staus between peers 2025-08-11 17:57:51,935 - DEBUG - Check the BGP connection on 10.0.0.27 2025-08-11 17:57:51,935 - DEBUG - Check the BGP connection on 10.0.0.27 2025-08-11 17:58:01,936 - INFO - Check BGP staus between peers 2025-08-11 17:58:01,946 - INFO - remove md5 configured on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:58:01,946 - INFO - config per peer with auth_data None 2025-08-11 17:58:02,482 - INFO - configure MD5 on host f5c340e9-2b44-4f4b-b88a-d0029b0ec5a4 2025-08-11 17:58:02,566 - INFO - remove md5 configured on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:58:02,566 - INFO - config per peer with auth_data None 2025-08-11 17:58:03,134 - INFO - configure MD5 on host 362390bf-d171-49f5-9d4c-927b10d4f818 2025-08-11 17:58:03,218 - INFO - remove md5 configured on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:58:03,218 - INFO - config per peer with auth_data None 2025-08-11 17:58:03,822 - INFO - configure MD5 on host bd97fd78-99c5-4f31-8434-bd502819c71f 2025-08-11 17:58:03,906 - INFO - Skip interface_detach for VM vn2_vm_0 in state BUILD 2025-08-11 17:58:03,906 - INFO - Deleting VM vn2_vm_0 2025-08-11 17:58:03,906 - ERROR - VM vn2_vm_0 has failed to come up 2025-08-11 17:58:03,907 - ERROR - Nova failed to get host of the VM 2025-08-11 17:58:03,907 - ERROR - VM vn2_vm_0 has failed to come up 2025-08-11 17:58:03,907 - ERROR - Nova failed to get host of the VM 2025-08-11 17:58:03,967 - INFO - Skip interface_detach for VM vn1_vm_0 in state BUILD 2025-08-11 17:58:03,967 - INFO - Deleting VM vn1_vm_0 2025-08-11 17:58:03,968 - ERROR - VM vn1_vm_0 has failed to come up 2025-08-11 17:58:03,968 - ERROR - Nova failed to get host of the VM 2025-08-11 17:58:03,968 - ERROR - VM vn1_vm_0 has failed to come up 2025-08-11 17:58:03,968 - ERROR - Nova failed to get host of the VM 2025-08-11 17:58:04,026 - INFO - Dettaching policy sec_grp_policy_ctest-random-46475835 from vn vn2 2025-08-11 17:58:04,205 - INFO - Dettaching policy sec_grp_policy_ctest-random-46475835 from vn vn1 2025-08-11 17:58:04,459 - INFO - Deleted policy sec_grp_policy_ctest-random-46475835 2025-08-11 17:58:04,459 - INFO - Deleting VN vn2 2025-08-11 17:58:04,513 - DEBUG - VN 18f1ff40-daf6-431e-9772-e37ac5d3e663 still in use: Unable to complete operation on network 18f1ff40-daf6-431e-9772-e37ac5d3e663. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0222a14a-403b-4f12-9976-ff824b2e878d'] 2025-08-11 17:58:04,514 - WARNING - Deleting VN vn2 failed..Will retry 2025-08-11 17:58:06,653 - DEBUG - Response for deleting network () 2025-08-11 17:58:06,654 - INFO - Deleting VN vn1 2025-08-11 17:58:06,799 - DEBUG - Response for deleting network () 2025-08-11 17:58:06,799 - INFO - Dettaching policy allow_all from vn test_vnv6dn 2025-08-11 17:58:07,001 - INFO - Dettaching policy allow_all from vn test_vnv6sr 2025-08-11 17:58:07,270 - INFO - Deleted policy allow_all 2025-08-11 17:58:07,270 - INFO - Deleting VM dest_vm 2025-08-11 17:58:07,339 - INFO - Deleting VM source_vm 2025-08-11 17:58:07,399 - INFO - Deleting VN test_vnv6dn 2025-08-11 17:58:07,463 - DEBUG - VN 9ce4f6f5-d8ba-4480-81c6-7c9121bfaefa still in use: Unable to complete operation on network 9ce4f6f5-d8ba-4480-81c6-7c9121bfaefa. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-42617131-558b-40aa-9e06-3a762d722f93'] 2025-08-11 17:58:07,463 - WARNING - Deleting VN test_vnv6dn failed..Will retry 2025-08-11 17:58:09,668 - DEBUG - Response for deleting network () 2025-08-11 17:58:09,668 - INFO - Deleting VN test_vnv6sr 2025-08-11 17:58:09,842 - DEBUG - Response for deleting network () 2025-08-11 17:58:11,091 - DEBUG - Skipping xmpp flap check 2025-08-11 17:58:11,091 - INFO - END TEST : test_create_md5_on_control : PASSED[0:00:23] 2025-08-11 17:58:11,091 - INFO - -------------------------------------------------------------------------------- 2025-08-11 17:58:11,831 - INFO - Deleted project: ctest-TestMd5testsOnControl-58512595, ID : f0be8015-365a-4639-85d5-db4705b5a1e7