2025-11-03 03:58:54,908 - INFO - Domain Default found not creating 2025-11-03 03:58:55,040 - INFO - Project ctest-TestBGPaasZone-28889712 not found, creating it 2025-11-03 03:58:55,537 - INFO - Created Project:ctest-TestBGPaasZone-28889712, ID : 9d22eaba-c211-4867-93e1-7a591286c3be 2025-11-03 03:58:56,984 - DEBUG - Services list from nova: [, , , ] 2025-11-03 03:58:56,985 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4597-1', 'an-jenkins-deploy-platform-ansible-os-4597-2']} 2025-11-03 03:58:56,987 - INFO - ================================================================================ 2025-11-03 03:58:56,987 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-11-03 03:58:58,259 - DEBUG - Skipping xmpp flap check 2025-11-03 03:58:58,259 - INFO - Initial checks done. Running the testcase now 2025-11-03 03:58:58,259 - INFO - 2025-11-03 03:58:58,259 - INFO - executing bgp_control_zone test 2025-11-03 03:58:58,986 - DEBUG - Response for create_network : {'network': {'id': '7ea94abf-1187-4c39-a919-a2b867ea4d55', 'name': 'ctest-cnz_vn-91829151', 'tenant_id': '9d22eabac211486793e17a591286c3be', 'project_id': '9d22eabac211486793e17a591286c3be', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-28889712', 'ctest-cnz_vn-91829151'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:58:59,297 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f9aef652-e444-4c06-a51e-7e6bf1365ed1', 'name': '', 'tenant_id': '9d22eabac211486793e17a591286c3be', 'network_id': '7ea94abf-1187-4c39-a919-a2b867ea4d55', 'ip_version': 4, 'cidr': '206.40.218.128/26', 'allocation_pools': [{'start': '206.40.218.130', 'end': '206.40.218.190'}], 'gateway_ip': '206.40.218.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.40.218.130', 'tags': [], 'project_id': '9d22eabac211486793e17a591286c3be'}} 2025-11-03 03:58:59,321 - INFO - Created VN ctest-cnz_vn-91829151 2025-11-03 03:58:59,337 - DEBUG - VN ctest-cnz_vn-91829151 UUID is 7ea94abf-1187-4c39-a919-a2b867ea4d55 2025-11-03 03:59:00,491 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 03:59:01,918 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2) 2025-11-03 03:59:03,591 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 03:59:03,591 - INFO - Waiting for VM ctest-TestBGPaasZone-28889712-03771591 to be up.. 2025-11-03 03:59:03,730 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:08,861 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:13,981 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:19,058 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:24,145 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:29,231 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:34,311 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:39,394 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 03:59:44,480 - DEBUG - VM is in ACTIVE state now 2025-11-03 03:59:44,480 - INFO - VM name : ctest-TestBGPaasZone-28889712-03771591 2025-11-03 03:59:44,552 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 ID is 6c857eee-248c-4608-b92b-d5cc27184043 2025-11-03 03:59:44,575 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 launched on Node an-jenkins-deploy-platform-ansible-os-4597-1 2025-11-03 03:59:44,668 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6c857eee-248c-4608-b92b-d5cc27184043 2025-11-03 03:59:44,961 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6c857eee-248c-4608-b92b-d5cc27184043 2025-11-03 03:59:44,995 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/209bb217-541e-487e-9f34-09549afc3dc4 2025-11-03 03:59:48,158 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-03 03:59:48,158 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 03:59:48,175 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 03:59:52,263 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-03 03:59:52,263 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 03:59:52,280 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 03:59:56,350 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-03 03:59:56,350 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 03:59:56,364 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:00,450 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-11-03 04:00:00,450 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:00,465 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:04,548 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-03 04:00:04,548 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:04,567 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:08,648 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-11-03 04:00:08,648 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:08,663 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:12,734 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-03 04:00:12,734 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:12,748 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:16,835 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-11-03 04:00:16,835 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:16,850 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:20,933 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-03 04:00:20,934 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:20,950 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:25,029 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-03 04:00:25,029 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:25,043 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:29,123 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-03 04:00:29,124 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:29,145 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:33,219 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-11-03 04:00:33,219 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:33,232 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:37,317 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-03 04:00:37,317 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:37,332 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:41,413 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-03 04:00:41,413 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:41,427 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:45,509 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-03 04:00:45,509 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:45,523 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:49,605 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-03 04:00:49,605 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:49,619 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:53,700 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-03 04:00:53,700 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 failed! 2025-11-03 04:00:53,713 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-91829151 is 206.40.218.129 and allocation pool is NOT set 2025-11-03 04:00:55,784 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.79 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.44 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.436/2.611/2.786/0.175 ms') 2025-11-03 04:00:55,784 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-03771591 passed 2025-11-03 04:00:55,852 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:00:55,852 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:00:55,918 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:00:56,033 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:01,033 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:01,033 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:01,099 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:01,184 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:06,185 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:06,185 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:06,251 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:06,343 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:11,343 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:11,343 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:11,410 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:11,488 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:16,489 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:16,489 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:16,555 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:16,638 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:21,639 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:21,639 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:21,697 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:21,780 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:26,780 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:26,781 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:26,836 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:26,919 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:31,920 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:31,920 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:31,987 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:32,069 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:37,070 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:37,070 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:37,124 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:01:37,220 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:01:42,220 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:42,221 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-03771591, IP 206.40.218.131, Port 22 2025-11-03 04:01:42,391 - DEBUG - VM ctest-TestBGPaasZone-28889712-03771591 is ready for SSH connections 2025-11-03 04:01:42,391 - INFO - Waiting for VM ctest-TestBGPaasZone-28889712-91422177 to be up.. 2025-11-03 04:01:42,486 - DEBUG - VM is in ACTIVE state now 2025-11-03 04:01:42,486 - INFO - VM name : ctest-TestBGPaasZone-28889712-91422177 2025-11-03 04:01:42,579 - DEBUG - VM ctest-TestBGPaasZone-28889712-91422177 ID is 1dc863ae-b99b-4efe-affa-e2a874321b53 2025-11-03 04:01:42,579 - DEBUG - VM ctest-TestBGPaasZone-28889712-91422177 launched on Node an-jenkins-deploy-platform-ansible-os-4597-2 2025-11-03 04:01:42,666 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/1dc863ae-b99b-4efe-affa-e2a874321b53 2025-11-03 04:01:42,681 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/1a88f8c3-2bcd-4124-898c-b6169ffedc2a 2025-11-03 04:01:43,854 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.83 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.515 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.515/2.670/4.825/2.155 ms') 2025-11-03 04:01:43,854 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-91422177 passed 2025-11-03 04:01:43,924 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:43,924 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-91422177, IP 206.40.218.132, Port 22 2025-11-03 04:01:44,093 - DEBUG - VM ctest-TestBGPaasZone-28889712-91422177 is ready for SSH connections 2025-11-03 04:01:44,093 - INFO - Waiting for VM ctest-TestBGPaasZone-28889712-79077349 to be up.. 2025-11-03 04:01:44,169 - DEBUG - VM is in ACTIVE state now 2025-11-03 04:01:44,169 - INFO - VM name : ctest-TestBGPaasZone-28889712-79077349 2025-11-03 04:01:44,249 - DEBUG - VM ctest-TestBGPaasZone-28889712-79077349 ID is e67df40a-c114-4019-b75b-618905933673 2025-11-03 04:01:44,249 - DEBUG - VM ctest-TestBGPaasZone-28889712-79077349 launched on Node an-jenkins-deploy-platform-ansible-os-4597-1 2025-11-03 04:01:44,328 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e67df40a-c114-4019-b75b-618905933673 2025-11-03 04:01:44,339 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/f7e9ad10-94ea-4fa6-b6c9-64125bfcec3c 2025-11-03 04:01:45,504 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.15 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=7.80 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.154/5.478/7.802/2.324 ms') 2025-11-03 04:01:45,504 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-28889712-79077349 passed 2025-11-03 04:01:45,571 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:45,571 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-79077349, IP 206.40.218.133, Port 22 2025-11-03 04:01:45,742 - DEBUG - VM ctest-TestBGPaasZone-28889712-79077349 is ready for SSH connections 2025-11-03 04:01:45,883 - INFO - Created control node zone ctest-test-zone-48766137(e189aabf-6829-4eb0-ade3-5e3247d95cb0) 2025-11-03 04:01:46,239 - INFO - Created control node zone ctest-test-zone-89656849(34e83d95-3e8c-4d48-9fa8-7843fff340b3) 2025-11-03 04:01:46,583 - INFO - Created control node zone ctest-test-zone-45211692(a8a54493-7215-412e-b002-85b8d22dbaea) 2025-11-03 04:01:46,871 - INFO - Creating BGPaaS ctest-TestBGPaasZone-28889712-91377035 2025-11-03 04:01:46,947 - INFO - BGPaaS: ctest-TestBGPaasZone-28889712-91377035(15317c32-67c7-4150-910c-419f1b02b5f7) 2025-11-03 04:01:46,947 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:01:47,245 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:01:47,275 - INFO - verify_in_api_server passed for BGPaaS obj 15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:01:47,276 - INFO - BGPaaS(15317c32-67c7-4150-910c-419f1b02b5f7): verify_on_setup passed 2025-11-03 04:01:47,276 - INFO - We will configure BGP on the VM 2025-11-03 04:01:47,523 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:01:47,523 - INFO - Configuring BGP on ctest-TestBGPaasZone-28889712-03771591 2025-11-03 04:01:47,523 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:01:47,523 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS 2025-11-03 04:02:00,144 - DEBUG - None 2025-11-03 04:02:00,145 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:00,145 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS 2025-11-03 04:02:01,079 - DEBUG - None 2025-11-03 04:02:01,079 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:01,079 - DEBUG - service bird restart 2025-11-03 04:02:04,124 - DEBUG - bird stop/waiting bird start/running, process 1431 2025-11-03 04:02:04,125 - INFO - Attaching VMI 209bb217-541e-487e-9f34-09549afc3dc4 to BGPaaS 15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:02:04,207 - INFO - Attaching the VMI 6c857eee-248c-4608-b92b-d5cc27184043 to the BGPaaS 15317c32-67c7-4150-910c-419f1b02b5f7 object 2025-11-03 04:02:04,207 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 206.40.218.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:04,207 - DEBUG - sudo ip addr add 206.40.218.148 dev eth0 2025-11-03 04:02:05,589 - DEBUG - None 2025-11-03 04:02:05,651 - INFO - Creating BGPaaS ctest-TestBGPaasZone-28889712-05425303 2025-11-03 04:02:05,739 - INFO - BGPaaS: ctest-TestBGPaasZone-28889712-05425303(22ba5047-057d-41f9-8b9d-09bf339b5841) 2025-11-03 04:02:05,739 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/22ba5047-057d-41f9-8b9d-09bf339b5841 2025-11-03 04:02:05,750 - INFO - verify_in_api_server passed for BGPaaS obj 22ba5047-057d-41f9-8b9d-09bf339b5841 2025-11-03 04:02:05,750 - INFO - BGPaaS(22ba5047-057d-41f9-8b9d-09bf339b5841): verify_on_setup passed 2025-11-03 04:02:05,750 - INFO - We will configure BGP on the VM 2025-11-03 04:02:06,023 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:02:06,023 - INFO - Configuring BGP on ctest-TestBGPaasZone-28889712-91422177 2025-11-03 04:02:06,023 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.132; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.132; } protocol bfd { neighbor 206.40.218.130 local 206.40.218.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:02:06,024 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.132; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.132; } protocol bfd { neighbor 206.40.218.130 local 206.40.218.132 multihop on; } EOS 2025-11-03 04:02:12,414 - DEBUG - None 2025-11-03 04:02:12,414 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.132; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.132; } protocol bfd { neighbor 206.40.218.130 local 206.40.218.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:02:12,414 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.132; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.132; } protocol bfd { neighbor 206.40.218.130 local 206.40.218.132 multihop on; } EOS 2025-11-03 04:02:12,914 - DEBUG - None 2025-11-03 04:02:12,914 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:02:12,915 - DEBUG - service bird restart 2025-11-03 04:02:14,635 - DEBUG - bird stop/waiting bird start/running, process 1431 2025-11-03 04:02:14,635 - INFO - Attaching VMI 1a88f8c3-2bcd-4124-898c-b6169ffedc2a to BGPaaS 22ba5047-057d-41f9-8b9d-09bf339b5841 2025-11-03 04:02:14,711 - INFO - Attaching the VMI 1dc863ae-b99b-4efe-affa-e2a874321b53 to the BGPaaS 22ba5047-057d-41f9-8b9d-09bf339b5841 object 2025-11-03 04:02:14,711 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 206.40.218.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:02:14,711 - DEBUG - sudo ip addr add 206.40.218.148 dev eth0 2025-11-03 04:02:15,350 - DEBUG - None 2025-11-03 04:02:15,350 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:02:15,350 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:02:15,372 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-03 04:02:15,378 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:02:15,399 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-03 04:02:21,422 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-03 04:02:27,444 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-03 04:02:27,451 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 206.40.218.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:27,451 - DEBUG - ping -s 56 -c 3 -W 1 206.40.218.148 2025-11-03 04:02:33,707 - DEBUG - PING 206.40.218.148 (206.40.218.148) 56(84) bytes of data. 64 bytes from 206.40.218.148: icmp_seq=1 ttl=64 time=9.78 ms 64 bytes from 206.40.218.148: icmp_seq=2 ttl=64 time=1.23 ms 64 bytes from 206.40.218.148: icmp_seq=3 ttl=64 time=0.757 ms --- 206.40.218.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.757/3.923/9.780/4.146 ms 2025-11-03 04:02:33,707 - INFO - Ping to IP 206.40.218.148 from VM ctest-TestBGPaasZone-28889712-79077349 passed 2025-11-03 04:02:34,531 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:34,531 - DEBUG - service bird restart 2025-11-03 04:02:36,085 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-11-03 04:02:36,086 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:02:36,086 - DEBUG - service bird restart 2025-11-03 04:02:37,669 - DEBUG - bird stop/waiting bird start/running, process 1458 2025-11-03 04:02:37,669 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:02:37,686 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-11-03 04:02:43,701 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-03 04:02:43,709 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:02:43,728 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-03 04:02:49,751 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-03 04:02:49,756 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 206.40.218.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:49,756 - DEBUG - ping -s 56 -c 3 -W 1 206.40.218.148 2025-11-03 04:02:52,239 - DEBUG - PING 206.40.218.148 (206.40.218.148) 56(84) bytes of data. 64 bytes from 206.40.218.148: icmp_seq=1 ttl=64 time=6.49 ms 64 bytes from 206.40.218.148: icmp_seq=2 ttl=64 time=1.40 ms 64 bytes from 206.40.218.148: icmp_seq=3 ttl=64 time=1.25 ms --- 206.40.218.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.252/3.051/6.498/2.438 ms 2025-11-03 04:02:52,239 - INFO - Ping to IP 206.40.218.148 from VM ctest-TestBGPaasZone-28889712-79077349 passed 2025-11-03 04:02:52,544 - INFO - We will configure BGP on the VM 2025-11-03 04:02:52,747 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:02:52,747 - INFO - Configuring BGP on ctest-TestBGPaasZone-28889712-03771591 2025-11-03 04:02:52,747 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:52,747 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS 2025-11-03 04:02:53,210 - DEBUG - None 2025-11-03 04:02:53,210 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:53,210 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 206.40.218.131; protocol bgp bgp_1{ local as 65000; neighbor 206.40.218.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 206.40.218.131; } protocol bfd { neighbor 206.40.218.129 local 206.40.218.131 multihop on; } EOS 2025-11-03 04:02:53,721 - DEBUG - None 2025-11-03 04:02:53,721 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:53,721 - DEBUG - service bird restart 2025-11-03 04:02:55,326 - DEBUG - bird stop/waiting bird start/running, process 1501 2025-11-03 04:02:55,326 - INFO - Attaching VMI 209bb217-541e-487e-9f34-09549afc3dc4 to BGPaaS 15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:02:55,346 - INFO - Attaching the VMI 6c857eee-248c-4608-b92b-d5cc27184043 to the BGPaaS 15317c32-67c7-4150-910c-419f1b02b5f7 object 2025-11-03 04:02:55,347 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 206.40.218.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:55,347 - DEBUG - sudo ip addr add 206.40.218.148 dev eth0 2025-11-03 04:02:56,011 - DEBUG - RTNETLINK answers: File exists 2025-11-03 04:02:56,011 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:02:56,011 - DEBUG - service bird restart 2025-11-03 04:02:57,630 - DEBUG - bird stop/waiting bird start/running, process 1528 2025-11-03 04:02:57,630 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:02:57,630 - DEBUG - service bird restart 2025-11-03 04:02:59,240 - DEBUG - bird stop/waiting bird start/running, process 1480 2025-11-03 04:02:59,240 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:02:59,240 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:02:59,257 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-03 04:03:05,258 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:03:05,271 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-03 04:03:05,276 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:03:05,296 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-03 04:03:05,301 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 206.40.218.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:03:05,301 - DEBUG - ping -s 56 -c 3 -W 1 206.40.218.148 2025-11-03 04:03:07,760 - DEBUG - PING 206.40.218.148 (206.40.218.148) 56(84) bytes of data. 64 bytes from 206.40.218.148: icmp_seq=1 ttl=64 time=3.35 ms 64 bytes from 206.40.218.148: icmp_seq=2 ttl=64 time=1.15 ms 64 bytes from 206.40.218.148: icmp_seq=3 ttl=64 time=1.34 ms --- 206.40.218.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.156/1.949/3.352/0.995 ms 2025-11-03 04:03:07,760 - INFO - Ping to IP 206.40.218.148 from VM ctest-TestBGPaasZone-28889712-79077349 passed 2025-11-03 04:03:07,760 - INFO - Detaching VMI 209bb217-541e-487e-9f34-09549afc3dc4 from BGPaaS 15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:03:07,843 - INFO - Detaching VMI 1a88f8c3-2bcd-4124-898c-b6169ffedc2a from BGPaaS 22ba5047-057d-41f9-8b9d-09bf339b5841 2025-11-03 04:03:07,956 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-28889712-05425303(22ba5047-057d-41f9-8b9d-09bf339b5841) 2025-11-03 04:03:08,010 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/22ba5047-057d-41f9-8b9d-09bf339b5841 2025-11-03 04:03:08,026 - DEBUG - Response Code: 404 2025-11-03 04:03:08,027 - DEBUG - BGPaaS: 22ba5047-057d-41f9-8b9d-09bf339b5841 deleted from api server 2025-11-03 04:03:08,027 - INFO - BGPaaS(22ba5047-057d-41f9-8b9d-09bf339b5841): verify_on_cleanup passed 2025-11-03 04:03:08,027 - INFO - Detaching VMI 209bb217-541e-487e-9f34-09549afc3dc4 from BGPaaS 15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:03:08,071 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-28889712-91377035(15317c32-67c7-4150-910c-419f1b02b5f7) 2025-11-03 04:03:08,147 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/15317c32-67c7-4150-910c-419f1b02b5f7 2025-11-03 04:03:08,157 - DEBUG - Response Code: 404 2025-11-03 04:03:08,157 - DEBUG - BGPaaS: 15317c32-67c7-4150-910c-419f1b02b5f7 deleted from api server 2025-11-03 04:03:08,158 - INFO - BGPaaS(15317c32-67c7-4150-910c-419f1b02b5f7): verify_on_cleanup passed 2025-11-03 04:03:08,158 - INFO - Deleting Control node zone ctest-test-zone-45211692(a8a54493-7215-412e-b002-85b8d22dbaea) 2025-11-03 04:03:08,321 - INFO - Deleting Control node zone ctest-test-zone-89656849(34e83d95-3e8c-4d48-9fa8-7843fff340b3) 2025-11-03 04:03:08,480 - INFO - Deleting Control node zone ctest-test-zone-48766137(e189aabf-6829-4eb0-ade3-5e3247d95cb0) 2025-11-03 04:03:08,563 - INFO - Deleting VM ctest-TestBGPaasZone-28889712-79077349 2025-11-03 04:03:08,652 - INFO - Deleting VM ctest-TestBGPaasZone-28889712-91422177 2025-11-03 04:03:08,723 - INFO - Deleting VM ctest-TestBGPaasZone-28889712-03771591 2025-11-03 04:03:08,783 - INFO - Deleting VN ctest-cnz_vn-91829151 2025-11-03 04:03:08,827 - DEBUG - VN 7ea94abf-1187-4c39-a919-a2b867ea4d55 still in use: Unable to complete operation on network 7ea94abf-1187-4c39-a919-a2b867ea4d55. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-2267817a-8e8a-4cfa-be0d-7a50927a441e'] 2025-11-03 04:03:08,827 - WARNING - Deleting VN ctest-cnz_vn-91829151 failed..Will retry 2025-11-03 04:03:11,072 - DEBUG - Response for deleting network () 2025-11-03 04:03:12,356 - DEBUG - Skipping xmpp flap check 2025-11-03 04:03:12,356 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:16] 2025-11-03 04:03:12,356 - INFO - -------------------------------------------------------------------------------- 2025-11-03 04:03:12,359 - INFO - ================================================================================ 2025-11-03 04:03:12,359 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-11-03 04:03:13,632 - DEBUG - Skipping xmpp flap check 2025-11-03 04:03:13,632 - INFO - Initial checks done. Running the testcase now 2025-11-03 04:03:13,632 - INFO - 2025-11-03 04:03:13,632 - INFO - executing bgp_control_zone agent restart test 2025-11-03 04:03:13,943 - DEBUG - Response for create_network : {'network': {'id': 'f34612ba-d4a5-4835-9cca-c831984baa60', 'name': 'ctest-cnz_vn-62552083', 'tenant_id': '9d22eabac211486793e17a591286c3be', 'project_id': '9d22eabac211486793e17a591286c3be', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-28889712', 'ctest-cnz_vn-62552083'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 04:03:14,215 - DEBUG - Response for create_subnet : {'subnet': {'id': '374f74b9-eb96-4de5-98ce-7691f5389e15', 'name': '', 'tenant_id': '9d22eabac211486793e17a591286c3be', 'network_id': 'f34612ba-d4a5-4835-9cca-c831984baa60', 'ip_version': 4, 'cidr': '6.73.52.64/26', 'allocation_pools': [{'start': '6.73.52.66', 'end': '6.73.52.126'}], 'gateway_ip': '6.73.52.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '6.73.52.66', 'tags': [], 'project_id': '9d22eabac211486793e17a591286c3be'}} 2025-11-03 04:03:14,238 - INFO - Created VN ctest-cnz_vn-62552083 2025-11-03 04:03:14,253 - DEBUG - VN ctest-cnz_vn-62552083 UUID is f34612ba-d4a5-4835-9cca-c831984baa60 2025-11-03 04:03:15,417 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2) 2025-11-03 04:03:16,699 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 04:03:18,185 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2) 2025-11-03 04:03:18,186 - INFO - Waiting for VM ctest-TestBGPaasZone-28889712-17199789 to be up.. 2025-11-03 04:03:18,272 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 04:03:23,369 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 04:03:28,466 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 04:03:33,559 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-03 04:03:38,633 - DEBUG - VM is in ACTIVE state now 2025-11-03 04:03:38,633 - INFO - VM name : ctest-TestBGPaasZone-28889712-17199789 2025-11-03 04:03:38,711 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 ID is 86ae9c6d-adad-48ff-84d3-529665d0ca48 2025-11-03 04:03:38,711 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 launched on Node an-jenkins-deploy-platform-ansible-os-4597-2 2025-11-03 04:03:38,791 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/86ae9c6d-adad-48ff-84d3-529665d0ca48 2025-11-03 04:03:38,801 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/1674539e-a8fb-4db1-b34f-22f63581c6f7 2025-11-03 04:03:41,979 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2025-11-03 04:03:41,979 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:03:41,995 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:03:46,071 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-11-03 04:03:46,071 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:03:46,088 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:03:50,165 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-03 04:03:50,165 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:03:50,181 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:03:54,257 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-11-03 04:03:54,257 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:03:54,271 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:03:58,354 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-03 04:03:58,354 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:03:58,397 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:02,484 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-11-03 04:04:02,484 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:02,499 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:06,585 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-03 04:04:06,585 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:06,600 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:10,673 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-03 04:04:10,673 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:10,686 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:14,774 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-03 04:04:14,774 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:14,787 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:18,876 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-03 04:04:18,877 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:18,892 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:22,970 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-11-03 04:04:22,970 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:22,988 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:27,061 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-03 04:04:27,061 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:27,076 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:31,161 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-03 04:04:31,161 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:31,179 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:35,262 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-11-03 04:04:35,262 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:35,276 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:39,349 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-11-03 04:04:39,350 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:39,363 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:43,445 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-11-03 04:04:43,446 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:43,463 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:47,545 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-03 04:04:47,545 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:47,559 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:51,634 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-03 04:04:51,634 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:51,649 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:55,734 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-03 04:04:55,734 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:55,751 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:04:59,832 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-03 04:04:59,832 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:04:59,847 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:03,930 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-03 04:05:03,930 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:05:03,945 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:08,022 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-11-03 04:05:08,022 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:05:08,038 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:12,122 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-03 04:05:12,122 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:05:12,137 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:16,215 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-11-03 04:05:16,215 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:05:16,229 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:20,305 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-11-03 04:05:20,306 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:05:20,320 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:24,406 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-03 04:05:24,406 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:05:24,421 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:28,506 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-11-03 04:05:28,506 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 failed! 2025-11-03 04:05:28,523 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-28889712:ctest-cnz_vn-62552083 is 6.73.52.65 and allocation pool is NOT set 2025-11-03 04:05:30,584 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.97 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.96 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.963/4.965/6.968/2.002 ms') 2025-11-03 04:05:30,584 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-17199789 passed 2025-11-03 04:05:30,656 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:05:30,656 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:05:30,722 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:05:30,876 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:05:35,876 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:05:35,876 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:05:35,949 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:05:36,065 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:05:41,066 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:05:41,067 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:05:41,123 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:05:41,204 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:05:46,205 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:05:46,205 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:05:46,273 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:05:46,365 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:05:51,366 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:05:51,366 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:05:51,434 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:05:51,517 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:05:56,517 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:05:56,517 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:05:56,575 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:05:56,680 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:06:01,681 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:01,681 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:06:01,749 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:06:01,837 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:06:06,838 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:06,838 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:06:06,905 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:06:06,996 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:06:11,997 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:11,997 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:06:12,055 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:06:12,147 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:06:17,147 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:17,148 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:06:17,213 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 04:06:17,307 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 04:06:22,308 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:22,308 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-17199789, IP 6.73.52.67, Port 22 2025-11-03 04:06:22,473 - DEBUG - VM ctest-TestBGPaasZone-28889712-17199789 is ready for SSH connections 2025-11-03 04:06:22,473 - INFO - Waiting for VM ctest-TestBGPaasZone-28889712-77689564 to be up.. 2025-11-03 04:06:22,554 - DEBUG - VM is in ACTIVE state now 2025-11-03 04:06:22,554 - INFO - VM name : ctest-TestBGPaasZone-28889712-77689564 2025-11-03 04:06:22,642 - DEBUG - VM ctest-TestBGPaasZone-28889712-77689564 ID is b336d456-0b9f-405c-9449-93a5def1ebcf 2025-11-03 04:06:22,643 - DEBUG - VM ctest-TestBGPaasZone-28889712-77689564 launched on Node an-jenkins-deploy-platform-ansible-os-4597-1 2025-11-03 04:06:22,734 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b336d456-0b9f-405c-9449-93a5def1ebcf 2025-11-03 04:06:22,768 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/78d074b8-f3fc-4189-8652-d4490759ddac 2025-11-03 04:06:23,930 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.26 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.532 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.532/1.897/3.262/1.365 ms') 2025-11-03 04:06:23,930 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-28889712-77689564 passed 2025-11-03 04:06:24,001 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:24,001 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-77689564, IP 6.73.52.68, Port 22 2025-11-03 04:06:24,171 - DEBUG - VM ctest-TestBGPaasZone-28889712-77689564 is ready for SSH connections 2025-11-03 04:06:24,171 - INFO - Waiting for VM ctest-TestBGPaasZone-28889712-80699339 to be up.. 2025-11-03 04:06:24,256 - DEBUG - VM is in ACTIVE state now 2025-11-03 04:06:24,256 - INFO - VM name : ctest-TestBGPaasZone-28889712-80699339 2025-11-03 04:06:24,361 - DEBUG - VM ctest-TestBGPaasZone-28889712-80699339 ID is e3cb3038-672c-4215-8ce5-87ea853f69ef 2025-11-03 04:06:24,361 - DEBUG - VM ctest-TestBGPaasZone-28889712-80699339 launched on Node an-jenkins-deploy-platform-ansible-os-4597-2 2025-11-03 04:06:24,449 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e3cb3038-672c-4215-8ce5-87ea853f69ef 2025-11-03 04:06:24,460 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/21823de0-14ce-44da-b9e9-6eee72de364c 2025-11-03 04:06:25,624 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=7.50 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.76 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.756/5.128/7.501/2.372 ms') 2025-11-03 04:06:25,625 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-28889712-80699339 passed 2025-11-03 04:06:25,699 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:25,699 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-28889712-80699339, IP 6.73.52.69, Port 22 2025-11-03 04:06:25,885 - DEBUG - VM ctest-TestBGPaasZone-28889712-80699339 is ready for SSH connections 2025-11-03 04:06:26,023 - INFO - Created control node zone ctest-test-zone-73124459(6cdabd32-d71a-4a42-a261-180aae09dfac) 2025-11-03 04:06:26,367 - INFO - Created control node zone ctest-test-zone-55382629(1349394c-c6ee-4d2d-b4ec-3fdea8a1e383) 2025-11-03 04:06:26,727 - INFO - Created control node zone ctest-test-zone-45120292(0c6e16af-37f9-4a1e-868b-0ae65de15544) 2025-11-03 04:06:27,011 - INFO - Creating BGPaaS ctest-TestBGPaasZone-28889712-42349817 2025-11-03 04:06:27,087 - INFO - BGPaaS: ctest-TestBGPaasZone-28889712-42349817(2b9d4be2-a17a-422e-9cb6-a92630040b4a) 2025-11-03 04:06:27,087 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/2b9d4be2-a17a-422e-9cb6-a92630040b4a 2025-11-03 04:06:27,096 - INFO - verify_in_api_server passed for BGPaaS obj 2b9d4be2-a17a-422e-9cb6-a92630040b4a 2025-11-03 04:06:27,096 - INFO - BGPaaS(2b9d4be2-a17a-422e-9cb6-a92630040b4a): verify_on_setup passed 2025-11-03 04:06:27,096 - INFO - We will configure BGP on the VM 2025-11-03 04:06:27,535 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:27,535 - INFO - Configuring BGP on ctest-TestBGPaasZone-28889712-17199789 2025-11-03 04:06:27,535 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.73.52.67; protocol bgp bgp_1{ local as 65000; neighbor 6.73.52.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.67; } protocol bfd { neighbor 6.73.52.65 local 6.73.52.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:06:27,536 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.73.52.67; protocol bgp bgp_1{ local as 65000; neighbor 6.73.52.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.67; } protocol bfd { neighbor 6.73.52.65 local 6.73.52.67 multihop on; } EOS 2025-11-03 04:06:45,157 - DEBUG - None 2025-11-03 04:06:45,157 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 6.73.52.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.67; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:06:45,157 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 6.73.52.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.67; } EOS 2025-11-03 04:06:45,724 - DEBUG - None 2025-11-03 04:06:45,724 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:06:45,725 - DEBUG - service bird restart 2025-11-03 04:06:47,529 - DEBUG - bird stop/waiting bird start/running, process 1437 2025-11-03 04:06:47,529 - INFO - Attaching VMI 1674539e-a8fb-4db1-b34f-22f63581c6f7 to BGPaaS 2b9d4be2-a17a-422e-9cb6-a92630040b4a 2025-11-03 04:06:47,603 - INFO - Attaching the VMI 86ae9c6d-adad-48ff-84d3-529665d0ca48 to the BGPaaS 2b9d4be2-a17a-422e-9cb6-a92630040b4a object 2025-11-03 04:06:47,603 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 6.73.52.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:06:47,603 - DEBUG - sudo ip addr add 6.73.52.84 dev eth0 2025-11-03 04:06:48,254 - DEBUG - None 2025-11-03 04:06:48,323 - INFO - Creating BGPaaS ctest-TestBGPaasZone-28889712-07122520 2025-11-03 04:06:48,407 - INFO - BGPaaS: ctest-TestBGPaasZone-28889712-07122520(3558c6b8-b2a6-4f43-8480-cf2457323c3e) 2025-11-03 04:06:48,408 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/3558c6b8-b2a6-4f43-8480-cf2457323c3e 2025-11-03 04:06:48,447 - INFO - verify_in_api_server passed for BGPaaS obj 3558c6b8-b2a6-4f43-8480-cf2457323c3e 2025-11-03 04:06:48,447 - INFO - BGPaaS(3558c6b8-b2a6-4f43-8480-cf2457323c3e): verify_on_setup passed 2025-11-03 04:06:48,448 - INFO - We will configure BGP on the VM 2025-11-03 04:06:48,871 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:06:48,871 - INFO - Configuring BGP on ctest-TestBGPaasZone-28889712-77689564 2025-11-03 04:06:48,871 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.73.52.68; protocol bgp bgp_1{ local as 65000; neighbor 6.73.52.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.68; } protocol bfd { neighbor 6.73.52.65 local 6.73.52.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:06:48,871 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.73.52.68; protocol bgp bgp_1{ local as 65000; neighbor 6.73.52.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.68; } protocol bfd { neighbor 6.73.52.65 local 6.73.52.68 multihop on; } EOS 2025-11-03 04:07:00,650 - DEBUG - None 2025-11-03 04:07:00,650 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 6.73.52.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.68; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:07:00,650 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 6.73.52.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.73.52.68; } EOS 2025-11-03 04:07:01,139 - DEBUG - None 2025-11-03 04:07:01,139 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:07:01,140 - DEBUG - service bird restart 2025-11-03 04:07:02,789 - DEBUG - bird stop/waiting bird start/running, process 1446 2025-11-03 04:07:02,789 - INFO - Attaching VMI 78d074b8-f3fc-4189-8652-d4490759ddac to BGPaaS 3558c6b8-b2a6-4f43-8480-cf2457323c3e 2025-11-03 04:07:02,867 - INFO - Attaching the VMI b336d456-0b9f-405c-9449-93a5def1ebcf to the BGPaaS 3558c6b8-b2a6-4f43-8480-cf2457323c3e object 2025-11-03 04:07:02,867 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 6.73.52.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 04:07:02,867 - DEBUG - sudo ip addr add 6.73.52.84 dev eth0 2025-11-03 04:07:03,533 - DEBUG - None 2025-11-03 04:07:03,534 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:03,534 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:07:03,551 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-03 04:07:03,551 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:03,576 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-03 04:07:03,583 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:03,583 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:07:03,599 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-03 04:07:09,600 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:07:09,613 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-03 04:07:15,613 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:07:15,626 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-03 04:07:15,626 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:15,648 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-03 04:07:15,653 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 6.73.52.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:07:15,653 - DEBUG - ping -s 56 -c 3 -W 1 6.73.52.84 2025-11-03 04:07:27,059 - DEBUG - PING 6.73.52.84 (6.73.52.84) 56(84) bytes of data. 64 bytes from 6.73.52.84: icmp_seq=1 ttl=64 time=8.65 ms 64 bytes from 6.73.52.84: icmp_seq=2 ttl=64 time=1.14 ms 64 bytes from 6.73.52.84: icmp_seq=3 ttl=64 time=0.811 ms --- 6.73.52.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.811/3.536/8.657/3.623 ms 2025-11-03 04:07:27,059 - INFO - Ping to IP 6.73.52.84 from VM ctest-TestBGPaasZone-28889712-80699339 passed 2025-11-03 04:07:27,059 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:27,059 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:07:27,072 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-03 04:07:27,072 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:27,095 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-03 04:07:27,103 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:27,103 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-03 04:07:27,115 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-03 04:07:27,116 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 04:07:27,135 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-03 04:07:27,142 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 6.73.52.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-11-03 04:07:27,143 - DEBUG - ping -s 56 -c 3 -W 1 6.73.52.84 2025-11-03 04:07:29,638 - DEBUG - PING 6.73.52.84 (6.73.52.84) 56(84) bytes of data. 64 bytes from 6.73.52.84: icmp_seq=1 ttl=64 time=2.26 ms 64 bytes from 6.73.52.84: icmp_seq=2 ttl=64 time=0.915 ms 64 bytes from 6.73.52.84: icmp_seq=3 ttl=64 time=0.948 ms --- 6.73.52.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.915/1.375/2.264/0.629 ms 2025-11-03 04:07:29,638 - INFO - Ping to IP 6.73.52.84 from VM ctest-TestBGPaasZone-28889712-80699339 passed 2025-11-03 04:07:29,638 - INFO - Detaching VMI 78d074b8-f3fc-4189-8652-d4490759ddac from BGPaaS 3558c6b8-b2a6-4f43-8480-cf2457323c3e 2025-11-03 04:07:29,719 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-28889712-07122520(3558c6b8-b2a6-4f43-8480-cf2457323c3e) 2025-11-03 04:07:29,771 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/3558c6b8-b2a6-4f43-8480-cf2457323c3e 2025-11-03 04:07:29,777 - DEBUG - Response Code: 404 2025-11-03 04:07:29,778 - DEBUG - BGPaaS: 3558c6b8-b2a6-4f43-8480-cf2457323c3e deleted from api server 2025-11-03 04:07:29,778 - INFO - BGPaaS(3558c6b8-b2a6-4f43-8480-cf2457323c3e): verify_on_cleanup passed 2025-11-03 04:07:29,778 - INFO - Detaching VMI 1674539e-a8fb-4db1-b34f-22f63581c6f7 from BGPaaS 2b9d4be2-a17a-422e-9cb6-a92630040b4a 2025-11-03 04:07:29,863 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-28889712-42349817(2b9d4be2-a17a-422e-9cb6-a92630040b4a) 2025-11-03 04:07:29,911 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/2b9d4be2-a17a-422e-9cb6-a92630040b4a 2025-11-03 04:07:29,919 - DEBUG - Response Code: 404 2025-11-03 04:07:29,920 - DEBUG - BGPaaS: 2b9d4be2-a17a-422e-9cb6-a92630040b4a deleted from api server 2025-11-03 04:07:29,920 - INFO - BGPaaS(2b9d4be2-a17a-422e-9cb6-a92630040b4a): verify_on_cleanup passed 2025-11-03 04:07:29,920 - INFO - Deleting Control node zone ctest-test-zone-45120292(0c6e16af-37f9-4a1e-868b-0ae65de15544) 2025-11-03 04:07:30,071 - INFO - Deleting Control node zone ctest-test-zone-55382629(1349394c-c6ee-4d2d-b4ec-3fdea8a1e383) 2025-11-03 04:07:30,241 - INFO - Deleting Control node zone ctest-test-zone-73124459(6cdabd32-d71a-4a42-a261-180aae09dfac) 2025-11-03 04:07:30,421 - INFO - Deleting VM ctest-TestBGPaasZone-28889712-80699339 2025-11-03 04:07:30,524 - INFO - Deleting VM ctest-TestBGPaasZone-28889712-77689564 2025-11-03 04:07:30,587 - INFO - Deleting VM ctest-TestBGPaasZone-28889712-17199789 2025-11-03 04:07:30,654 - INFO - Deleting VN ctest-cnz_vn-62552083 2025-11-03 04:07:30,696 - DEBUG - VN f34612ba-d4a5-4835-9cca-c831984baa60 still in use: Unable to complete operation on network f34612ba-d4a5-4835-9cca-c831984baa60. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6a870e9f-36f8-4073-849f-0d0d3cec18c8'] 2025-11-03 04:07:30,696 - WARNING - Deleting VN ctest-cnz_vn-62552083 failed..Will retry 2025-11-03 04:07:32,881 - DEBUG - Response for deleting network () 2025-11-03 04:07:34,167 - DEBUG - Skipping xmpp flap check 2025-11-03 04:07:34,167 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:04:22] 2025-11-03 04:07:34,167 - INFO - -------------------------------------------------------------------------------- 2025-11-03 04:07:34,941 - INFO - Deleted project: ctest-TestBGPaasZone-28889712, ID : 9d22eaba-c211-4867-93e1-7a591286c3be