2025-07-22 17:44:30,515 - INFO - Domain Default found not creating 2025-07-22 17:44:30,658 - INFO - Project ctest-TestBGPaasZone-12365445 not found, creating it 2025-07-22 17:44:31,230 - INFO - Created Project:ctest-TestBGPaasZone-12365445, ID : 38f69b0d-de8b-4cc3-bd96-78c4f5a15e6a 2025-07-22 17:44:32,673 - DEBUG - Services list from nova: [, , , ] 2025-07-22 17:44:32,673 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3693-2', 'an-jenkins-deploy-platform-ansible-os-3693-1']} 2025-07-22 17:44:32,675 - INFO - ================================================================================ 2025-07-22 17:44:32,675 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-07-22 17:44:33,926 - DEBUG - Skipping xmpp flap check 2025-07-22 17:44:33,926 - INFO - Initial checks done. Running the testcase now 2025-07-22 17:44:33,926 - INFO - 2025-07-22 17:44:33,926 - INFO - executing bgp_control_zone test 2025-07-22 17:44:34,624 - DEBUG - Response for create_network : {'network': {'id': 'bfce279c-480e-414a-9b4f-d691f20ec435', 'name': 'ctest-cnz_vn-02005420', 'tenant_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a', 'project_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-12365445', 'ctest-cnz_vn-02005420'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 17:44:34,950 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e32abbf1-fd73-4305-af69-de2f64968eba', 'name': '', 'tenant_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a', 'network_id': 'bfce279c-480e-414a-9b4f-d691f20ec435', 'ip_version': 4, 'cidr': '62.53.147.192/26', 'allocation_pools': [{'start': '62.53.147.194', 'end': '62.53.147.254'}], 'gateway_ip': '62.53.147.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '62.53.147.194', 'tags': [], 'project_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a'}} 2025-07-22 17:44:34,975 - INFO - Created VN ctest-cnz_vn-02005420 2025-07-22 17:44:34,991 - DEBUG - VN ctest-cnz_vn-02005420 UUID is bfce279c-480e-414a-9b4f-d691f20ec435 2025-07-22 17:44:36,417 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2) 2025-07-22 17:44:37,749 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1) 2025-07-22 17:44:39,131 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2) 2025-07-22 17:44:39,131 - INFO - Waiting for VM ctest-TestBGPaasZone-12365445-61823691 to be up.. 2025-07-22 17:44:39,224 - DEBUG - VM is in ACTIVE state now 2025-07-22 17:44:39,224 - INFO - VM name : ctest-TestBGPaasZone-12365445-61823691 2025-07-22 17:44:39,309 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 ID is 01a0a12a-3983-425d-b90e-3699e015e29a 2025-07-22 17:44:39,337 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 launched on Node an-jenkins-deploy-platform-ansible-os-3693-2 2025-07-22 17:44:39,426 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/01a0a12a-3983-425d-b90e-3699e015e29a 2025-07-22 17:44:39,963 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/01a0a12a-3983-425d-b90e-3699e015e29a 2025-07-22 17:44:39,999 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/05555b26-25ec-4ec0-9415-2654311a7ed3 2025-07-22 17:44:43,264 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-07-22 17:44:43,264 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:44:43,280 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:44:47,358 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-07-22 17:44:47,358 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:44:47,374 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:44:51,450 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-07-22 17:44:51,450 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:44:51,470 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:44:55,550 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-07-22 17:44:55,550 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:44:55,568 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:44:59,641 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-07-22 17:44:59,641 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:44:59,657 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:03,743 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-07-22 17:45:03,744 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:03,761 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:07,839 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-07-22 17:45:07,839 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:07,858 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:11,937 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-07-22 17:45:11,937 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:11,954 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:16,029 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-07-22 17:45:16,030 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:16,050 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:20,125 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-07-22 17:45:20,125 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:20,144 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:24,218 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-07-22 17:45:24,218 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:24,236 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:28,311 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-07-22 17:45:28,311 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:28,327 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:32,412 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-07-22 17:45:32,412 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:32,429 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:36,506 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-07-22 17:45:36,506 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:36,522 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:40,604 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-07-22 17:45:40,604 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:40,622 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:44,702 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-07-22 17:45:44,703 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:44,720 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:48,797 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-07-22 17:45:48,797 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:48,816 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:52,891 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-07-22 17:45:52,892 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 failed! 2025-07-22 17:45:52,908 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-02005420 is 62.53.147.193 and allocation pool is NOT set 2025-07-22 17:45:54,975 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.493 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.493/2.569/4.646/2.076 ms') 2025-07-22 17:45:54,975 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-61823691 passed 2025-07-22 17:45:55,094 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:45:55,095 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:45:55,167 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:45:55,274 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:00,274 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:00,275 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:00,343 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:00,430 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:05,430 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:05,431 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:05,500 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:05,596 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:10,597 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:10,597 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:10,657 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:10,743 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:15,744 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:15,744 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:15,802 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:15,930 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:20,931 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:20,932 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:20,999 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:21,100 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:26,101 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:26,101 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:26,167 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:26,263 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:31,264 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:31,264 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:31,325 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:31,420 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:36,421 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:36,421 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:36,477 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:36,569 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:41,570 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:41,570 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:41,635 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:46:41,717 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:46:46,718 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:46,718 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-61823691, IP 62.53.147.195, Port 22 2025-07-22 17:46:46,883 - DEBUG - VM ctest-TestBGPaasZone-12365445-61823691 is ready for SSH connections 2025-07-22 17:46:46,884 - INFO - Waiting for VM ctest-TestBGPaasZone-12365445-02800422 to be up.. 2025-07-22 17:46:46,971 - DEBUG - VM is in ACTIVE state now 2025-07-22 17:46:46,971 - INFO - VM name : ctest-TestBGPaasZone-12365445-02800422 2025-07-22 17:46:47,059 - DEBUG - VM ctest-TestBGPaasZone-12365445-02800422 ID is fa9866ad-db32-4409-b4af-8ff6fc9d868c 2025-07-22 17:46:47,059 - DEBUG - VM ctest-TestBGPaasZone-12365445-02800422 launched on Node an-jenkins-deploy-platform-ansible-os-3693-1 2025-07-22 17:46:47,145 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/fa9866ad-db32-4409-b4af-8ff6fc9d868c 2025-07-22 17:46:47,159 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/4936149f-921d-43d4-a89f-51f21891656f 2025-07-22 17:46:48,375 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.33 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.43 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.429/2.879/4.329/1.450 ms') 2025-07-22 17:46:48,375 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-02800422 passed 2025-07-22 17:46:48,489 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:48,489 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-02800422, IP 62.53.147.196, Port 22 2025-07-22 17:46:48,655 - DEBUG - VM ctest-TestBGPaasZone-12365445-02800422 is ready for SSH connections 2025-07-22 17:46:48,655 - INFO - Waiting for VM ctest-TestBGPaasZone-12365445-57575268 to be up.. 2025-07-22 17:46:48,732 - DEBUG - VM is in ACTIVE state now 2025-07-22 17:46:48,732 - INFO - VM name : ctest-TestBGPaasZone-12365445-57575268 2025-07-22 17:46:48,811 - DEBUG - VM ctest-TestBGPaasZone-12365445-57575268 ID is 9addedf8-bd5b-4257-aed0-443362f620dc 2025-07-22 17:46:48,811 - DEBUG - VM ctest-TestBGPaasZone-12365445-57575268 launched on Node an-jenkins-deploy-platform-ansible-os-3693-2 2025-07-22 17:46:48,889 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/9addedf8-bd5b-4257-aed0-443362f620dc 2025-07-22 17:46:48,901 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/83000ad5-d9fb-4a8e-a8a1-5780baba63e3 2025-07-22 17:46:50,118 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.45 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.56 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.562/2.504/3.446/0.942 ms') 2025-07-22 17:46:50,118 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-12365445-57575268 passed 2025-07-22 17:46:50,238 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:50,239 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-57575268, IP 62.53.147.197, Port 22 2025-07-22 17:46:50,415 - DEBUG - VM ctest-TestBGPaasZone-12365445-57575268 is ready for SSH connections 2025-07-22 17:46:50,560 - INFO - Created control node zone ctest-test-zone-38425361(a1f71636-85a6-42dc-a771-834133d35379) 2025-07-22 17:46:50,928 - INFO - Created control node zone ctest-test-zone-87440800(af4f2f09-ca9e-40ce-ab12-d272bbf9f974) 2025-07-22 17:46:51,292 - INFO - Created control node zone ctest-test-zone-00167552(bbdc9e8f-8e63-48ad-8aa3-373ad90579f5) 2025-07-22 17:46:51,580 - INFO - Creating BGPaaS ctest-TestBGPaasZone-12365445-83412243 2025-07-22 17:46:51,656 - INFO - BGPaaS: ctest-TestBGPaasZone-12365445-83412243(db0fdcb0-6d54-4304-a774-17a5a491b7b5) 2025-07-22 17:46:51,656 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:46:51,946 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:46:51,981 - INFO - verify_in_api_server passed for BGPaaS obj db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:46:51,981 - INFO - BGPaaS(db0fdcb0-6d54-4304-a774-17a5a491b7b5): verify_on_setup passed 2025-07-22 17:46:51,981 - INFO - We will configure BGP on the VM 2025-07-22 17:46:52,240 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:46:52,240 - INFO - Configuring BGP on ctest-TestBGPaasZone-12365445-61823691 2025-07-22 17:46:52,240 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:46:52,240 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS 2025-07-22 17:47:03,963 - DEBUG - None 2025-07-22 17:47:03,963 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:03,963 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS 2025-07-22 17:47:05,009 - DEBUG - None 2025-07-22 17:47:05,009 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:05,009 - DEBUG - service bird restart 2025-07-22 17:47:08,459 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-07-22 17:47:08,459 - INFO - Attaching VMI 05555b26-25ec-4ec0-9415-2654311a7ed3 to BGPaaS db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:47:08,540 - INFO - Attaching the VMI 01a0a12a-3983-425d-b90e-3699e015e29a to the BGPaaS db0fdcb0-6d54-4304-a774-17a5a491b7b5 object 2025-07-22 17:47:08,540 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 62.53.147.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:08,540 - DEBUG - sudo ip addr add 62.53.147.212 dev eth0 2025-07-22 17:47:09,684 - DEBUG - None 2025-07-22 17:47:09,752 - INFO - Creating BGPaaS ctest-TestBGPaasZone-12365445-47964822 2025-07-22 17:47:09,832 - INFO - BGPaaS: ctest-TestBGPaasZone-12365445-47964822(3de41903-589c-4e3e-84fb-cd4520b05ddd) 2025-07-22 17:47:09,832 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/3de41903-589c-4e3e-84fb-cd4520b05ddd 2025-07-22 17:47:09,844 - INFO - verify_in_api_server passed for BGPaaS obj 3de41903-589c-4e3e-84fb-cd4520b05ddd 2025-07-22 17:47:09,844 - INFO - BGPaaS(3de41903-589c-4e3e-84fb-cd4520b05ddd): verify_on_setup passed 2025-07-22 17:47:09,844 - INFO - We will configure BGP on the VM 2025-07-22 17:47:10,112 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:47:10,112 - INFO - Configuring BGP on ctest-TestBGPaasZone-12365445-02800422 2025-07-22 17:47:10,112 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.196; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.196; } protocol bfd { neighbor 62.53.147.194 local 62.53.147.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:47:10,112 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.196; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.196; } protocol bfd { neighbor 62.53.147.194 local 62.53.147.196 multihop on; } EOS 2025-07-22 17:47:15,951 - DEBUG - None 2025-07-22 17:47:15,951 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.196; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.196; } protocol bfd { neighbor 62.53.147.194 local 62.53.147.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:47:15,952 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.196; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.196; } protocol bfd { neighbor 62.53.147.194 local 62.53.147.196 multihop on; } EOS 2025-07-22 17:47:16,468 - DEBUG - None 2025-07-22 17:47:16,468 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:47:16,468 - DEBUG - service bird restart 2025-07-22 17:47:18,356 - DEBUG - bird stop/waiting bird start/running, process 1443 2025-07-22 17:47:18,356 - INFO - Attaching VMI 4936149f-921d-43d4-a89f-51f21891656f to BGPaaS 3de41903-589c-4e3e-84fb-cd4520b05ddd 2025-07-22 17:47:18,444 - INFO - Attaching the VMI fa9866ad-db32-4409-b4af-8ff6fc9d868c to the BGPaaS 3de41903-589c-4e3e-84fb-cd4520b05ddd object 2025-07-22 17:47:18,444 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 62.53.147.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:47:18,445 - DEBUG - sudo ip addr add 62.53.147.212 dev eth0 2025-07-22 17:47:19,110 - DEBUG - None 2025-07-22 17:47:19,110 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:47:19,125 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-07-22 17:47:19,131 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:47:19,131 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:47:19,147 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-07-22 17:47:25,148 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:47:25,174 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-07-22 17:47:31,175 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:47:31,191 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-07-22 17:47:31,199 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 62.53.147.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:31,199 - DEBUG - ping -s 56 -c 3 -W 1 62.53.147.212 2025-07-22 17:47:37,594 - DEBUG - PING 62.53.147.212 (62.53.147.212) 56(84) bytes of data. 64 bytes from 62.53.147.212: icmp_seq=1 ttl=64 time=10.4 ms 64 bytes from 62.53.147.212: icmp_seq=2 ttl=64 time=1.28 ms 64 bytes from 62.53.147.212: icmp_seq=3 ttl=64 time=1.17 ms --- 62.53.147.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.170/4.317/10.493/4.367 ms 2025-07-22 17:47:37,594 - INFO - Ping to IP 62.53.147.212 from VM ctest-TestBGPaasZone-12365445-57575268 passed 2025-07-22 17:47:38,444 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:38,444 - DEBUG - service bird restart 2025-07-22 17:47:40,062 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-07-22 17:47:40,062 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:47:40,063 - DEBUG - service bird restart 2025-07-22 17:47:41,816 - DEBUG - bird stop/waiting bird start/running, process 1470 2025-07-22 17:47:41,816 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:47:41,836 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-07-22 17:47:47,857 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-07-22 17:47:47,864 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:47:47,864 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:47:47,883 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-07-22 17:47:53,884 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:47:53,904 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-07-22 17:47:53,913 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 62.53.147.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:53,913 - DEBUG - ping -s 56 -c 3 -W 1 62.53.147.212 2025-07-22 17:47:56,434 - DEBUG - PING 62.53.147.212 (62.53.147.212) 56(84) bytes of data. 64 bytes from 62.53.147.212: icmp_seq=1 ttl=64 time=4.40 ms 64 bytes from 62.53.147.212: icmp_seq=2 ttl=64 time=0.945 ms 64 bytes from 62.53.147.212: icmp_seq=3 ttl=64 time=0.802 ms --- 62.53.147.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.802/2.051/4.407/1.667 ms 2025-07-22 17:47:56,434 - INFO - Ping to IP 62.53.147.212 from VM ctest-TestBGPaasZone-12365445-57575268 passed 2025-07-22 17:47:56,752 - INFO - We will configure BGP on the VM 2025-07-22 17:47:56,976 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:47:56,976 - INFO - Configuring BGP on ctest-TestBGPaasZone-12365445-61823691 2025-07-22 17:47:56,976 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:56,976 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS 2025-07-22 17:47:57,471 - DEBUG - None 2025-07-22 17:47:57,471 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:57,471 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 62.53.147.195; protocol bgp bgp_1{ local as 65000; neighbor 62.53.147.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 62.53.147.195; } protocol bfd { neighbor 62.53.147.193 local 62.53.147.195 multihop on; } EOS 2025-07-22 17:47:57,983 - DEBUG - None 2025-07-22 17:47:57,983 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:57,983 - DEBUG - service bird restart 2025-07-22 17:47:59,696 - DEBUG - bird stop/waiting bird start/running, process 1501 2025-07-22 17:47:59,696 - INFO - Attaching VMI 05555b26-25ec-4ec0-9415-2654311a7ed3 to BGPaaS db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:47:59,724 - INFO - Attaching the VMI 01a0a12a-3983-425d-b90e-3699e015e29a to the BGPaaS db0fdcb0-6d54-4304-a774-17a5a491b7b5 object 2025-07-22 17:47:59,725 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 62.53.147.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:47:59,725 - DEBUG - sudo ip addr add 62.53.147.212 dev eth0 2025-07-22 17:48:00,416 - DEBUG - RTNETLINK answers: File exists 2025-07-22 17:48:00,416 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:48:00,416 - DEBUG - service bird restart 2025-07-22 17:48:02,137 - DEBUG - bird stop/waiting bird start/running, process 1528 2025-07-22 17:48:02,137 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:48:02,138 - DEBUG - service bird restart 2025-07-22 17:48:03,836 - DEBUG - bird stop/waiting bird start/running, process 1492 2025-07-22 17:48:03,836 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:48:03,850 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-07-22 17:48:09,866 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-07-22 17:48:09,877 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:48:09,877 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:48:09,896 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-07-22 17:48:09,906 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 62.53.147.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:48:09,906 - DEBUG - ping -s 56 -c 3 -W 1 62.53.147.212 2025-07-22 17:48:12,387 - DEBUG - PING 62.53.147.212 (62.53.147.212) 56(84) bytes of data. 64 bytes from 62.53.147.212: icmp_seq=1 ttl=64 time=4.00 ms 64 bytes from 62.53.147.212: icmp_seq=2 ttl=64 time=1.27 ms 64 bytes from 62.53.147.212: icmp_seq=3 ttl=64 time=1.27 ms --- 62.53.147.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.270/2.181/4.002/1.287 ms 2025-07-22 17:48:12,387 - INFO - Ping to IP 62.53.147.212 from VM ctest-TestBGPaasZone-12365445-57575268 passed 2025-07-22 17:48:12,388 - INFO - Detaching VMI 05555b26-25ec-4ec0-9415-2654311a7ed3 from BGPaaS db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:48:12,473 - INFO - Detaching VMI 4936149f-921d-43d4-a89f-51f21891656f from BGPaaS 3de41903-589c-4e3e-84fb-cd4520b05ddd 2025-07-22 17:48:12,584 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-12365445-47964822(3de41903-589c-4e3e-84fb-cd4520b05ddd) 2025-07-22 17:48:12,660 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/3de41903-589c-4e3e-84fb-cd4520b05ddd 2025-07-22 17:48:12,666 - DEBUG - Response Code: 404 2025-07-22 17:48:12,667 - DEBUG - BGPaaS: 3de41903-589c-4e3e-84fb-cd4520b05ddd deleted from api server 2025-07-22 17:48:12,667 - INFO - BGPaaS(3de41903-589c-4e3e-84fb-cd4520b05ddd): verify_on_cleanup passed 2025-07-22 17:48:12,667 - INFO - Detaching VMI 05555b26-25ec-4ec0-9415-2654311a7ed3 from BGPaaS db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:48:12,713 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-12365445-83412243(db0fdcb0-6d54-4304-a774-17a5a491b7b5) 2025-07-22 17:48:12,797 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/db0fdcb0-6d54-4304-a774-17a5a491b7b5 2025-07-22 17:48:12,804 - DEBUG - Response Code: 404 2025-07-22 17:48:12,804 - DEBUG - BGPaaS: db0fdcb0-6d54-4304-a774-17a5a491b7b5 deleted from api server 2025-07-22 17:48:12,804 - INFO - BGPaaS(db0fdcb0-6d54-4304-a774-17a5a491b7b5): verify_on_cleanup passed 2025-07-22 17:48:12,804 - INFO - Deleting Control node zone ctest-test-zone-00167552(bbdc9e8f-8e63-48ad-8aa3-373ad90579f5) 2025-07-22 17:48:12,966 - INFO - Deleting Control node zone ctest-test-zone-87440800(af4f2f09-ca9e-40ce-ab12-d272bbf9f974) 2025-07-22 17:48:13,119 - INFO - Deleting Control node zone ctest-test-zone-38425361(a1f71636-85a6-42dc-a771-834133d35379) 2025-07-22 17:48:13,212 - INFO - Deleting VM ctest-TestBGPaasZone-12365445-57575268 2025-07-22 17:48:13,288 - INFO - Deleting VM ctest-TestBGPaasZone-12365445-02800422 2025-07-22 17:48:13,360 - INFO - Deleting VM ctest-TestBGPaasZone-12365445-61823691 2025-07-22 17:48:13,421 - INFO - Deleting VN ctest-cnz_vn-02005420 2025-07-22 17:48:13,468 - DEBUG - VN bfce279c-480e-414a-9b4f-d691f20ec435 still in use: Unable to complete operation on network bfce279c-480e-414a-9b4f-d691f20ec435. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-fce19850-eb5e-469f-9401-d101de6919fa'] 2025-07-22 17:48:13,468 - WARNING - Deleting VN ctest-cnz_vn-02005420 failed..Will retry 2025-07-22 17:48:15,727 - DEBUG - Response for deleting network () 2025-07-22 17:48:16,989 - DEBUG - Skipping xmpp flap check
2025-07-22 17:48:16,989 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:03:44]
2025-07-22 17:48:16,989 - INFO - -------------------------------------------------------------------------------- 2025-07-22 17:48:16,992 - INFO - ================================================================================ 2025-07-22 17:48:16,992 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-07-22 17:48:18,276 - DEBUG - Skipping xmpp flap check 2025-07-22 17:48:18,276 - INFO - Initial checks done. Running the testcase now 2025-07-22 17:48:18,276 - INFO - 2025-07-22 17:48:18,276 - INFO - executing bgp_control_zone agent restart test 2025-07-22 17:48:18,588 - DEBUG - Response for create_network : {'network': {'id': 'e24d52f1-82f5-4162-9a32-b67652fa906c', 'name': 'ctest-cnz_vn-53495715', 'tenant_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a', 'project_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-12365445', 'ctest-cnz_vn-53495715'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 17:48:18,858 - DEBUG - Response for create_subnet : {'subnet': {'id': '2bf83318-2105-4d95-91d7-6ebe64881a06', 'name': '', 'tenant_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a', 'network_id': 'e24d52f1-82f5-4162-9a32-b67652fa906c', 'ip_version': 4, 'cidr': '78.252.102.128/26', 'allocation_pools': [{'start': '78.252.102.130', 'end': '78.252.102.190'}], 'gateway_ip': '78.252.102.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '78.252.102.130', 'tags': [], 'project_id': '38f69b0dde8b4cc3bd9678c4f5a15e6a'}} 2025-07-22 17:48:18,885 - INFO - Created VN ctest-cnz_vn-53495715 2025-07-22 17:48:18,901 - DEBUG - VN ctest-cnz_vn-53495715 UUID is e24d52f1-82f5-4162-9a32-b67652fa906c 2025-07-22 17:48:20,140 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1) 2025-07-22 17:48:21,560 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2) 2025-07-22 17:48:23,052 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1) 2025-07-22 17:48:23,052 - INFO - Waiting for VM ctest-TestBGPaasZone-12365445-67419855 to be up.. 2025-07-22 17:48:23,152 - DEBUG - VM is in ACTIVE state now 2025-07-22 17:48:23,152 - INFO - VM name : ctest-TestBGPaasZone-12365445-67419855 2025-07-22 17:48:23,243 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 ID is d8c5efeb-a0de-4086-98fe-85d95b960456 2025-07-22 17:48:23,243 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 launched on Node an-jenkins-deploy-platform-ansible-os-3693-1 2025-07-22 17:48:23,327 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/d8c5efeb-a0de-4086-98fe-85d95b960456 2025-07-22 17:48:23,339 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/e8370038-e4f3-4b2c-9b67-55867bec8e68 2025-07-22 17:48:26,595 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-07-22 17:48:26,595 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:26,611 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:30,692 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-07-22 17:48:30,692 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:30,709 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:34,790 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-07-22 17:48:34,790 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:34,807 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:38,886 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-07-22 17:48:38,886 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:38,903 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:42,983 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-07-22 17:48:42,984 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:43,002 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:47,074 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-07-22 17:48:47,074 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:47,095 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:51,170 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-07-22 17:48:51,170 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:51,189 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:55,274 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-07-22 17:48:55,275 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:55,291 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:48:59,364 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-07-22 17:48:59,364 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:48:59,383 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:03,466 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-07-22 17:49:03,466 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:03,483 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:07,553 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2025-07-22 17:49:07,553 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:07,573 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:11,656 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-07-22 17:49:11,656 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:11,673 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:15,743 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-07-22 17:49:15,743 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:15,760 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:19,845 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-07-22 17:49:19,845 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:19,863 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:23,939 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-07-22 17:49:23,939 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:23,956 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:28,038 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-07-22 17:49:28,038 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:28,064 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:32,130 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-07-22 17:49:32,130 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:32,149 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:36,225 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-07-22 17:49:36,225 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:36,298 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:40,389 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-07-22 17:49:40,389 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 failed! 2025-07-22 17:49:40,406 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-12365445:ctest-cnz_vn-53495715 is 78.252.102.129 and allocation pool is NOT set 2025-07-22 17:49:42,468 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.00 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.13 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.126/5.064/9.003/3.938 ms') 2025-07-22 17:49:42,468 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-67419855 passed 2025-07-22 17:49:42,586 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:49:42,587 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:49:42,655 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:49:42,821 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:49:47,822 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:49:47,823 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:49:47,891 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:49:48,017 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:49:53,018 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:49:53,018 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:49:53,077 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:49:53,159 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:49:58,160 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:49:58,160 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:49:58,227 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:49:58,320 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:50:03,321 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:03,321 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:50:03,382 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:50:03,472 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:50:08,473 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:08,473 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:50:08,544 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:50:08,641 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:50:13,642 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:13,642 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:50:13,701 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:50:13,784 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:50:18,785 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:18,785 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:50:18,850 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:50:18,931 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:50:23,932 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:23,932 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:50:23,998 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:50:24,092 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:50:29,094 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:29,094 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:50:29,159 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-22 17:50:29,260 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-22 17:50:34,261 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:34,261 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-67419855, IP 78.252.102.131, Port 22 2025-07-22 17:50:34,428 - DEBUG - VM ctest-TestBGPaasZone-12365445-67419855 is ready for SSH connections 2025-07-22 17:50:34,428 - INFO - Waiting for VM ctest-TestBGPaasZone-12365445-47931232 to be up.. 2025-07-22 17:50:34,534 - DEBUG - VM is in ACTIVE state now 2025-07-22 17:50:34,534 - INFO - VM name : ctest-TestBGPaasZone-12365445-47931232 2025-07-22 17:50:34,627 - DEBUG - VM ctest-TestBGPaasZone-12365445-47931232 ID is 56dbe814-af71-4b9f-8625-067aa0e99ede 2025-07-22 17:50:34,627 - DEBUG - VM ctest-TestBGPaasZone-12365445-47931232 launched on Node an-jenkins-deploy-platform-ansible-os-3693-2 2025-07-22 17:50:34,722 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/56dbe814-af71-4b9f-8625-067aa0e99ede 2025-07-22 17:50:34,759 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/70b7512e-882b-4a91-8e07-c09b56dcc61b 2025-07-22 17:50:35,992 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.712 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.712/2.181/3.650/1.469 ms') 2025-07-22 17:50:35,992 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-12365445-47931232 passed 2025-07-22 17:50:36,107 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:36,107 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-47931232, IP 78.252.102.132, Port 22 2025-07-22 17:50:36,279 - DEBUG - VM ctest-TestBGPaasZone-12365445-47931232 is ready for SSH connections 2025-07-22 17:50:36,279 - INFO - Waiting for VM ctest-TestBGPaasZone-12365445-47059316 to be up.. 2025-07-22 17:50:36,372 - DEBUG - VM is in ACTIVE state now 2025-07-22 17:50:36,372 - INFO - VM name : ctest-TestBGPaasZone-12365445-47059316 2025-07-22 17:50:36,464 - DEBUG - VM ctest-TestBGPaasZone-12365445-47059316 ID is e83dec63-55be-482a-a4c5-20d6bf0830d2 2025-07-22 17:50:36,464 - DEBUG - VM ctest-TestBGPaasZone-12365445-47059316 launched on Node an-jenkins-deploy-platform-ansible-os-3693-1 2025-07-22 17:50:36,547 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e83dec63-55be-482a-a4c5-20d6bf0830d2 2025-07-22 17:50:36,559 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/f3deb1e3-c13c-4346-b06b-68ab52ee707d 2025-07-22 17:50:37,774 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.77 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.67 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.668/2.717/3.767/1.049 ms') 2025-07-22 17:50:37,775 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-12365445-47059316 passed 2025-07-22 17:50:37,890 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:37,890 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12365445-47059316, IP 78.252.102.133, Port 22 2025-07-22 17:50:38,063 - DEBUG - VM ctest-TestBGPaasZone-12365445-47059316 is ready for SSH connections 2025-07-22 17:50:38,208 - INFO - Created control node zone ctest-test-zone-26888408(5c9ccc96-2a42-4f53-8deb-fcb4c226f21b) 2025-07-22 17:50:38,584 - INFO - Created control node zone ctest-test-zone-47323781(7be3a91c-4b42-4427-b257-74340f6d9bee) 2025-07-22 17:50:38,940 - INFO - Created control node zone ctest-test-zone-77632865(2fab3977-f8d4-4e06-898b-595e4e7ac926) 2025-07-22 17:50:39,236 - INFO - Creating BGPaaS ctest-TestBGPaasZone-12365445-19883429 2025-07-22 17:50:39,316 - INFO - BGPaaS: ctest-TestBGPaasZone-12365445-19883429(1bee2e2b-41c7-48bf-b85c-f897312bd2e9) 2025-07-22 17:50:39,317 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/1bee2e2b-41c7-48bf-b85c-f897312bd2e9 2025-07-22 17:50:39,329 - INFO - verify_in_api_server passed for BGPaaS obj 1bee2e2b-41c7-48bf-b85c-f897312bd2e9 2025-07-22 17:50:39,329 - INFO - BGPaaS(1bee2e2b-41c7-48bf-b85c-f897312bd2e9): verify_on_setup passed 2025-07-22 17:50:39,329 - INFO - We will configure BGP on the VM 2025-07-22 17:50:39,768 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:50:39,768 - INFO - Configuring BGP on ctest-TestBGPaasZone-12365445-67419855 2025-07-22 17:50:39,768 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 78.252.102.131; protocol bgp bgp_1{ local as 65000; neighbor 78.252.102.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.131; } protocol bfd { neighbor 78.252.102.129 local 78.252.102.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:50:39,768 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 78.252.102.131; protocol bgp bgp_1{ local as 65000; neighbor 78.252.102.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.131; } protocol bfd { neighbor 78.252.102.129 local 78.252.102.131 multihop on; } EOS 2025-07-22 17:50:53,340 - DEBUG - None 2025-07-22 17:50:53,340 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 78.252.102.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.131; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:50:53,340 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 78.252.102.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.131; } EOS 2025-07-22 17:50:54,378 - DEBUG - None 2025-07-22 17:50:54,378 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:50:54,378 - DEBUG - service bird restart 2025-07-22 17:50:58,016 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-07-22 17:50:58,016 - INFO - Attaching VMI e8370038-e4f3-4b2c-9b67-55867bec8e68 to BGPaaS 1bee2e2b-41c7-48bf-b85c-f897312bd2e9 2025-07-22 17:50:58,104 - INFO - Attaching the VMI d8c5efeb-a0de-4086-98fe-85d95b960456 to the BGPaaS 1bee2e2b-41c7-48bf-b85c-f897312bd2e9 object 2025-07-22 17:50:58,104 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 78.252.102.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:50:58,104 - DEBUG - sudo ip addr add 78.252.102.148 dev eth0 2025-07-22 17:50:59,460 - DEBUG - None 2025-07-22 17:50:59,528 - INFO - Creating BGPaaS ctest-TestBGPaasZone-12365445-93707269 2025-07-22 17:50:59,612 - INFO - BGPaaS: ctest-TestBGPaasZone-12365445-93707269(2643ef92-3d3d-4c04-b633-1769463dd8e4) 2025-07-22 17:50:59,612 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/2643ef92-3d3d-4c04-b633-1769463dd8e4 2025-07-22 17:50:59,624 - INFO - verify_in_api_server passed for BGPaaS obj 2643ef92-3d3d-4c04-b633-1769463dd8e4 2025-07-22 17:50:59,624 - INFO - BGPaaS(2643ef92-3d3d-4c04-b633-1769463dd8e4): verify_on_setup passed 2025-07-22 17:50:59,624 - INFO - We will configure BGP on the VM 2025-07-22 17:51:00,068 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:00,068 - INFO - Configuring BGP on ctest-TestBGPaasZone-12365445-47931232 2025-07-22 17:51:00,068 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 78.252.102.132; protocol bgp bgp_1{ local as 65000; neighbor 78.252.102.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.132; } protocol bfd { neighbor 78.252.102.129 local 78.252.102.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:51:00,068 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 78.252.102.132; protocol bgp bgp_1{ local as 65000; neighbor 78.252.102.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.132; } protocol bfd { neighbor 78.252.102.129 local 78.252.102.132 multihop on; } EOS 2025-07-22 17:51:05,660 - DEBUG - None 2025-07-22 17:51:05,660 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 78.252.102.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.132; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:51:05,660 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 78.252.102.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 78.252.102.132; } EOS 2025-07-22 17:51:06,183 - DEBUG - None 2025-07-22 17:51:06,183 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:51:06,183 - DEBUG - service bird restart 2025-07-22 17:51:07,912 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-07-22 17:51:07,912 - INFO - Attaching VMI 70b7512e-882b-4a91-8e07-c09b56dcc61b to BGPaaS 2643ef92-3d3d-4c04-b633-1769463dd8e4 2025-07-22 17:51:07,996 - INFO - Attaching the VMI 56dbe814-af71-4b9f-8625-067aa0e99ede to the BGPaaS 2643ef92-3d3d-4c04-b633-1769463dd8e4 object 2025-07-22 17:51:07,997 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 78.252.102.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-22 17:51:07,997 - DEBUG - sudo ip addr add 78.252.102.148 dev eth0 2025-07-22 17:51:08,669 - DEBUG - None 2025-07-22 17:51:08,669 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:08,683 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-07-22 17:51:08,683 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:08,683 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:51:08,699 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-07-22 17:51:08,706 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:08,720 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-07-22 17:51:14,735 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-07-22 17:51:20,749 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-07-22 17:51:20,749 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:20,749 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:51:20,766 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-07-22 17:51:20,772 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 78.252.102.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:51:20,772 - DEBUG - ping -s 56 -c 3 -W 1 78.252.102.148 2025-07-22 17:51:26,979 - DEBUG - PING 78.252.102.148 (78.252.102.148) 56(84) bytes of data. 64 bytes from 78.252.102.148: icmp_seq=1 ttl=64 time=7.17 ms 64 bytes from 78.252.102.148: icmp_seq=2 ttl=64 time=1.39 ms 64 bytes from 78.252.102.148: icmp_seq=3 ttl=64 time=1.34 ms --- 78.252.102.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.341/3.304/7.177/2.738 ms 2025-07-22 17:51:26,979 - INFO - Ping to IP 78.252.102.148 from VM ctest-TestBGPaasZone-12365445-47059316 passed 2025-07-22 17:51:26,979 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:26,993 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-07-22 17:51:26,993 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:26,993 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:51:27,016 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-07-22 17:51:27,025 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:27,043 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-07-22 17:51:27,044 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-22 17:51:27,044 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-07-22 17:51:27,077 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-07-22 17:51:27,085 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 78.252.102.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-07-22 17:51:27,085 - DEBUG - ping -s 56 -c 3 -W 1 78.252.102.148 2025-07-22 17:51:29,603 - DEBUG - PING 78.252.102.148 (78.252.102.148) 56(84) bytes of data. 64 bytes from 78.252.102.148: icmp_seq=1 ttl=64 time=4.19 ms 64 bytes from 78.252.102.148: icmp_seq=2 ttl=64 time=0.873 ms 64 bytes from 78.252.102.148: icmp_seq=3 ttl=64 time=0.852 ms --- 78.252.102.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.852/1.973/4.194/1.570 ms 2025-07-22 17:51:29,603 - INFO - Ping to IP 78.252.102.148 from VM ctest-TestBGPaasZone-12365445-47059316 passed 2025-07-22 17:51:29,603 - INFO - Detaching VMI 70b7512e-882b-4a91-8e07-c09b56dcc61b from BGPaaS 2643ef92-3d3d-4c04-b633-1769463dd8e4 2025-07-22 17:51:29,696 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-12365445-93707269(2643ef92-3d3d-4c04-b633-1769463dd8e4) 2025-07-22 17:51:29,787 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/2643ef92-3d3d-4c04-b633-1769463dd8e4 2025-07-22 17:51:29,797 - DEBUG - Response Code: 404 2025-07-22 17:51:29,797 - DEBUG - BGPaaS: 2643ef92-3d3d-4c04-b633-1769463dd8e4 deleted from api server 2025-07-22 17:51:29,797 - INFO - BGPaaS(2643ef92-3d3d-4c04-b633-1769463dd8e4): verify_on_cleanup passed 2025-07-22 17:51:29,797 - INFO - Detaching VMI e8370038-e4f3-4b2c-9b67-55867bec8e68 from BGPaaS 1bee2e2b-41c7-48bf-b85c-f897312bd2e9 2025-07-22 17:51:29,920 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-12365445-19883429(1bee2e2b-41c7-48bf-b85c-f897312bd2e9) 2025-07-22 17:51:30,024 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/1bee2e2b-41c7-48bf-b85c-f897312bd2e9 2025-07-22 17:51:30,031 - DEBUG - Response Code: 404 2025-07-22 17:51:30,031 - DEBUG - BGPaaS: 1bee2e2b-41c7-48bf-b85c-f897312bd2e9 deleted from api server 2025-07-22 17:51:30,031 - INFO - BGPaaS(1bee2e2b-41c7-48bf-b85c-f897312bd2e9): verify_on_cleanup passed 2025-07-22 17:51:30,031 - INFO - Deleting Control node zone ctest-test-zone-77632865(2fab3977-f8d4-4e06-898b-595e4e7ac926) 2025-07-22 17:51:30,209 - INFO - Deleting Control node zone ctest-test-zone-47323781(7be3a91c-4b42-4427-b257-74340f6d9bee) 2025-07-22 17:51:30,379 - INFO - Deleting Control node zone ctest-test-zone-26888408(5c9ccc96-2a42-4f53-8deb-fcb4c226f21b) 2025-07-22 17:51:30,545 - INFO - Deleting VM ctest-TestBGPaasZone-12365445-47059316 2025-07-22 17:51:30,654 - INFO - Deleting VM ctest-TestBGPaasZone-12365445-47931232 2025-07-22 17:51:30,724 - INFO - Deleting VM ctest-TestBGPaasZone-12365445-67419855 2025-07-22 17:51:30,793 - INFO - Deleting VN ctest-cnz_vn-53495715 2025-07-22 17:51:30,844 - DEBUG - VN e24d52f1-82f5-4162-9a32-b67652fa906c still in use: Unable to complete operation on network e24d52f1-82f5-4162-9a32-b67652fa906c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0f1bb4aa-85f2-41f6-a839-fb38712f67e2'] 2025-07-22 17:51:30,844 - WARNING - Deleting VN ctest-cnz_vn-53495715 failed..Will retry 2025-07-22 17:51:33,065 - DEBUG - Response for deleting network () 2025-07-22 17:51:34,314 - DEBUG - Skipping xmpp flap check
2025-07-22 17:51:34,315 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:18]
2025-07-22 17:51:34,315 - INFO - -------------------------------------------------------------------------------- 2025-07-22 17:51:35,120 - INFO - Deleted project: ctest-TestBGPaasZone-12365445, ID : 38f69b0d-de8b-4cc3-bd96-78c4f5a15e6a