2025-12-08 03:53:51,346 - INFO - Domain Default found not creating 2025-12-08 03:53:51,504 - INFO - Project ctest-TestBGPaasZone-91854096 not found, creating it 2025-12-08 03:53:52,002 - INFO - Created Project:ctest-TestBGPaasZone-91854096, ID : eb165d14-87a7-41ec-8bbb-9f6eed140996 2025-12-08 03:53:53,670 - DEBUG - Services list from nova: [, , , ] 2025-12-08 03:53:53,670 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4854-2', 'an-jenkins-deploy-platform-ansible-os-4854-1']} 2025-12-08 03:53:53,672 - INFO - ================================================================================ 2025-12-08 03:53:53,672 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-12-08 03:53:54,924 - DEBUG - Skipping xmpp flap check 2025-12-08 03:53:54,924 - INFO - Initial checks done. Running the testcase now 2025-12-08 03:53:54,924 - INFO - 2025-12-08 03:53:54,924 - INFO - executing bgp_control_zone test 2025-12-08 03:53:55,637 - DEBUG - Response for create_network : {'network': {'id': '4f59218b-1c22-4559-8b0a-d52c64ecb7e7', 'name': 'ctest-cnz_vn-91021203', 'tenant_id': 'eb165d1487a741ec8bbb9f6eed140996', 'project_id': 'eb165d1487a741ec8bbb9f6eed140996', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-91854096', 'ctest-cnz_vn-91021203'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:53:55,918 - DEBUG - Response for create_subnet : {'subnet': {'id': '7b9e5385-404f-4cc2-bd72-229b9fa3bccf', 'name': '', 'tenant_id': 'eb165d1487a741ec8bbb9f6eed140996', 'network_id': '4f59218b-1c22-4559-8b0a-d52c64ecb7e7', 'ip_version': 4, 'cidr': '210.5.104.64/26', 'allocation_pools': [{'start': '210.5.104.66', 'end': '210.5.104.126'}], 'gateway_ip': '210.5.104.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '210.5.104.66', 'tags': [], 'project_id': 'eb165d1487a741ec8bbb9f6eed140996'}} 2025-12-08 03:53:55,939 - INFO - Created VN ctest-cnz_vn-91021203 2025-12-08 03:53:55,952 - DEBUG - VN ctest-cnz_vn-91021203 UUID is 4f59218b-1c22-4559-8b0a-d52c64ecb7e7 2025-12-08 03:53:57,429 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-2) 2025-12-08 03:53:58,893 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-1) 2025-12-08 03:54:00,584 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-2) 2025-12-08 03:54:00,585 - INFO - Waiting for VM ctest-TestBGPaasZone-91854096-87504962 to be up.. 2025-12-08 03:54:00,698 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-08 03:54:05,798 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-08 03:54:10,902 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-08 03:54:15,987 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-08 03:54:21,086 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-08 03:54:26,172 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-08 03:54:31,268 - DEBUG - VM is in ACTIVE state now 2025-12-08 03:54:31,268 - INFO - VM name : ctest-TestBGPaasZone-91854096-87504962 2025-12-08 03:54:31,352 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 ID is 7e77e6c9-66e1-43fd-a959-6d9dee8a193b 2025-12-08 03:54:31,378 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 launched on Node an-jenkins-deploy-platform-ansible-os-4854-2 2025-12-08 03:54:31,457 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/7e77e6c9-66e1-43fd-a959-6d9dee8a193b 2025-12-08 03:54:31,794 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/7e77e6c9-66e1-43fd-a959-6d9dee8a193b 2025-12-08 03:54:31,829 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/8ea21313-48d0-48b3-975b-ca53796d20fa 2025-12-08 03:54:35,008 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-08 03:54:35,008 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:54:35,023 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:54:39,109 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-08 03:54:39,109 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:54:39,125 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:54:43,202 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-12-08 03:54:43,202 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:54:43,216 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:54:47,297 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-12-08 03:54:47,297 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:54:47,310 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:54:51,388 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-08 03:54:51,388 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:54:51,401 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:54:55,482 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-08 03:54:55,482 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:54:55,505 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:54:59,585 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-08 03:54:59,585 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:54:59,600 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:03,677 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-08 03:55:03,677 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:03,693 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:07,778 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-08 03:55:07,778 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:07,792 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:11,871 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-08 03:55:11,871 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:11,886 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:15,974 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-12-08 03:55:15,974 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:15,990 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:20,059 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-12-08 03:55:20,059 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:20,076 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:24,164 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-08 03:55:24,165 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:24,178 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:28,256 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-12-08 03:55:28,256 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:28,270 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:32,353 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-08 03:55:32,353 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:32,368 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:36,442 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-12-08 03:55:36,443 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:36,457 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:40,545 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-12-08 03:55:40,545 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:40,559 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:44,642 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-08 03:55:44,642 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:44,662 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:48,732 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-12-08 03:55:48,732 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:48,748 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:52,834 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-12-08 03:55:52,834 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 failed! 2025-12-08 03:55:52,847 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-91021203 is 210.5.104.65 and allocation pool is NOT set 2025-12-08 03:55:54,917 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.805 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.805/1.836/2.868/1.031 ms') 2025-12-08 03:55:54,917 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-87504962 passed 2025-12-08 03:55:54,986 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:55:54,986 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:55:55,053 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:55:55,169 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:00,170 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:00,170 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:00,248 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:00,330 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:05,330 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:05,331 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:05,398 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:05,498 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:10,499 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:10,499 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:10,566 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:10,653 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:15,654 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:15,654 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:15,722 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:15,815 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:20,816 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:20,817 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:20,885 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:20,966 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:25,967 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:25,968 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:26,033 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:26,131 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:31,131 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:31,131 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:31,202 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:31,287 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:36,288 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:36,288 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:36,357 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:36,450 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:41,451 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:41,451 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:41,518 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:41,596 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:46,597 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:46,597 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:46,665 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:56:46,751 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:56:51,752 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:51,752 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-87504962, IP 210.5.104.67, Port 22 2025-12-08 03:56:51,926 - DEBUG - VM ctest-TestBGPaasZone-91854096-87504962 is ready for SSH connections 2025-12-08 03:56:51,926 - INFO - Waiting for VM ctest-TestBGPaasZone-91854096-17015166 to be up.. 2025-12-08 03:56:52,008 - DEBUG - VM is in ACTIVE state now 2025-12-08 03:56:52,009 - INFO - VM name : ctest-TestBGPaasZone-91854096-17015166 2025-12-08 03:56:52,089 - DEBUG - VM ctest-TestBGPaasZone-91854096-17015166 ID is c1e0ea84-ade0-4daf-bc6d-5852a9d06140 2025-12-08 03:56:52,090 - DEBUG - VM ctest-TestBGPaasZone-91854096-17015166 launched on Node an-jenkins-deploy-platform-ansible-os-4854-1 2025-12-08 03:56:52,166 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/c1e0ea84-ade0-4daf-bc6d-5852a9d06140 2025-12-08 03:56:52,177 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/4b1fa308-f746-4104-858a-46373a772001 2025-12-08 03:56:53,335 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.56 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.532 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.532/2.046/3.561/1.514 ms') 2025-12-08 03:56:53,336 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-17015166 passed 2025-12-08 03:56:53,406 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:53,406 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-17015166, IP 210.5.104.68, Port 22 2025-12-08 03:56:53,580 - DEBUG - VM ctest-TestBGPaasZone-91854096-17015166 is ready for SSH connections 2025-12-08 03:56:53,581 - INFO - Waiting for VM ctest-TestBGPaasZone-91854096-82687238 to be up.. 2025-12-08 03:56:53,672 - DEBUG - VM is in ACTIVE state now 2025-12-08 03:56:53,672 - INFO - VM name : ctest-TestBGPaasZone-91854096-82687238 2025-12-08 03:56:53,766 - DEBUG - VM ctest-TestBGPaasZone-91854096-82687238 ID is 5d6017b7-749c-406e-96c1-fa91f80487de 2025-12-08 03:56:53,766 - DEBUG - VM ctest-TestBGPaasZone-91854096-82687238 launched on Node an-jenkins-deploy-platform-ansible-os-4854-2 2025-12-08 03:56:53,861 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/5d6017b7-749c-406e-96c1-fa91f80487de 2025-12-08 03:56:53,871 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/93925065-d115-4c33-8856-30b7ea0ee598 2025-12-08 03:56:55,034 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.35 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.02 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.017/3.681/6.345/2.664 ms') 2025-12-08 03:56:55,034 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-91854096-82687238 passed 2025-12-08 03:56:55,105 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:55,105 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-82687238, IP 210.5.104.69, Port 22 2025-12-08 03:56:55,277 - DEBUG - VM ctest-TestBGPaasZone-91854096-82687238 is ready for SSH connections 2025-12-08 03:56:55,421 - INFO - Created control node zone ctest-test-zone-33253079(aa840b8f-fa18-4026-bec0-bce1f68de827) 2025-12-08 03:56:55,777 - INFO - Created control node zone ctest-test-zone-01944511(335de086-98c5-4d17-8d19-439b9d8c01f7) 2025-12-08 03:56:56,133 - INFO - Created control node zone ctest-test-zone-87370342(6e954740-ed96-498f-84b6-1d27b8112a04) 2025-12-08 03:56:56,413 - INFO - Creating BGPaaS ctest-TestBGPaasZone-91854096-60578385 2025-12-08 03:56:56,489 - INFO - BGPaaS: ctest-TestBGPaasZone-91854096-60578385(521b83ee-b961-40ba-9513-270c3236f39e) 2025-12-08 03:56:56,489 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:56:56,825 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:56:56,858 - INFO - verify_in_api_server passed for BGPaaS obj 521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:56:56,858 - INFO - BGPaaS(521b83ee-b961-40ba-9513-270c3236f39e): verify_on_setup passed 2025-12-08 03:56:56,858 - INFO - We will configure BGP on the VM 2025-12-08 03:56:57,101 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:56:57,101 - INFO - Configuring BGP on ctest-TestBGPaasZone-91854096-87504962 2025-12-08 03:56:57,101 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:56:57,101 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS 2025-12-08 03:57:11,584 - DEBUG - None 2025-12-08 03:57:11,584 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:11,584 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS 2025-12-08 03:57:12,693 - DEBUG - None 2025-12-08 03:57:12,693 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:12,693 - DEBUG - service bird restart 2025-12-08 03:57:15,616 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-12-08 03:57:15,616 - INFO - Attaching VMI 8ea21313-48d0-48b3-975b-ca53796d20fa to BGPaaS 521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:57:15,693 - INFO - Attaching the VMI 7e77e6c9-66e1-43fd-a959-6d9dee8a193b to the BGPaaS 521b83ee-b961-40ba-9513-270c3236f39e object 2025-12-08 03:57:15,693 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 210.5.104.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:15,693 - DEBUG - sudo ip addr add 210.5.104.84 dev eth0 2025-12-08 03:57:16,382 - DEBUG - None 2025-12-08 03:57:16,445 - INFO - Creating BGPaaS ctest-TestBGPaasZone-91854096-96509115 2025-12-08 03:57:16,521 - INFO - BGPaaS: ctest-TestBGPaasZone-91854096-96509115(54d7ad8f-19ea-4a97-afbf-d88acee6530c) 2025-12-08 03:57:16,521 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/54d7ad8f-19ea-4a97-afbf-d88acee6530c 2025-12-08 03:57:16,531 - INFO - verify_in_api_server passed for BGPaaS obj 54d7ad8f-19ea-4a97-afbf-d88acee6530c 2025-12-08 03:57:16,531 - INFO - BGPaaS(54d7ad8f-19ea-4a97-afbf-d88acee6530c): verify_on_setup passed 2025-12-08 03:57:16,531 - INFO - We will configure BGP on the VM 2025-12-08 03:57:16,773 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:57:16,773 - INFO - Configuring BGP on ctest-TestBGPaasZone-91854096-17015166 2025-12-08 03:57:16,773 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.68; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.68; } protocol bfd { neighbor 210.5.104.66 local 210.5.104.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 03:57:16,773 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.68; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.68; } protocol bfd { neighbor 210.5.104.66 local 210.5.104.68 multihop on; } EOS 2025-12-08 03:57:21,987 - DEBUG - None 2025-12-08 03:57:21,987 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.68; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.68; } protocol bfd { neighbor 210.5.104.66 local 210.5.104.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 03:57:21,987 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.68; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.68; } protocol bfd { neighbor 210.5.104.66 local 210.5.104.68 multihop on; } EOS 2025-12-08 03:57:22,470 - DEBUG - None 2025-12-08 03:57:22,470 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 03:57:22,470 - DEBUG - service bird restart 2025-12-08 03:57:24,069 - DEBUG - bird stop/waiting bird start/running, process 1442 2025-12-08 03:57:24,069 - INFO - Attaching VMI 4b1fa308-f746-4104-858a-46373a772001 to BGPaaS 54d7ad8f-19ea-4a97-afbf-d88acee6530c 2025-12-08 03:57:24,149 - INFO - Attaching the VMI c1e0ea84-ade0-4daf-bc6d-5852a9d06140 to the BGPaaS 54d7ad8f-19ea-4a97-afbf-d88acee6530c object 2025-12-08 03:57:24,149 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 210.5.104.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 03:57:24,149 - DEBUG - sudo ip addr add 210.5.104.84 dev eth0 2025-12-08 03:57:24,754 - DEBUG - None 2025-12-08 03:57:24,755 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:57:24,767 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-08 03:57:24,773 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:57:24,773 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 03:57:24,791 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-12-08 03:57:30,792 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 03:57:30,813 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-08 03:57:30,820 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 210.5.104.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:30,820 - DEBUG - ping -s 56 -c 3 -W 1 210.5.104.84 2025-12-08 03:57:37,451 - DEBUG - PING 210.5.104.84 (210.5.104.84) 56(84) bytes of data. 64 bytes from 210.5.104.84: icmp_seq=1 ttl=64 time=7.98 ms 64 bytes from 210.5.104.84: icmp_seq=2 ttl=64 time=1.27 ms 64 bytes from 210.5.104.84: icmp_seq=3 ttl=64 time=0.936 ms --- 210.5.104.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.936/3.398/7.983/3.245 ms 2025-12-08 03:57:37,451 - INFO - Ping to IP 210.5.104.84 from VM ctest-TestBGPaasZone-91854096-82687238 passed 2025-12-08 03:57:38,265 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:38,265 - DEBUG - service bird restart 2025-12-08 03:57:39,965 - DEBUG - bird stop/waiting bird start/running, process 1466 2025-12-08 03:57:39,966 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 03:57:39,966 - DEBUG - service bird restart 2025-12-08 03:57:41,590 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-12-08 03:57:41,590 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:57:41,608 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.145'] 2025-12-08 03:57:47,627 - INFO - BGPaaS session seen in control-node 10.20.0.145 2025-12-08 03:57:47,634 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:57:47,634 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 03:57:47,649 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-08 03:57:47,655 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 210.5.104.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:47,655 - DEBUG - ping -s 56 -c 3 -W 1 210.5.104.84 2025-12-08 03:57:50,152 - DEBUG - PING 210.5.104.84 (210.5.104.84) 56(84) bytes of data. 64 bytes from 210.5.104.84: icmp_seq=1 ttl=64 time=5.59 ms 64 bytes from 210.5.104.84: icmp_seq=2 ttl=64 time=1.35 ms 64 bytes from 210.5.104.84: icmp_seq=3 ttl=64 time=1.46 ms --- 210.5.104.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.355/2.805/5.595/1.973 ms 2025-12-08 03:57:50,152 - INFO - Ping to IP 210.5.104.84 from VM ctest-TestBGPaasZone-91854096-82687238 passed 2025-12-08 03:57:50,448 - INFO - We will configure BGP on the VM 2025-12-08 03:57:50,657 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:57:50,657 - INFO - Configuring BGP on ctest-TestBGPaasZone-91854096-87504962 2025-12-08 03:57:50,657 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:50,657 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS 2025-12-08 03:57:51,170 - DEBUG - None 2025-12-08 03:57:51,170 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:51,170 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 210.5.104.67; protocol bgp bgp_1{ local as 65000; neighbor 210.5.104.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 210.5.104.67; } protocol bfd { neighbor 210.5.104.65 local 210.5.104.67 multihop on; } EOS 2025-12-08 03:57:51,701 - DEBUG - None 2025-12-08 03:57:51,701 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:51,701 - DEBUG - service bird restart 2025-12-08 03:57:53,590 - DEBUG - bird stop/waiting bird start/running, process 1498 2025-12-08 03:57:53,590 - INFO - Attaching VMI 8ea21313-48d0-48b3-975b-ca53796d20fa to BGPaaS 521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:57:53,610 - INFO - Attaching the VMI 7e77e6c9-66e1-43fd-a959-6d9dee8a193b to the BGPaaS 521b83ee-b961-40ba-9513-270c3236f39e object 2025-12-08 03:57:53,610 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 210.5.104.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:53,610 - DEBUG - sudo ip addr add 210.5.104.84 dev eth0 2025-12-08 03:57:54,394 - DEBUG - RTNETLINK answers: File exists 2025-12-08 03:57:54,394 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:57:54,394 - DEBUG - service bird restart 2025-12-08 03:57:56,234 - DEBUG - bird stop/waiting bird start/running, process 1525 2025-12-08 03:57:56,234 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 03:57:56,234 - DEBUG - service bird restart 2025-12-08 03:57:57,800 - DEBUG - bird stop/waiting bird start/running, process 1491 2025-12-08 03:57:57,800 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:57:57,815 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-12-08 03:58:03,830 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-08 03:58:03,835 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:58:03,836 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 03:58:03,851 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-12-08 03:58:09,855 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 03:58:09,869 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-08 03:58:09,874 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 210.5.104.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 03:58:09,875 - DEBUG - ping -s 56 -c 3 -W 1 210.5.104.84 2025-12-08 03:58:12,359 - DEBUG - PING 210.5.104.84 (210.5.104.84) 56(84) bytes of data. 64 bytes from 210.5.104.84: icmp_seq=1 ttl=64 time=3.29 ms 64 bytes from 210.5.104.84: icmp_seq=2 ttl=64 time=1.40 ms 64 bytes from 210.5.104.84: icmp_seq=3 ttl=64 time=1.28 ms --- 210.5.104.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.285/1.994/3.297/0.923 ms 2025-12-08 03:58:12,359 - INFO - Ping to IP 210.5.104.84 from VM ctest-TestBGPaasZone-91854096-82687238 passed 2025-12-08 03:58:12,359 - INFO - Detaching VMI 8ea21313-48d0-48b3-975b-ca53796d20fa from BGPaaS 521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:58:12,433 - INFO - Detaching VMI 4b1fa308-f746-4104-858a-46373a772001 from BGPaaS 54d7ad8f-19ea-4a97-afbf-d88acee6530c 2025-12-08 03:58:12,505 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-91854096-96509115(54d7ad8f-19ea-4a97-afbf-d88acee6530c) 2025-12-08 03:58:12,552 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/54d7ad8f-19ea-4a97-afbf-d88acee6530c 2025-12-08 03:58:12,561 - DEBUG - Response Code: 404 2025-12-08 03:58:12,561 - DEBUG - BGPaaS: 54d7ad8f-19ea-4a97-afbf-d88acee6530c deleted from api server 2025-12-08 03:58:12,561 - INFO - BGPaaS(54d7ad8f-19ea-4a97-afbf-d88acee6530c): verify_on_cleanup passed 2025-12-08 03:58:12,561 - INFO - Detaching VMI 8ea21313-48d0-48b3-975b-ca53796d20fa from BGPaaS 521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:58:12,582 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-91854096-60578385(521b83ee-b961-40ba-9513-270c3236f39e) 2025-12-08 03:58:12,620 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/521b83ee-b961-40ba-9513-270c3236f39e 2025-12-08 03:58:12,628 - DEBUG - Response Code: 404 2025-12-08 03:58:12,629 - DEBUG - BGPaaS: 521b83ee-b961-40ba-9513-270c3236f39e deleted from api server 2025-12-08 03:58:12,629 - INFO - BGPaaS(521b83ee-b961-40ba-9513-270c3236f39e): verify_on_cleanup passed 2025-12-08 03:58:12,629 - INFO - Deleting Control node zone ctest-test-zone-87370342(6e954740-ed96-498f-84b6-1d27b8112a04) 2025-12-08 03:58:12,767 - INFO - Deleting Control node zone ctest-test-zone-01944511(335de086-98c5-4d17-8d19-439b9d8c01f7) 2025-12-08 03:58:12,920 - INFO - Deleting Control node zone ctest-test-zone-33253079(aa840b8f-fa18-4026-bec0-bce1f68de827) 2025-12-08 03:58:13,016 - INFO - Deleting VM ctest-TestBGPaasZone-91854096-82687238 2025-12-08 03:58:13,168 - INFO - Deleting VM ctest-TestBGPaasZone-91854096-17015166 2025-12-08 03:58:13,259 - INFO - Deleting VM ctest-TestBGPaasZone-91854096-87504962 2025-12-08 03:58:13,329 - INFO - Deleting VN ctest-cnz_vn-91021203 2025-12-08 03:58:13,371 - DEBUG - VN 4f59218b-1c22-4559-8b0a-d52c64ecb7e7 still in use: Unable to complete operation on network 4f59218b-1c22-4559-8b0a-d52c64ecb7e7. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3ed665f7-3768-438a-9aaa-14070d37a23f'] 2025-12-08 03:58:13,371 - WARNING - Deleting VN ctest-cnz_vn-91021203 failed..Will retry 2025-12-08 03:58:15,766 - DEBUG - Response for deleting network () 2025-12-08 03:58:17,040 - DEBUG - Skipping xmpp flap check
2025-12-08 03:58:17,040 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:24]
2025-12-08 03:58:17,040 - INFO - -------------------------------------------------------------------------------- 2025-12-08 03:58:17,043 - INFO - ================================================================================ 2025-12-08 03:58:17,044 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-12-08 03:58:18,303 - DEBUG - Skipping xmpp flap check 2025-12-08 03:58:18,303 - INFO - Initial checks done. Running the testcase now 2025-12-08 03:58:18,304 - INFO - 2025-12-08 03:58:18,304 - INFO - executing bgp_control_zone agent restart test 2025-12-08 03:58:18,608 - DEBUG - Response for create_network : {'network': {'id': '96f18f8b-2859-4114-8c67-9cd83c361460', 'name': 'ctest-cnz_vn-86085796', 'tenant_id': 'eb165d1487a741ec8bbb9f6eed140996', 'project_id': 'eb165d1487a741ec8bbb9f6eed140996', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-91854096', 'ctest-cnz_vn-86085796'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:58:18,848 - DEBUG - Response for create_subnet : {'subnet': {'id': '32c28886-9389-4ed5-90d2-8d4d1c9aae2c', 'name': '', 'tenant_id': 'eb165d1487a741ec8bbb9f6eed140996', 'network_id': '96f18f8b-2859-4114-8c67-9cd83c361460', 'ip_version': 4, 'cidr': '208.144.147.64/26', 'allocation_pools': [{'start': '208.144.147.66', 'end': '208.144.147.126'}], 'gateway_ip': '208.144.147.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '208.144.147.66', 'tags': [], 'project_id': 'eb165d1487a741ec8bbb9f6eed140996'}} 2025-12-08 03:58:18,869 - INFO - Created VN ctest-cnz_vn-86085796 2025-12-08 03:58:18,879 - DEBUG - VN ctest-cnz_vn-86085796 UUID is 96f18f8b-2859-4114-8c67-9cd83c361460 2025-12-08 03:58:20,181 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-1) 2025-12-08 03:58:21,611 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-2) 2025-12-08 03:58:23,189 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-1) 2025-12-08 03:58:23,190 - INFO - Waiting for VM ctest-TestBGPaasZone-91854096-99201581 to be up.. 2025-12-08 03:58:23,276 - DEBUG - VM is in ACTIVE state now 2025-12-08 03:58:23,276 - INFO - VM name : ctest-TestBGPaasZone-91854096-99201581 2025-12-08 03:58:23,365 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 ID is 9dc2e517-c1c4-4363-9746-dcf6a15439d0 2025-12-08 03:58:23,365 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 launched on Node an-jenkins-deploy-platform-ansible-os-4854-1 2025-12-08 03:58:23,469 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/9dc2e517-c1c4-4363-9746-dcf6a15439d0 2025-12-08 03:58:23,480 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/782ff00e-650c-44c3-bcc9-84a151793b9e 2025-12-08 03:58:26,707 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-08 03:58:26,708 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:26,721 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:30,805 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-08 03:58:30,805 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:30,818 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:34,897 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-08 03:58:34,897 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:34,911 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:38,990 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-08 03:58:38,990 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:39,010 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:43,083 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-08 03:58:43,083 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:43,099 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:47,177 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-12-08 03:58:47,177 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:47,190 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:51,272 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-12-08 03:58:51,273 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:51,287 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:55,372 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-12-08 03:58:55,372 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:55,457 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:58:59,534 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-12-08 03:58:59,534 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:58:59,547 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:03,635 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-12-08 03:59:03,635 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:59:03,649 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:07,734 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-12-08 03:59:07,734 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:59:07,748 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:11,822 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-08 03:59:11,822 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:59:11,836 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:15,926 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-12-08 03:59:15,926 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:59:15,940 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:20,013 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-12-08 03:59:20,013 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:59:20,032 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:24,111 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-12-08 03:59:24,111 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:59:24,127 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:28,202 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-08 03:59:28,202 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 failed! 2025-12-08 03:59:28,218 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-91854096:ctest-cnz_vn-86085796 is 208.144.147.65 and allocation pool is NOT set 2025-12-08 03:59:32,302 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.46 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1023ms\r\nrtt min/avg/max/mdev = 3.456/3.456/3.456/0.000 ms') 2025-12-08 03:59:32,303 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-99201581 passed 2025-12-08 03:59:32,373 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:59:32,373 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 03:59:32,431 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:59:32,588 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:59:37,590 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:59:37,590 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 03:59:37,660 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:59:37,764 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:59:42,765 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:59:42,765 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 03:59:42,834 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:59:42,914 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:59:47,915 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:59:47,916 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 03:59:47,971 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:59:48,059 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:59:53,060 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:59:53,060 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 03:59:53,126 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:59:53,214 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 03:59:58,215 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 03:59:58,215 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 03:59:58,282 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 03:59:58,362 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 04:00:03,362 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:03,362 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 04:00:03,419 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 04:00:03,509 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 04:00:08,511 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:08,511 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 04:00:08,567 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 04:00:08,657 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 04:00:13,659 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:13,659 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 04:00:13,715 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 04:00:13,793 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 04:00:18,794 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:18,795 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-99201581, IP 208.144.147.67, Port 22 2025-12-08 04:00:18,962 - DEBUG - VM ctest-TestBGPaasZone-91854096-99201581 is ready for SSH connections 2025-12-08 04:00:18,962 - INFO - Waiting for VM ctest-TestBGPaasZone-91854096-40583715 to be up.. 2025-12-08 04:00:19,047 - DEBUG - VM is in ACTIVE state now 2025-12-08 04:00:19,047 - INFO - VM name : ctest-TestBGPaasZone-91854096-40583715 2025-12-08 04:00:19,131 - DEBUG - VM ctest-TestBGPaasZone-91854096-40583715 ID is 4caf15e7-f91b-403d-98f8-41b7007aaab2 2025-12-08 04:00:19,131 - DEBUG - VM ctest-TestBGPaasZone-91854096-40583715 launched on Node an-jenkins-deploy-platform-ansible-os-4854-2 2025-12-08 04:00:19,220 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/4caf15e7-f91b-403d-98f8-41b7007aaab2 2025-12-08 04:00:19,257 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/bd759db2-24c2-4f95-96de-9b4af0a376f1 2025-12-08 04:00:20,426 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.14 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.00 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.002/2.073/3.144/1.071 ms') 2025-12-08 04:00:20,426 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-91854096-40583715 passed 2025-12-08 04:00:20,498 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:20,498 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-40583715, IP 208.144.147.68, Port 22 2025-12-08 04:00:20,567 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 04:00:20,657 - DEBUG - VM ctest-TestBGPaasZone-91854096-40583715 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 04:00:25,658 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:25,658 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-40583715, IP 208.144.147.68, Port 22 2025-12-08 04:00:25,726 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-08 04:00:25,804 - DEBUG - VM ctest-TestBGPaasZone-91854096-40583715 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-08 04:00:30,804 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:30,805 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-40583715, IP 208.144.147.68, Port 22 2025-12-08 04:00:30,978 - DEBUG - VM ctest-TestBGPaasZone-91854096-40583715 is ready for SSH connections 2025-12-08 04:00:30,978 - INFO - Waiting for VM ctest-TestBGPaasZone-91854096-00384241 to be up.. 2025-12-08 04:00:31,161 - DEBUG - VM is in ACTIVE state now 2025-12-08 04:00:31,161 - INFO - VM name : ctest-TestBGPaasZone-91854096-00384241 2025-12-08 04:00:31,263 - DEBUG - VM ctest-TestBGPaasZone-91854096-00384241 ID is db750562-4316-4bd9-9fc8-a8996a47eafc 2025-12-08 04:00:31,264 - DEBUG - VM ctest-TestBGPaasZone-91854096-00384241 launched on Node an-jenkins-deploy-platform-ansible-os-4854-1 2025-12-08 04:00:31,355 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/db750562-4316-4bd9-9fc8-a8996a47eafc 2025-12-08 04:00:31,367 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/6f67bbd8-8cca-4ba4-b0f6-ff0bf8b7fd1b 2025-12-08 04:00:32,543 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.70 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.82 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.815/4.258/6.702/2.443 ms') 2025-12-08 04:00:32,543 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-91854096-00384241 passed 2025-12-08 04:00:32,618 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:32,618 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-91854096-00384241, IP 208.144.147.69, Port 22 2025-12-08 04:00:32,779 - DEBUG - VM ctest-TestBGPaasZone-91854096-00384241 is ready for SSH connections 2025-12-08 04:00:32,909 - INFO - Created control node zone ctest-test-zone-33520466(af79ccb0-7b30-40ea-915c-4814d38d256d) 2025-12-08 04:00:33,249 - INFO - Created control node zone ctest-test-zone-55981873(7b36a26a-c030-48d7-86aa-cccb1b0dafa0) 2025-12-08 04:00:33,589 - INFO - Created control node zone ctest-test-zone-57534736(e370720c-cde9-4f4a-842c-2501f794bcfd) 2025-12-08 04:00:33,873 - INFO - Creating BGPaaS ctest-TestBGPaasZone-91854096-54395751 2025-12-08 04:00:33,945 - INFO - BGPaaS: ctest-TestBGPaasZone-91854096-54395751(f1a2d191-d221-4a0c-9888-0266ad09b492) 2025-12-08 04:00:33,946 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/f1a2d191-d221-4a0c-9888-0266ad09b492 2025-12-08 04:00:33,956 - INFO - verify_in_api_server passed for BGPaaS obj f1a2d191-d221-4a0c-9888-0266ad09b492 2025-12-08 04:00:33,956 - INFO - BGPaaS(f1a2d191-d221-4a0c-9888-0266ad09b492): verify_on_setup passed 2025-12-08 04:00:33,956 - INFO - We will configure BGP on the VM 2025-12-08 04:00:34,373 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:34,373 - INFO - Configuring BGP on ctest-TestBGPaasZone-91854096-99201581 2025-12-08 04:00:34,373 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 208.144.147.67; protocol bgp bgp_1{ local as 65000; neighbor 208.144.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.67; } protocol bfd { neighbor 208.144.147.65 local 208.144.147.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 04:00:34,373 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 208.144.147.67; protocol bgp bgp_1{ local as 65000; neighbor 208.144.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.67; } protocol bfd { neighbor 208.144.147.65 local 208.144.147.67 multihop on; } EOS 2025-12-08 04:00:40,103 - DEBUG - None 2025-12-08 04:00:40,103 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 208.144.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.67; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 04:00:40,103 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 208.144.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.67; } EOS 2025-12-08 04:00:40,594 - DEBUG - None 2025-12-08 04:00:40,594 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 04:00:40,594 - DEBUG - service bird restart 2025-12-08 04:00:42,237 - DEBUG - bird stop/waiting bird start/running, process 1438 2025-12-08 04:00:42,237 - INFO - Attaching VMI 782ff00e-650c-44c3-bcc9-84a151793b9e to BGPaaS f1a2d191-d221-4a0c-9888-0266ad09b492 2025-12-08 04:00:42,313 - INFO - Attaching the VMI 9dc2e517-c1c4-4363-9746-dcf6a15439d0 to the BGPaaS f1a2d191-d221-4a0c-9888-0266ad09b492 object 2025-12-08 04:00:42,313 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 208.144.147.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 04:00:42,313 - DEBUG - sudo ip addr add 208.144.147.84 dev eth0 2025-12-08 04:00:42,949 - DEBUG - None 2025-12-08 04:00:43,017 - INFO - Creating BGPaaS ctest-TestBGPaasZone-91854096-65028011 2025-12-08 04:00:43,137 - INFO - BGPaaS: ctest-TestBGPaasZone-91854096-65028011(77db69a0-bf18-4180-a251-f89a8a3c9784) 2025-12-08 04:00:43,137 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/77db69a0-bf18-4180-a251-f89a8a3c9784 2025-12-08 04:00:43,147 - INFO - verify_in_api_server passed for BGPaaS obj 77db69a0-bf18-4180-a251-f89a8a3c9784 2025-12-08 04:00:43,147 - INFO - BGPaaS(77db69a0-bf18-4180-a251-f89a8a3c9784): verify_on_setup passed 2025-12-08 04:00:43,147 - INFO - We will configure BGP on the VM 2025-12-08 04:00:43,585 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:43,585 - INFO - Configuring BGP on ctest-TestBGPaasZone-91854096-40583715 2025-12-08 04:00:43,585 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 208.144.147.68; protocol bgp bgp_1{ local as 65000; neighbor 208.144.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.68; } protocol bfd { neighbor 208.144.147.65 local 208.144.147.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 04:00:43,585 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 208.144.147.68; protocol bgp bgp_1{ local as 65000; neighbor 208.144.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.68; } protocol bfd { neighbor 208.144.147.65 local 208.144.147.68 multihop on; } EOS 2025-12-08 04:00:49,573 - DEBUG - None 2025-12-08 04:00:49,573 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 208.144.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.68; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 04:00:49,574 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 208.144.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 208.144.147.68; } EOS 2025-12-08 04:00:50,182 - DEBUG - None 2025-12-08 04:00:50,182 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 04:00:50,182 - DEBUG - service bird restart 2025-12-08 04:00:51,911 - DEBUG - bird stop/waiting bird start/running, process 1440 2025-12-08 04:00:51,912 - INFO - Attaching VMI bd759db2-24c2-4f95-96de-9b4af0a376f1 to BGPaaS 77db69a0-bf18-4180-a251-f89a8a3c9784 2025-12-08 04:00:51,985 - INFO - Attaching the VMI 4caf15e7-f91b-403d-98f8-41b7007aaab2 to the BGPaaS 77db69a0-bf18-4180-a251-f89a8a3c9784 object 2025-12-08 04:00:51,985 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 208.144.147.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123 2025-12-08 04:00:51,985 - DEBUG - sudo ip addr add 208.144.147.84 dev eth0 2025-12-08 04:00:52,675 - DEBUG - None 2025-12-08 04:00:52,675 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:52,688 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-08 04:00:52,688 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:52,688 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 04:00:52,703 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-08 04:00:52,709 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:52,722 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-12-08 04:00:58,735 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-08 04:00:58,735 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:00:58,735 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 04:00:58,748 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-12-08 04:01:04,749 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 04:01:04,764 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-08 04:01:04,771 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 208.144.147.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 04:01:04,771 - DEBUG - ping -s 56 -c 3 -W 1 208.144.147.84 2025-12-08 04:01:10,812 - DEBUG - PING 208.144.147.84 (208.144.147.84) 56(84) bytes of data. 64 bytes from 208.144.147.84: icmp_seq=1 ttl=64 time=9.39 ms 64 bytes from 208.144.147.84: icmp_seq=2 ttl=64 time=1.42 ms 64 bytes from 208.144.147.84: icmp_seq=3 ttl=64 time=1.31 ms --- 208.144.147.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.315/4.043/9.394/3.783 ms 2025-12-08 04:01:10,812 - INFO - Ping to IP 208.144.147.84 from VM ctest-TestBGPaasZone-91854096-00384241 passed 2025-12-08 04:01:10,813 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:01:10,827 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-08 04:01:10,827 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:01:10,827 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 04:01:10,841 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-08 04:01:10,847 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:01:10,861 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-08 04:01:10,862 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-08 04:01:10,862 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-08 04:01:10,875 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-08 04:01:10,881 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 208.144.147.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-12-08 04:01:10,881 - DEBUG - ping -s 56 -c 3 -W 1 208.144.147.84 2025-12-08 04:01:13,358 - DEBUG - PING 208.144.147.84 (208.144.147.84) 56(84) bytes of data. 64 bytes from 208.144.147.84: icmp_seq=1 ttl=64 time=3.53 ms 64 bytes from 208.144.147.84: icmp_seq=2 ttl=64 time=1.51 ms 64 bytes from 208.144.147.84: icmp_seq=3 ttl=64 time=1.46 ms --- 208.144.147.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.465/2.174/3.538/0.964 ms 2025-12-08 04:01:13,358 - INFO - Ping to IP 208.144.147.84 from VM ctest-TestBGPaasZone-91854096-00384241 passed 2025-12-08 04:01:13,359 - INFO - Detaching VMI bd759db2-24c2-4f95-96de-9b4af0a376f1 from BGPaaS 77db69a0-bf18-4180-a251-f89a8a3c9784 2025-12-08 04:01:13,434 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-91854096-65028011(77db69a0-bf18-4180-a251-f89a8a3c9784) 2025-12-08 04:01:13,489 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/77db69a0-bf18-4180-a251-f89a8a3c9784 2025-12-08 04:01:13,514 - DEBUG - Response Code: 404 2025-12-08 04:01:13,515 - DEBUG - BGPaaS: 77db69a0-bf18-4180-a251-f89a8a3c9784 deleted from api server 2025-12-08 04:01:13,515 - INFO - BGPaaS(77db69a0-bf18-4180-a251-f89a8a3c9784): verify_on_cleanup passed 2025-12-08 04:01:13,515 - INFO - Detaching VMI 782ff00e-650c-44c3-bcc9-84a151793b9e from BGPaaS f1a2d191-d221-4a0c-9888-0266ad09b492 2025-12-08 04:01:13,601 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-91854096-54395751(f1a2d191-d221-4a0c-9888-0266ad09b492) 2025-12-08 04:01:13,659 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/f1a2d191-d221-4a0c-9888-0266ad09b492 2025-12-08 04:01:13,667 - DEBUG - Response Code: 404 2025-12-08 04:01:13,667 - DEBUG - BGPaaS: f1a2d191-d221-4a0c-9888-0266ad09b492 deleted from api server 2025-12-08 04:01:13,667 - INFO - BGPaaS(f1a2d191-d221-4a0c-9888-0266ad09b492): verify_on_cleanup passed 2025-12-08 04:01:13,667 - INFO - Deleting Control node zone ctest-test-zone-57534736(e370720c-cde9-4f4a-842c-2501f794bcfd) 2025-12-08 04:01:13,825 - INFO - Deleting Control node zone ctest-test-zone-55981873(7b36a26a-c030-48d7-86aa-cccb1b0dafa0) 2025-12-08 04:01:13,966 - INFO - Deleting Control node zone ctest-test-zone-33520466(af79ccb0-7b30-40ea-915c-4814d38d256d) 2025-12-08 04:01:14,113 - INFO - Deleting VM ctest-TestBGPaasZone-91854096-00384241 2025-12-08 04:01:14,191 - INFO - Deleting VM ctest-TestBGPaasZone-91854096-40583715 2025-12-08 04:01:14,262 - INFO - Deleting VM ctest-TestBGPaasZone-91854096-99201581 2025-12-08 04:01:14,346 - INFO - Deleting VN ctest-cnz_vn-86085796 2025-12-08 04:01:14,390 - DEBUG - VN 96f18f8b-2859-4114-8c67-9cd83c361460 still in use: Unable to complete operation on network 96f18f8b-2859-4114-8c67-9cd83c361460. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3f8c53af-388c-4277-ac8d-72741f7f92b0'] 2025-12-08 04:01:14,390 - WARNING - Deleting VN ctest-cnz_vn-86085796 failed..Will retry 2025-12-08 04:01:16,588 - DEBUG - Response for deleting network () 2025-12-08 04:01:17,848 - DEBUG - Skipping xmpp flap check
2025-12-08 04:01:17,848 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:00]
2025-12-08 04:01:17,848 - INFO - -------------------------------------------------------------------------------- 2025-12-08 04:01:19,101 - INFO - Deleted project: ctest-TestBGPaasZone-91854096, ID : eb165d14-87a7-41ec-8bbb-9f6eed140996