2025-10-27 03:58:40,009 - INFO - Domain Default found not creating 2025-10-27 03:58:40,172 - INFO - Project ctest-TestBGPaasZone-98657758 not found, creating it 2025-10-27 03:58:40,711 - INFO - Created Project:ctest-TestBGPaasZone-98657758, ID : 290ff9c2-de2a-40cc-83e9-58bf66b2dd23 2025-10-27 03:58:42,267 - DEBUG - Services list from nova: [, , , ] 2025-10-27 03:58:42,267 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4489-2', 'an-jenkins-deploy-platform-ansible-os-4489-1']} 2025-10-27 03:58:42,269 - INFO - ================================================================================ 2025-10-27 03:58:42,270 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-10-27 03:58:43,534 - DEBUG - Skipping xmpp flap check 2025-10-27 03:58:43,534 - INFO - Initial checks done. Running the testcase now 2025-10-27 03:58:43,534 - INFO - 2025-10-27 03:58:43,534 - INFO - executing bgp_control_zone test 2025-10-27 03:58:44,212 - DEBUG - Response for create_network : {'network': {'id': '7bcc9289-9640-4abb-a838-8e496b3bb9c7', 'name': 'ctest-cnz_vn-20823855', 'tenant_id': '290ff9c2de2a40cc83e958bf66b2dd23', 'project_id': '290ff9c2de2a40cc83e958bf66b2dd23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-98657758', 'ctest-cnz_vn-20823855'], 'port_security_enabled': True, 'description': ''}} 2025-10-27 03:58:44,630 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b8eaf604-22a0-4f82-bfdc-0b2768501b38', 'name': '', 'tenant_id': '290ff9c2de2a40cc83e958bf66b2dd23', 'network_id': '7bcc9289-9640-4abb-a838-8e496b3bb9c7', 'ip_version': 4, 'cidr': '113.43.214.128/26', 'allocation_pools': [{'start': '113.43.214.130', 'end': '113.43.214.190'}], 'gateway_ip': '113.43.214.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '113.43.214.130', 'tags': [], 'project_id': '290ff9c2de2a40cc83e958bf66b2dd23'}} 2025-10-27 03:58:44,652 - INFO - Created VN ctest-cnz_vn-20823855 2025-10-27 03:58:44,668 - DEBUG - VN ctest-cnz_vn-20823855 UUID is 7bcc9289-9640-4abb-a838-8e496b3bb9c7 2025-10-27 03:58:45,839 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4489-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4489-2) 2025-10-27 03:58:47,418 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4489-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4489-1) 2025-10-27 03:58:49,081 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4489-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4489-2) 2025-10-27 03:58:49,081 - INFO - Waiting for VM ctest-TestBGPaasZone-98657758-60326867 to be up.. 2025-10-27 03:58:49,208 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-27 03:58:54,316 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-27 03:58:59,408 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-27 03:59:04,539 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-27 03:59:09,645 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-27 03:59:14,731 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-27 03:59:19,836 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-27 03:59:24,926 - DEBUG - VM is in ACTIVE state now 2025-10-27 03:59:24,926 - INFO - VM name : ctest-TestBGPaasZone-98657758-60326867 2025-10-27 03:59:25,009 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 ID is 9ab795d6-4d00-475e-8767-16ae89348dd7 2025-10-27 03:59:25,035 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 launched on Node an-jenkins-deploy-platform-ansible-os-4489-2 2025-10-27 03:59:25,112 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/9ab795d6-4d00-475e-8767-16ae89348dd7 2025-10-27 03:59:25,418 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/9ab795d6-4d00-475e-8767-16ae89348dd7 2025-10-27 03:59:25,459 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/496f718d-1e81-4d5f-89c1-f5260a467a58 2025-10-27 03:59:28,635 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-10-27 03:59:28,636 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:28,652 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 03:59:32,739 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-27 03:59:32,739 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:32,756 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 03:59:36,826 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-27 03:59:36,827 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:36,841 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 03:59:40,925 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-27 03:59:40,925 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:40,939 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 03:59:45,021 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-27 03:59:45,022 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:45,036 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 03:59:49,112 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-27 03:59:49,112 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:49,128 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 03:59:53,216 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-10-27 03:59:53,216 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:53,232 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 03:59:57,315 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-27 03:59:57,315 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 03:59:57,330 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:01,409 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-27 04:00:01,409 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:01,429 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:05,537 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1035ms') 2025-10-27 04:00:05,537 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:05,551 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:09,631 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-27 04:00:09,631 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:09,645 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:13,722 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-27 04:00:13,722 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:13,737 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:17,819 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-27 04:00:17,819 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:17,838 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:21,917 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-27 04:00:21,918 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:21,936 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:26,010 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-27 04:00:26,010 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:26,026 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:30,109 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-10-27 04:00:30,110 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:30,125 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:34,203 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-27 04:00:34,203 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:34,220 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:38,302 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-27 04:00:38,303 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 failed! 2025-10-27 04:00:38,317 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-20823855 is 113.43.214.129 and allocation pool is NOT set 2025-10-27 04:00:42,396 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=9.25 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1010ms\r\nrtt min/avg/max/mdev = 9.246/9.246/9.246/0.000 ms') 2025-10-27 04:00:42,396 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-60326867 passed 2025-10-27 04:00:42,470 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:00:42,470 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:00:42,540 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:00:42,639 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:00:47,639 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:00:47,639 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:00:47,712 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:00:47,813 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:00:52,814 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:00:52,814 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:00:52,887 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:00:53,009 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:00:58,011 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:00:58,011 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:00:58,073 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:00:58,162 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:01:03,163 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:03,164 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:01:03,262 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:01:03,356 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:01:08,356 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:08,357 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:01:08,423 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:01:08,523 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:01:13,523 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:13,523 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:01:13,592 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:01:13,694 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:01:18,695 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:18,695 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:01:18,753 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:01:18,840 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:01:23,840 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:23,841 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:01:23,898 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:01:23,994 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:01:28,995 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:28,995 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:01:29,063 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:01:29,151 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:01:34,152 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:34,152 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-60326867, IP 113.43.214.131, Port 22 2025-10-27 04:01:34,309 - DEBUG - VM ctest-TestBGPaasZone-98657758-60326867 is ready for SSH connections 2025-10-27 04:01:34,309 - INFO - Waiting for VM ctest-TestBGPaasZone-98657758-62520455 to be up.. 2025-10-27 04:01:34,395 - DEBUG - VM is in ACTIVE state now 2025-10-27 04:01:34,395 - INFO - VM name : ctest-TestBGPaasZone-98657758-62520455 2025-10-27 04:01:34,481 - DEBUG - VM ctest-TestBGPaasZone-98657758-62520455 ID is d965aba4-e0e2-4e79-ac8e-9b9145ef9e8b 2025-10-27 04:01:34,481 - DEBUG - VM ctest-TestBGPaasZone-98657758-62520455 launched on Node an-jenkins-deploy-platform-ansible-os-4489-1 2025-10-27 04:01:34,582 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/d965aba4-e0e2-4e79-ac8e-9b9145ef9e8b 2025-10-27 04:01:34,596 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/6b5016c8-b005-4819-a90d-afb803322783 2025-10-27 04:01:35,761 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.66 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.553 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.553/2.106/3.659/1.553 ms') 2025-10-27 04:01:35,761 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-62520455 passed 2025-10-27 04:01:35,829 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:35,829 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-62520455, IP 113.43.214.132, Port 22 2025-10-27 04:01:35,987 - DEBUG - VM ctest-TestBGPaasZone-98657758-62520455 is ready for SSH connections 2025-10-27 04:01:35,987 - INFO - Waiting for VM ctest-TestBGPaasZone-98657758-46903715 to be up.. 2025-10-27 04:01:36,069 - DEBUG - VM is in ACTIVE state now 2025-10-27 04:01:36,070 - INFO - VM name : ctest-TestBGPaasZone-98657758-46903715 2025-10-27 04:01:36,151 - DEBUG - VM ctest-TestBGPaasZone-98657758-46903715 ID is 6f1d0272-fab2-4502-abf3-e914f92be3c0 2025-10-27 04:01:36,151 - DEBUG - VM ctest-TestBGPaasZone-98657758-46903715 launched on Node an-jenkins-deploy-platform-ansible-os-4489-2 2025-10-27 04:01:36,230 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/6f1d0272-fab2-4502-abf3-e914f92be3c0 2025-10-27 04:01:36,240 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/e608fced-ecc2-42ae-99b8-36d79717f667 2025-10-27 04:01:37,398 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=11.7 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.752 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.752/6.231/11.711/5.479 ms') 2025-10-27 04:01:37,398 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-98657758-46903715 passed 2025-10-27 04:01:37,470 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:37,470 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-46903715, IP 113.43.214.133, Port 22 2025-10-27 04:01:37,633 - DEBUG - VM ctest-TestBGPaasZone-98657758-46903715 is ready for SSH connections 2025-10-27 04:01:37,785 - INFO - Created control node zone ctest-test-zone-08700899(1e856140-6d14-452d-a32c-930893c51657) 2025-10-27 04:01:38,149 - INFO - Created control node zone ctest-test-zone-72366189(ca479baa-5727-4f72-a4ea-2c1f8cceebd2) 2025-10-27 04:01:38,525 - INFO - Created control node zone ctest-test-zone-02317395(0e23a785-061b-40a9-bed6-1c2934474dd7) 2025-10-27 04:01:38,809 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98657758-41785914 2025-10-27 04:01:38,893 - INFO - BGPaaS: ctest-TestBGPaasZone-98657758-41785914(e738d3d6-0a89-4a89-856f-91d2f75f7d0f) 2025-10-27 04:01:38,893 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:01:39,217 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:01:39,287 - INFO - verify_in_api_server passed for BGPaaS obj e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:01:39,287 - INFO - BGPaaS(e738d3d6-0a89-4a89-856f-91d2f75f7d0f): verify_on_setup passed 2025-10-27 04:01:39,287 - INFO - We will configure BGP on the VM 2025-10-27 04:01:39,553 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:39,553 - INFO - Configuring BGP on ctest-TestBGPaasZone-98657758-60326867 2025-10-27 04:01:39,553 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:01:39,553 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS 2025-10-27 04:01:54,546 - DEBUG - None 2025-10-27 04:01:54,546 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:01:54,546 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS 2025-10-27 04:01:55,588 - DEBUG - None 2025-10-27 04:01:55,588 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:01:55,588 - DEBUG - service bird restart 2025-10-27 04:01:58,666 - DEBUG - bird stop/waiting bird start/running, process 1443 2025-10-27 04:01:58,666 - INFO - Attaching VMI 496f718d-1e81-4d5f-89c1-f5260a467a58 to BGPaaS e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:01:58,745 - INFO - Attaching the VMI 9ab795d6-4d00-475e-8767-16ae89348dd7 to the BGPaaS e738d3d6-0a89-4a89-856f-91d2f75f7d0f object 2025-10-27 04:01:58,745 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 113.43.214.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:01:58,746 - DEBUG - sudo ip addr add 113.43.214.148 dev eth0 2025-10-27 04:01:59,483 - DEBUG - None 2025-10-27 04:01:59,545 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98657758-90987285 2025-10-27 04:01:59,625 - INFO - BGPaaS: ctest-TestBGPaasZone-98657758-90987285(7806d54f-2ec1-4c1e-8f4f-a058318cb45b) 2025-10-27 04:01:59,626 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/7806d54f-2ec1-4c1e-8f4f-a058318cb45b 2025-10-27 04:01:59,639 - INFO - verify_in_api_server passed for BGPaaS obj 7806d54f-2ec1-4c1e-8f4f-a058318cb45b 2025-10-27 04:01:59,640 - INFO - BGPaaS(7806d54f-2ec1-4c1e-8f4f-a058318cb45b): verify_on_setup passed 2025-10-27 04:01:59,640 - INFO - We will configure BGP on the VM 2025-10-27 04:01:59,909 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:01:59,910 - INFO - Configuring BGP on ctest-TestBGPaasZone-98657758-62520455 2025-10-27 04:01:59,910 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.132; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.132; } protocol bfd { neighbor 113.43.214.130 local 113.43.214.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:01:59,910 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.132; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.132; } protocol bfd { neighbor 113.43.214.130 local 113.43.214.132 multihop on; } EOS 2025-10-27 04:02:05,700 - DEBUG - None 2025-10-27 04:02:05,700 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.132; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.132; } protocol bfd { neighbor 113.43.214.130 local 113.43.214.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:02:05,700 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.132; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.132; } protocol bfd { neighbor 113.43.214.130 local 113.43.214.132 multihop on; } EOS 2025-10-27 04:02:06,229 - DEBUG - None 2025-10-27 04:02:06,229 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:02:06,229 - DEBUG - service bird restart 2025-10-27 04:02:08,038 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-10-27 04:02:08,038 - INFO - Attaching VMI 6b5016c8-b005-4819-a90d-afb803322783 to BGPaaS 7806d54f-2ec1-4c1e-8f4f-a058318cb45b 2025-10-27 04:02:08,129 - INFO - Attaching the VMI d965aba4-e0e2-4e79-ac8e-9b9145ef9e8b to the BGPaaS 7806d54f-2ec1-4c1e-8f4f-a058318cb45b object 2025-10-27 04:02:08,129 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 113.43.214.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:02:08,129 - DEBUG - sudo ip addr add 113.43.214.148 dev eth0 2025-10-27 04:02:08,864 - DEBUG - None 2025-10-27 04:02:08,864 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:02:08,864 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:02:08,883 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-27 04:02:08,890 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:02:08,907 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-10-27 04:02:14,926 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-27 04:02:14,932 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 113.43.214.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:14,932 - DEBUG - ping -s 56 -c 3 -W 1 113.43.214.148 2025-10-27 04:02:22,100 - DEBUG - PING 113.43.214.148 (113.43.214.148) 56(84) bytes of data. 64 bytes from 113.43.214.148: icmp_seq=1 ttl=64 time=8.72 ms 64 bytes from 113.43.214.148: icmp_seq=2 ttl=64 time=1.35 ms 64 bytes from 113.43.214.148: icmp_seq=3 ttl=64 time=2.05 ms --- 113.43.214.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.350/4.045/8.728/3.323 ms 2025-10-27 04:02:22,100 - INFO - Ping to IP 113.43.214.148 from VM ctest-TestBGPaasZone-98657758-46903715 passed 2025-10-27 04:02:22,917 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:22,917 - DEBUG - service bird restart 2025-10-27 04:02:24,573 - DEBUG - bird stop/waiting bird start/running, process 1470 2025-10-27 04:02:24,573 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:02:24,573 - DEBUG - service bird restart 2025-10-27 04:02:26,311 - DEBUG - bird stop/waiting bird start/running, process 1466 2025-10-27 04:02:26,312 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:02:26,334 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-10-27 04:02:32,354 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-10-27 04:02:32,360 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:02:32,377 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-27 04:02:32,384 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 113.43.214.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:32,384 - DEBUG - ping -s 56 -c 3 -W 1 113.43.214.148 2025-10-27 04:02:34,922 - DEBUG - PING 113.43.214.148 (113.43.214.148) 56(84) bytes of data. 64 bytes from 113.43.214.148: icmp_seq=1 ttl=64 time=3.84 ms 64 bytes from 113.43.214.148: icmp_seq=2 ttl=64 time=1.66 ms 64 bytes from 113.43.214.148: icmp_seq=3 ttl=64 time=1.60 ms --- 113.43.214.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.604/2.369/3.841/1.041 ms 2025-10-27 04:02:34,923 - INFO - Ping to IP 113.43.214.148 from VM ctest-TestBGPaasZone-98657758-46903715 passed 2025-10-27 04:02:35,259 - INFO - We will configure BGP on the VM 2025-10-27 04:02:35,481 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:02:35,481 - INFO - Configuring BGP on ctest-TestBGPaasZone-98657758-60326867 2025-10-27 04:02:35,481 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:35,481 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS 2025-10-27 04:02:35,998 - DEBUG - None 2025-10-27 04:02:35,998 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:35,998 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 113.43.214.131; protocol bgp bgp_1{ local as 65000; neighbor 113.43.214.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 113.43.214.131; } protocol bfd { neighbor 113.43.214.129 local 113.43.214.131 multihop on; } EOS 2025-10-27 04:02:36,551 - DEBUG - None 2025-10-27 04:02:36,551 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:36,551 - DEBUG - service bird restart 2025-10-27 04:02:38,389 - DEBUG - bird stop/waiting bird start/running, process 1502 2025-10-27 04:02:38,390 - INFO - Attaching VMI 496f718d-1e81-4d5f-89c1-f5260a467a58 to BGPaaS e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:02:38,415 - INFO - Attaching the VMI 9ab795d6-4d00-475e-8767-16ae89348dd7 to the BGPaaS e738d3d6-0a89-4a89-856f-91d2f75f7d0f object 2025-10-27 04:02:38,415 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 113.43.214.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:38,415 - DEBUG - sudo ip addr add 113.43.214.148 dev eth0 2025-10-27 04:02:39,186 - DEBUG - RTNETLINK answers: File exists 2025-10-27 04:02:39,186 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:39,186 - DEBUG - service bird restart 2025-10-27 04:02:40,984 - DEBUG - bird stop/waiting bird start/running, process 1529 2025-10-27 04:02:40,984 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:02:40,984 - DEBUG - service bird restart 2025-10-27 04:02:42,751 - DEBUG - bird stop/waiting bird start/running, process 1488 2025-10-27 04:02:42,751 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:02:42,752 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:02:42,766 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-27 04:02:48,767 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:02:48,791 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-27 04:02:48,799 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:02:48,815 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-27 04:02:48,824 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 113.43.214.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:02:48,824 - DEBUG - ping -s 56 -c 3 -W 1 113.43.214.148 2025-10-27 04:02:51,338 - DEBUG - PING 113.43.214.148 (113.43.214.148) 56(84) bytes of data. 64 bytes from 113.43.214.148: icmp_seq=1 ttl=64 time=5.55 ms 64 bytes from 113.43.214.148: icmp_seq=2 ttl=64 time=1.04 ms 64 bytes from 113.43.214.148: icmp_seq=3 ttl=64 time=1.59 ms --- 113.43.214.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.043/2.730/5.555/2.010 ms 2025-10-27 04:02:51,338 - INFO - Ping to IP 113.43.214.148 from VM ctest-TestBGPaasZone-98657758-46903715 passed 2025-10-27 04:02:51,338 - INFO - Detaching VMI 496f718d-1e81-4d5f-89c1-f5260a467a58 from BGPaaS e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:02:51,413 - INFO - Detaching VMI 6b5016c8-b005-4819-a90d-afb803322783 from BGPaaS 7806d54f-2ec1-4c1e-8f4f-a058318cb45b 2025-10-27 04:02:51,497 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98657758-90987285(7806d54f-2ec1-4c1e-8f4f-a058318cb45b) 2025-10-27 04:02:51,544 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/7806d54f-2ec1-4c1e-8f4f-a058318cb45b 2025-10-27 04:02:51,551 - DEBUG - Response Code: 404 2025-10-27 04:02:51,551 - DEBUG - BGPaaS: 7806d54f-2ec1-4c1e-8f4f-a058318cb45b deleted from api server 2025-10-27 04:02:51,551 - INFO - BGPaaS(7806d54f-2ec1-4c1e-8f4f-a058318cb45b): verify_on_cleanup passed 2025-10-27 04:02:51,551 - INFO - Detaching VMI 496f718d-1e81-4d5f-89c1-f5260a467a58 from BGPaaS e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:02:51,570 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98657758-41785914(e738d3d6-0a89-4a89-856f-91d2f75f7d0f) 2025-10-27 04:02:51,608 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/e738d3d6-0a89-4a89-856f-91d2f75f7d0f 2025-10-27 04:02:51,616 - DEBUG - Response Code: 404 2025-10-27 04:02:51,617 - DEBUG - BGPaaS: e738d3d6-0a89-4a89-856f-91d2f75f7d0f deleted from api server 2025-10-27 04:02:51,617 - INFO - BGPaaS(e738d3d6-0a89-4a89-856f-91d2f75f7d0f): verify_on_cleanup passed 2025-10-27 04:02:51,617 - INFO - Deleting Control node zone ctest-test-zone-02317395(0e23a785-061b-40a9-bed6-1c2934474dd7) 2025-10-27 04:02:51,760 - INFO - Deleting Control node zone ctest-test-zone-72366189(ca479baa-5727-4f72-a4ea-2c1f8cceebd2) 2025-10-27 04:02:51,904 - INFO - Deleting Control node zone ctest-test-zone-08700899(1e856140-6d14-452d-a32c-930893c51657) 2025-10-27 04:02:52,010 - INFO - Deleting VM ctest-TestBGPaasZone-98657758-46903715 2025-10-27 04:02:52,151 - INFO - Deleting VM ctest-TestBGPaasZone-98657758-62520455 2025-10-27 04:02:52,227 - INFO - Deleting VM ctest-TestBGPaasZone-98657758-60326867 2025-10-27 04:02:52,308 - INFO - Deleting VN ctest-cnz_vn-20823855 2025-10-27 04:02:52,360 - DEBUG - VN 7bcc9289-9640-4abb-a838-8e496b3bb9c7 still in use: Unable to complete operation on network 7bcc9289-9640-4abb-a838-8e496b3bb9c7. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-23519a69-2542-4f1e-a6c8-08b601a85bbe'] 2025-10-27 04:02:52,361 - WARNING - Deleting VN ctest-cnz_vn-20823855 failed..Will retry 2025-10-27 04:02:54,594 - DEBUG - Response for deleting network () 2025-10-27 04:02:55,869 - DEBUG - Skipping xmpp flap check 2025-10-27 04:02:55,869 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:13] 2025-10-27 04:02:55,869 - INFO - -------------------------------------------------------------------------------- 2025-10-27 04:02:55,873 - INFO - ================================================================================ 2025-10-27 04:02:55,873 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-10-27 04:02:57,137 - DEBUG - Skipping xmpp flap check 2025-10-27 04:02:57,137 - INFO - Initial checks done. Running the testcase now 2025-10-27 04:02:57,137 - INFO - 2025-10-27 04:02:57,137 - INFO - executing bgp_control_zone agent restart test 2025-10-27 04:02:57,436 - DEBUG - Response for create_network : {'network': {'id': '96112003-7706-4571-8e30-890d1c36d81c', 'name': 'ctest-cnz_vn-39410597', 'tenant_id': '290ff9c2de2a40cc83e958bf66b2dd23', 'project_id': '290ff9c2de2a40cc83e958bf66b2dd23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-98657758', 'ctest-cnz_vn-39410597'], 'port_security_enabled': True, 'description': ''}} 2025-10-27 04:02:57,722 - DEBUG - Response for create_subnet : {'subnet': {'id': '62aab743-b377-4b04-bf58-0dc86ab7efbf', 'name': '', 'tenant_id': '290ff9c2de2a40cc83e958bf66b2dd23', 'network_id': '96112003-7706-4571-8e30-890d1c36d81c', 'ip_version': 4, 'cidr': '108.35.76.192/26', 'allocation_pools': [{'start': '108.35.76.194', 'end': '108.35.76.254'}], 'gateway_ip': '108.35.76.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '108.35.76.194', 'tags': [], 'project_id': '290ff9c2de2a40cc83e958bf66b2dd23'}} 2025-10-27 04:02:57,749 - INFO - Created VN ctest-cnz_vn-39410597 2025-10-27 04:02:57,761 - DEBUG - VN ctest-cnz_vn-39410597 UUID is 96112003-7706-4571-8e30-890d1c36d81c 2025-10-27 04:02:58,984 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4489-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4489-1) 2025-10-27 04:03:00,458 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4489-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4489-2) 2025-10-27 04:03:02,072 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4489-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4489-1) 2025-10-27 04:03:02,072 - INFO - Waiting for VM ctest-TestBGPaasZone-98657758-65656103 to be up.. 2025-10-27 04:03:02,193 - DEBUG - VM is in ACTIVE state now 2025-10-27 04:03:02,193 - INFO - VM name : ctest-TestBGPaasZone-98657758-65656103 2025-10-27 04:03:02,299 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 ID is 4be09eff-f280-4149-9365-7f5a6ed9caf7 2025-10-27 04:03:02,299 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 launched on Node an-jenkins-deploy-platform-ansible-os-4489-1 2025-10-27 04:03:02,390 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/4be09eff-f280-4149-9365-7f5a6ed9caf7 2025-10-27 04:03:02,402 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/f6aa0843-2f44-42fa-b0f4-5e17be2d8740 2025-10-27 04:03:05,600 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-27 04:03:05,601 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:05,614 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:09,697 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-27 04:03:09,697 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:09,714 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:13,796 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-27 04:03:13,796 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:13,810 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:17,889 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-27 04:03:17,889 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:17,902 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:21,990 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-10-27 04:03:21,990 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:22,005 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:26,077 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-27 04:03:26,077 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:26,093 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:30,182 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-27 04:03:30,182 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:30,201 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:34,270 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-27 04:03:34,270 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:34,284 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:38,370 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-10-27 04:03:38,370 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:38,390 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:42,468 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-27 04:03:42,469 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:42,484 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:46,565 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-27 04:03:46,566 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:46,611 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:50,689 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-27 04:03:50,689 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:50,708 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:54,790 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-27 04:03:54,790 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:54,809 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:03:58,884 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-27 04:03:58,884 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:03:58,900 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:04:02,980 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-27 04:04:02,980 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:04:03,004 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:04:07,071 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-10-27 04:04:07,071 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:04:07,085 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:04:11,178 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-27 04:04:11,178 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:04:11,194 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:04:15,263 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-10-27 04:04:15,263 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:04:15,277 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:04:19,358 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-27 04:04:19,359 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 failed! 2025-10-27 04:04:19,373 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98657758:ctest-cnz_vn-39410597 is 108.35.76.193 and allocation pool is NOT set 2025-10-27 04:04:21,445 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.70 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.26 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.255/3.477/3.700/0.222 ms') 2025-10-27 04:04:21,446 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-65656103 passed 2025-10-27 04:04:21,517 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:21,518 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:21,585 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:21,750 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:04:26,750 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:26,751 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:26,820 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:27,083 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:04:32,084 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:32,084 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:32,139 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:32,234 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:04:37,235 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:37,235 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:37,301 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:37,402 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:04:42,402 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:42,402 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:42,459 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:42,556 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:04:47,557 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:47,558 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:47,617 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:47,717 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:04:52,717 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:52,717 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:52,775 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:52,877 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:04:57,877 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:04:57,877 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:04:57,940 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:04:58,038 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:05:03,039 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:03,039 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:05:03,109 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:05:03,220 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:05:08,221 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:08,221 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:05:08,279 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:05:08,385 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:05:13,386 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:13,387 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-65656103, IP 108.35.76.195, Port 22 2025-10-27 04:05:13,553 - DEBUG - VM ctest-TestBGPaasZone-98657758-65656103 is ready for SSH connections 2025-10-27 04:05:13,554 - INFO - Waiting for VM ctest-TestBGPaasZone-98657758-11834574 to be up.. 2025-10-27 04:05:13,649 - DEBUG - VM is in ACTIVE state now 2025-10-27 04:05:13,649 - INFO - VM name : ctest-TestBGPaasZone-98657758-11834574 2025-10-27 04:05:13,760 - DEBUG - VM ctest-TestBGPaasZone-98657758-11834574 ID is 3502cfbe-a02d-4a3a-b9d9-5d7c12580c3e 2025-10-27 04:05:13,760 - DEBUG - VM ctest-TestBGPaasZone-98657758-11834574 launched on Node an-jenkins-deploy-platform-ansible-os-4489-2 2025-10-27 04:05:13,865 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/3502cfbe-a02d-4a3a-b9d9-5d7c12580c3e 2025-10-27 04:05:13,898 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/9f507b3c-af20-4840-8cd9-1a353e0a6b66 2025-10-27 04:05:15,073 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=13.6 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.60 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.604/7.616/13.628/6.012 ms') 2025-10-27 04:05:15,074 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98657758-11834574 passed 2025-10-27 04:05:15,142 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:15,142 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-11834574, IP 108.35.76.196, Port 22 2025-10-27 04:05:15,319 - DEBUG - VM ctest-TestBGPaasZone-98657758-11834574 is ready for SSH connections 2025-10-27 04:05:15,319 - INFO - Waiting for VM ctest-TestBGPaasZone-98657758-19595000 to be up.. 2025-10-27 04:05:15,412 - DEBUG - VM is in ACTIVE state now 2025-10-27 04:05:15,412 - INFO - VM name : ctest-TestBGPaasZone-98657758-19595000 2025-10-27 04:05:15,498 - DEBUG - VM ctest-TestBGPaasZone-98657758-19595000 ID is 0dcdd00b-78b6-40af-8139-55857d855c42 2025-10-27 04:05:15,499 - DEBUG - VM ctest-TestBGPaasZone-98657758-19595000 launched on Node an-jenkins-deploy-platform-ansible-os-4489-1 2025-10-27 04:05:15,608 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/0dcdd00b-78b6-40af-8139-55857d855c42 2025-10-27 04:05:15,619 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/e4fb2305-8fd4-45e6-9a64-749369703e5e 2025-10-27 04:05:16,782 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.98 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.72 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.721/2.849/3.977/1.128 ms') 2025-10-27 04:05:16,782 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-98657758-19595000 passed 2025-10-27 04:05:16,855 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:16,855 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-19595000, IP 108.35.76.197, Port 22 2025-10-27 04:05:16,921 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:05:17,015 - DEBUG - VM ctest-TestBGPaasZone-98657758-19595000 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:05:22,016 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:22,017 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-19595000, IP 108.35.76.197, Port 22 2025-10-27 04:05:22,085 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-27 04:05:22,182 - DEBUG - VM ctest-TestBGPaasZone-98657758-19595000 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-27 04:05:27,183 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:27,183 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98657758-19595000, IP 108.35.76.197, Port 22 2025-10-27 04:05:27,358 - DEBUG - VM ctest-TestBGPaasZone-98657758-19595000 is ready for SSH connections 2025-10-27 04:05:27,497 - INFO - Created control node zone ctest-test-zone-65333228(13b194f8-2d7d-4d02-8b13-54c0d4a9cc30) 2025-10-27 04:05:27,853 - INFO - Created control node zone ctest-test-zone-52758753(46b73fa8-5e88-488d-b515-fe5e25752d6f) 2025-10-27 04:05:28,197 - INFO - Created control node zone ctest-test-zone-01392399(f032bc4a-45c2-454a-a791-e5fff9945fc2) 2025-10-27 04:05:28,477 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98657758-46881095 2025-10-27 04:05:28,557 - INFO - BGPaaS: ctest-TestBGPaasZone-98657758-46881095(2157b1e1-844f-4465-8889-0626591c2a0b) 2025-10-27 04:05:28,558 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/2157b1e1-844f-4465-8889-0626591c2a0b 2025-10-27 04:05:28,572 - INFO - verify_in_api_server passed for BGPaaS obj 2157b1e1-844f-4465-8889-0626591c2a0b 2025-10-27 04:05:28,572 - INFO - BGPaaS(2157b1e1-844f-4465-8889-0626591c2a0b): verify_on_setup passed 2025-10-27 04:05:28,572 - INFO - We will configure BGP on the VM 2025-10-27 04:05:29,017 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:29,017 - INFO - Configuring BGP on ctest-TestBGPaasZone-98657758-65656103 2025-10-27 04:05:29,017 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 108.35.76.195; protocol bgp bgp_1{ local as 65000; neighbor 108.35.76.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.195; } protocol bfd { neighbor 108.35.76.193 local 108.35.76.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:05:29,017 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 108.35.76.195; protocol bgp bgp_1{ local as 65000; neighbor 108.35.76.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.195; } protocol bfd { neighbor 108.35.76.193 local 108.35.76.195 multihop on; } EOS 2025-10-27 04:05:36,377 - DEBUG - None 2025-10-27 04:05:36,378 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 108.35.76.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.195; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:05:36,378 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 108.35.76.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.195; } EOS 2025-10-27 04:05:36,970 - DEBUG - None 2025-10-27 04:05:36,970 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:05:36,970 - DEBUG - service bird restart 2025-10-27 04:05:38,964 - DEBUG - bird stop/waiting bird start/running, process 1440 2025-10-27 04:05:38,965 - INFO - Attaching VMI f6aa0843-2f44-42fa-b0f4-5e17be2d8740 to BGPaaS 2157b1e1-844f-4465-8889-0626591c2a0b 2025-10-27 04:05:39,037 - INFO - Attaching the VMI 4be09eff-f280-4149-9365-7f5a6ed9caf7 to the BGPaaS 2157b1e1-844f-4465-8889-0626591c2a0b object 2025-10-27 04:05:39,037 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 108.35.76.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:05:39,038 - DEBUG - sudo ip addr add 108.35.76.212 dev eth0 2025-10-27 04:05:39,831 - DEBUG - None 2025-10-27 04:05:39,893 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98657758-07197349 2025-10-27 04:05:39,977 - INFO - BGPaaS: ctest-TestBGPaasZone-98657758-07197349(4a879f88-4039-4e80-85fa-1bdc6bd0223e) 2025-10-27 04:05:39,977 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/4a879f88-4039-4e80-85fa-1bdc6bd0223e 2025-10-27 04:05:39,987 - INFO - verify_in_api_server passed for BGPaaS obj 4a879f88-4039-4e80-85fa-1bdc6bd0223e 2025-10-27 04:05:39,987 - INFO - BGPaaS(4a879f88-4039-4e80-85fa-1bdc6bd0223e): verify_on_setup passed 2025-10-27 04:05:39,987 - INFO - We will configure BGP on the VM 2025-10-27 04:05:40,413 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:40,413 - INFO - Configuring BGP on ctest-TestBGPaasZone-98657758-11834574 2025-10-27 04:05:40,413 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 108.35.76.196; protocol bgp bgp_1{ local as 65000; neighbor 108.35.76.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.196; } protocol bfd { neighbor 108.35.76.193 local 108.35.76.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:05:40,413 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 108.35.76.196; protocol bgp bgp_1{ local as 65000; neighbor 108.35.76.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.196; } protocol bfd { neighbor 108.35.76.193 local 108.35.76.196 multihop on; } EOS 2025-10-27 04:05:46,327 - DEBUG - None 2025-10-27 04:05:46,327 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 108.35.76.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.196; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:05:46,327 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 108.35.76.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 108.35.76.196; } EOS 2025-10-27 04:05:46,883 - DEBUG - None 2025-10-27 04:05:46,883 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:05:46,883 - DEBUG - service bird restart 2025-10-27 04:05:48,637 - DEBUG - bird stop/waiting bird start/running, process 1440 2025-10-27 04:05:48,637 - INFO - Attaching VMI 9f507b3c-af20-4840-8cd9-1a353e0a6b66 to BGPaaS 4a879f88-4039-4e80-85fa-1bdc6bd0223e 2025-10-27 04:05:48,709 - INFO - Attaching the VMI 3502cfbe-a02d-4a3a-b9d9-5d7c12580c3e to the BGPaaS 4a879f88-4039-4e80-85fa-1bdc6bd0223e object 2025-10-27 04:05:48,709 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 108.35.76.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-27 04:05:48,710 - DEBUG - sudo ip addr add 108.35.76.212 dev eth0 2025-10-27 04:05:49,463 - DEBUG - None 2025-10-27 04:05:49,463 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:49,463 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:05:49,479 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-27 04:05:49,479 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:49,501 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-27 04:05:49,508 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:05:49,509 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:05:49,523 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-27 04:05:55,524 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:05:55,540 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-27 04:06:01,541 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:06:01,558 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-27 04:06:01,559 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:06:01,579 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-27 04:06:01,587 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.35.76.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:06:01,587 - DEBUG - ping -s 56 -c 3 -W 1 108.35.76.212 2025-10-27 04:06:08,184 - DEBUG - PING 108.35.76.212 (108.35.76.212) 56(84) bytes of data. 64 bytes from 108.35.76.212: icmp_seq=1 ttl=64 time=8.83 ms 64 bytes from 108.35.76.212: icmp_seq=2 ttl=64 time=1.28 ms 64 bytes from 108.35.76.212: icmp_seq=3 ttl=64 time=1.27 ms --- 108.35.76.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.270/3.794/8.832/3.562 ms 2025-10-27 04:06:08,185 - INFO - Ping to IP 108.35.76.212 from VM ctest-TestBGPaasZone-98657758-19595000 passed 2025-10-27 04:06:08,185 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:06:08,185 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:06:08,205 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-27 04:06:08,206 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:06:08,222 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-27 04:06:08,229 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:06:08,229 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-27 04:06:08,247 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-27 04:06:08,247 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-27 04:06:08,265 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-27 04:06:08,272 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.35.76.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-27 04:06:08,272 - DEBUG - ping -s 56 -c 3 -W 1 108.35.76.212 2025-10-27 04:06:10,792 - DEBUG - PING 108.35.76.212 (108.35.76.212) 56(84) bytes of data. 64 bytes from 108.35.76.212: icmp_seq=1 ttl=64 time=4.97 ms 64 bytes from 108.35.76.212: icmp_seq=2 ttl=64 time=0.916 ms 64 bytes from 108.35.76.212: icmp_seq=3 ttl=64 time=0.906 ms --- 108.35.76.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.906/2.265/4.974/1.915 ms 2025-10-27 04:06:10,792 - INFO - Ping to IP 108.35.76.212 from VM ctest-TestBGPaasZone-98657758-19595000 passed 2025-10-27 04:06:10,792 - INFO - Detaching VMI 9f507b3c-af20-4840-8cd9-1a353e0a6b66 from BGPaaS 4a879f88-4039-4e80-85fa-1bdc6bd0223e 2025-10-27 04:06:10,881 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98657758-07197349(4a879f88-4039-4e80-85fa-1bdc6bd0223e) 2025-10-27 04:06:10,950 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/4a879f88-4039-4e80-85fa-1bdc6bd0223e 2025-10-27 04:06:10,957 - DEBUG - Response Code: 404 2025-10-27 04:06:10,957 - DEBUG - BGPaaS: 4a879f88-4039-4e80-85fa-1bdc6bd0223e deleted from api server 2025-10-27 04:06:10,957 - INFO - BGPaaS(4a879f88-4039-4e80-85fa-1bdc6bd0223e): verify_on_cleanup passed 2025-10-27 04:06:10,958 - INFO - Detaching VMI f6aa0843-2f44-42fa-b0f4-5e17be2d8740 from BGPaaS 2157b1e1-844f-4465-8889-0626591c2a0b 2025-10-27 04:06:11,061 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98657758-46881095(2157b1e1-844f-4465-8889-0626591c2a0b) 2025-10-27 04:06:11,137 - DEBUG - Requesting: http://10.0.0.249:8082/bgp-as-a-service/2157b1e1-844f-4465-8889-0626591c2a0b 2025-10-27 04:06:11,148 - DEBUG - Response Code: 404 2025-10-27 04:06:11,148 - DEBUG - BGPaaS: 2157b1e1-844f-4465-8889-0626591c2a0b deleted from api server 2025-10-27 04:06:11,148 - INFO - BGPaaS(2157b1e1-844f-4465-8889-0626591c2a0b): verify_on_cleanup passed 2025-10-27 04:06:11,149 - INFO - Deleting Control node zone ctest-test-zone-01392399(f032bc4a-45c2-454a-a791-e5fff9945fc2) 2025-10-27 04:06:11,294 - INFO - Deleting Control node zone ctest-test-zone-52758753(46b73fa8-5e88-488d-b515-fe5e25752d6f) 2025-10-27 04:06:11,440 - INFO - Deleting Control node zone ctest-test-zone-65333228(13b194f8-2d7d-4d02-8b13-54c0d4a9cc30) 2025-10-27 04:06:11,585 - INFO - Deleting VM ctest-TestBGPaasZone-98657758-19595000 2025-10-27 04:06:11,668 - INFO - Deleting VM ctest-TestBGPaasZone-98657758-11834574 2025-10-27 04:06:11,737 - INFO - Deleting VM ctest-TestBGPaasZone-98657758-65656103 2025-10-27 04:06:11,802 - INFO - Deleting VN ctest-cnz_vn-39410597 2025-10-27 04:06:11,844 - DEBUG - VN 96112003-7706-4571-8e30-890d1c36d81c still in use: Unable to complete operation on network 96112003-7706-4571-8e30-890d1c36d81c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0985e5ce-c5c9-4fd6-aead-e2540d992fb5'] 2025-10-27 04:06:11,844 - WARNING - Deleting VN ctest-cnz_vn-39410597 failed..Will retry 2025-10-27 04:06:14,055 - DEBUG - Response for deleting network () 2025-10-27 04:06:15,356 - DEBUG - Skipping xmpp flap check 2025-10-27 04:06:15,356 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:20] 2025-10-27 04:06:15,356 - INFO - -------------------------------------------------------------------------------- 2025-10-27 04:06:16,195 - INFO - Deleted project: ctest-TestBGPaasZone-98657758, ID : 290ff9c2-de2a-40cc-83e9-58bf66b2dd23