2025-11-17 03:55:17,183 - INFO - Domain Default found not creating 2025-11-17 03:55:17,371 - INFO - Project ctest-TestBGPaasZone-23100938 not found, creating it 2025-11-17 03:55:17,984 - INFO - Created Project:ctest-TestBGPaasZone-23100938, ID : 0fc0f043-2de9-4b2a-8b97-a3040463c391 2025-11-17 03:55:19,821 - DEBUG - Services list from nova: [, , , ] 2025-11-17 03:55:19,821 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4736-1', 'an-jenkins-deploy-platform-ansible-os-4736-2']} 2025-11-17 03:55:19,824 - INFO - ================================================================================ 2025-11-17 03:55:19,824 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-11-17 03:55:21,095 - DEBUG - Skipping xmpp flap check 2025-11-17 03:55:21,095 - INFO - Initial checks done. Running the testcase now 2025-11-17 03:55:21,096 - INFO - 2025-11-17 03:55:21,096 - INFO - executing bgp_control_zone test 2025-11-17 03:55:21,875 - DEBUG - Response for create_network : {'network': {'id': '504cea95-07a9-4c51-b5c8-31540c8f9efd', 'name': 'ctest-cnz_vn-35930463', 'tenant_id': '0fc0f0432de94b2a8b97a3040463c391', 'project_id': '0fc0f0432de94b2a8b97a3040463c391', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-23100938', 'ctest-cnz_vn-35930463'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:55:22,172 - DEBUG - Response for create_subnet : {'subnet': {'id': '359afa11-6069-4614-bc9f-45597cbe87e2', 'name': '', 'tenant_id': '0fc0f0432de94b2a8b97a3040463c391', 'network_id': '504cea95-07a9-4c51-b5c8-31540c8f9efd', 'ip_version': 4, 'cidr': '47.81.167.0/26', 'allocation_pools': [{'start': '47.81.167.2', 'end': '47.81.167.62'}], 'gateway_ip': '47.81.167.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '47.81.167.2', 'tags': [], 'project_id': '0fc0f0432de94b2a8b97a3040463c391'}} 2025-11-17 03:55:22,196 - INFO - Created VN ctest-cnz_vn-35930463 2025-11-17 03:55:22,210 - DEBUG - VN ctest-cnz_vn-35930463 UUID is 504cea95-07a9-4c51-b5c8-31540c8f9efd 2025-11-17 03:55:23,592 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-1) 2025-11-17 03:55:25,361 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-2) 2025-11-17 03:55:27,321 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-1) 2025-11-17 03:55:27,321 - INFO - Waiting for VM ctest-TestBGPaasZone-23100938-48152215 to be up.. 2025-11-17 03:55:27,476 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-17 03:55:32,564 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-17 03:55:37,652 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-17 03:55:42,742 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-17 03:55:47,827 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-17 03:55:52,914 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-17 03:55:58,000 - DEBUG - VM is in ACTIVE state now 2025-11-17 03:55:58,000 - INFO - VM name : ctest-TestBGPaasZone-23100938-48152215 2025-11-17 03:55:58,087 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 ID is 72abf7a8-6714-4aee-9b07-56e6c6ca92e1 2025-11-17 03:55:58,112 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 launched on Node an-jenkins-deploy-platform-ansible-os-4736-1 2025-11-17 03:55:58,192 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/72abf7a8-6714-4aee-9b07-56e6c6ca92e1 2025-11-17 03:55:58,536 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/72abf7a8-6714-4aee-9b07-56e6c6ca92e1 2025-11-17 03:55:58,579 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/8b21803f-250c-4ce9-8945-021d9fd72e49 2025-11-17 03:56:01,751 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-17 03:56:01,751 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:01,769 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:05,841 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-17 03:56:05,841 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:05,857 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:09,947 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-11-17 03:56:09,947 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:09,964 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:14,034 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-17 03:56:14,035 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:14,049 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:18,135 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-17 03:56:18,135 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:18,150 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:22,232 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-17 03:56:22,232 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:22,247 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:26,330 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-17 03:56:26,330 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:26,347 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:30,418 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-17 03:56:30,418 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:30,435 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:34,523 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-17 03:56:34,523 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:34,539 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:38,610 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-11-17 03:56:38,610 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:38,625 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:42,711 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-17 03:56:42,711 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:42,726 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:46,809 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-11-17 03:56:46,809 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:46,825 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:50,901 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-17 03:56:50,901 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:50,916 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:54,999 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-17 03:56:54,999 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:55,015 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:56:59,099 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-17 03:56:59,099 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:56:59,114 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:57:03,185 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-17 03:57:03,185 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:57:03,201 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:57:07,297 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-11-17 03:57:07,297 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:57:07,313 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:57:11,378 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-11-17 03:57:11,378 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:57:11,395 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:57:15,476 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-17 03:57:15,476 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:57:15,491 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:57:19,579 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-17 03:57:19,579 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:57:19,596 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:57:23,675 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-11-17 03:57:23,675 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 failed! 2025-11-17 03:57:23,690 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-35930463 is 47.81.167.1 and allocation pool is NOT set 2025-11-17 03:57:25,757 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.94 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.32 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.324/2.133/2.943/0.809 ms') 2025-11-17 03:57:25,757 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-48152215 passed 2025-11-17 03:57:25,826 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:57:25,826 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:57:25,894 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:57:26,013 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:57:31,013 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:57:31,014 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:57:31,082 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:57:31,169 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:57:36,170 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:57:36,170 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:57:36,238 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:57:36,324 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:57:41,324 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:57:41,324 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:57:41,394 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:57:41,484 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:57:46,485 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:57:46,485 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:57:46,549 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:57:46,638 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:57:51,639 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:57:51,639 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:57:51,716 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:57:51,809 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:57:56,811 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:57:56,811 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:57:56,878 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:57:56,964 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:58:01,965 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:01,965 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:58:02,029 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:58:02,118 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:58:07,118 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:07,118 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:58:07,186 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:58:07,297 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:58:12,298 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:12,298 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:58:12,366 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 03:58:12,461 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 03:58:17,461 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:17,461 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-48152215, IP 47.81.167.3, Port 22 2025-11-17 03:58:17,638 - DEBUG - VM ctest-TestBGPaasZone-23100938-48152215 is ready for SSH connections 2025-11-17 03:58:17,638 - INFO - Waiting for VM ctest-TestBGPaasZone-23100938-09119735 to be up.. 2025-11-17 03:58:17,744 - DEBUG - VM is in ACTIVE state now 2025-11-17 03:58:17,744 - INFO - VM name : ctest-TestBGPaasZone-23100938-09119735 2025-11-17 03:58:17,845 - DEBUG - VM ctest-TestBGPaasZone-23100938-09119735 ID is df6badea-1773-49cc-abf2-c6309555d1fd 2025-11-17 03:58:17,845 - DEBUG - VM ctest-TestBGPaasZone-23100938-09119735 launched on Node an-jenkins-deploy-platform-ansible-os-4736-2 2025-11-17 03:58:17,963 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/df6badea-1773-49cc-abf2-c6309555d1fd 2025-11-17 03:58:17,972 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/523a915e-f83b-4fd9-bb7c-b0ca222769bd 2025-11-17 03:58:19,136 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.68 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.531 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.531/1.103/1.676/0.572 ms') 2025-11-17 03:58:19,137 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-09119735 passed 2025-11-17 03:58:19,208 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:19,209 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-09119735, IP 47.81.167.4, Port 22 2025-11-17 03:58:19,377 - DEBUG - VM ctest-TestBGPaasZone-23100938-09119735 is ready for SSH connections 2025-11-17 03:58:19,378 - INFO - Waiting for VM ctest-TestBGPaasZone-23100938-02705995 to be up.. 2025-11-17 03:58:19,478 - DEBUG - VM is in ACTIVE state now 2025-11-17 03:58:19,478 - INFO - VM name : ctest-TestBGPaasZone-23100938-02705995 2025-11-17 03:58:19,565 - DEBUG - VM ctest-TestBGPaasZone-23100938-02705995 ID is af5daaf1-cd8c-4f36-b942-5419a5c9458e 2025-11-17 03:58:19,565 - DEBUG - VM ctest-TestBGPaasZone-23100938-02705995 launched on Node an-jenkins-deploy-platform-ansible-os-4736-1 2025-11-17 03:58:19,658 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/af5daaf1-cd8c-4f36-b942-5419a5c9458e 2025-11-17 03:58:19,669 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9e140bbf-cf60-429b-871d-c30951d1fdc0 2025-11-17 03:58:20,841 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.01 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.889 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.889/1.948/3.007/1.059 ms') 2025-11-17 03:58:20,841 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-23100938-02705995 passed 2025-11-17 03:58:20,910 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:20,910 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-02705995, IP 47.81.167.5, Port 22 2025-11-17 03:58:21,079 - DEBUG - VM ctest-TestBGPaasZone-23100938-02705995 is ready for SSH connections 2025-11-17 03:58:21,217 - INFO - Created control node zone ctest-test-zone-11915102(9177c5fc-9cc4-4d2e-9211-5fb0606426ad) 2025-11-17 03:58:21,577 - INFO - Created control node zone ctest-test-zone-45046179(c5d2bdb7-392e-426c-9b93-df0313b7b67d) 2025-11-17 03:58:21,925 - INFO - Created control node zone ctest-test-zone-44811492(50840cd0-c49e-4eb6-b1bb-f22035465645) 2025-11-17 03:58:22,209 - INFO - Creating BGPaaS ctest-TestBGPaasZone-23100938-76360638 2025-11-17 03:58:22,281 - INFO - BGPaaS: ctest-TestBGPaasZone-23100938-76360638(7b284897-b1ad-4200-bb61-ffd60cb76441) 2025-11-17 03:58:22,281 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:58:22,625 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:58:22,664 - INFO - verify_in_api_server passed for BGPaaS obj 7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:58:22,664 - INFO - BGPaaS(7b284897-b1ad-4200-bb61-ffd60cb76441): verify_on_setup passed 2025-11-17 03:58:22,665 - INFO - We will configure BGP on the VM 2025-11-17 03:58:22,925 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:22,925 - INFO - Configuring BGP on ctest-TestBGPaasZone-23100938-48152215 2025-11-17 03:58:22,925 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:58:22,925 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS 2025-11-17 03:58:37,942 - DEBUG - None 2025-11-17 03:58:37,942 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:58:37,942 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS 2025-11-17 03:58:39,146 - DEBUG - None 2025-11-17 03:58:39,146 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:58:39,146 - DEBUG - service bird restart 2025-11-17 03:58:42,428 - DEBUG - bird stop/waiting bird start/running, process 1431 2025-11-17 03:58:42,428 - INFO - Attaching VMI 8b21803f-250c-4ce9-8945-021d9fd72e49 to BGPaaS 7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:58:42,505 - INFO - Attaching the VMI 72abf7a8-6714-4aee-9b07-56e6c6ca92e1 to the BGPaaS 7b284897-b1ad-4200-bb61-ffd60cb76441 object 2025-11-17 03:58:42,505 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 47.81.167.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:58:42,505 - DEBUG - sudo ip addr add 47.81.167.20 dev eth0 2025-11-17 03:58:44,013 - DEBUG - None 2025-11-17 03:58:44,077 - INFO - Creating BGPaaS ctest-TestBGPaasZone-23100938-04636497 2025-11-17 03:58:44,149 - INFO - BGPaaS: ctest-TestBGPaasZone-23100938-04636497(c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b) 2025-11-17 03:58:44,149 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b 2025-11-17 03:58:44,160 - INFO - verify_in_api_server passed for BGPaaS obj c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b 2025-11-17 03:58:44,160 - INFO - BGPaaS(c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b): verify_on_setup passed 2025-11-17 03:58:44,160 - INFO - We will configure BGP on the VM 2025-11-17 03:58:44,421 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:44,421 - INFO - Configuring BGP on ctest-TestBGPaasZone-23100938-09119735 2025-11-17 03:58:44,421 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.4; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.4; } protocol bfd { neighbor 47.81.167.2 local 47.81.167.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 03:58:44,421 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.4; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.4; } protocol bfd { neighbor 47.81.167.2 local 47.81.167.4 multihop on; } EOS 2025-11-17 03:58:49,581 - DEBUG - None 2025-11-17 03:58:49,581 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.4; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.4; } protocol bfd { neighbor 47.81.167.2 local 47.81.167.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 03:58:49,581 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.4; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.4; } protocol bfd { neighbor 47.81.167.2 local 47.81.167.4 multihop on; } EOS 2025-11-17 03:58:50,088 - DEBUG - None 2025-11-17 03:58:50,089 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 03:58:50,089 - DEBUG - service bird restart 2025-11-17 03:58:51,741 - DEBUG - bird stop/waiting bird start/running, process 1480 2025-11-17 03:58:51,742 - INFO - Attaching VMI 523a915e-f83b-4fd9-bb7c-b0ca222769bd to BGPaaS c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b 2025-11-17 03:58:51,817 - INFO - Attaching the VMI df6badea-1773-49cc-abf2-c6309555d1fd to the BGPaaS c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b object 2025-11-17 03:58:51,817 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 47.81.167.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 03:58:51,817 - DEBUG - sudo ip addr add 47.81.167.20 dev eth0 2025-11-17 03:58:52,461 - DEBUG - None 2025-11-17 03:58:52,461 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:52,477 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-17 03:58:52,484 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:58:52,503 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-17 03:58:58,523 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-17 03:59:04,543 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-17 03:59:04,549 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 47.81.167.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:04,549 - DEBUG - ping -s 56 -c 3 -W 1 47.81.167.20 2025-11-17 03:59:11,404 - DEBUG - PING 47.81.167.20 (47.81.167.20) 56(84) bytes of data. 64 bytes from 47.81.167.20: icmp_seq=1 ttl=64 time=7.92 ms 64 bytes from 47.81.167.20: icmp_seq=2 ttl=64 time=0.906 ms 64 bytes from 47.81.167.20: icmp_seq=3 ttl=64 time=0.857 ms --- 47.81.167.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.857/3.229/7.924/3.319 ms 2025-11-17 03:59:11,404 - INFO - Ping to IP 47.81.167.20 from VM ctest-TestBGPaasZone-23100938-02705995 passed 2025-11-17 03:59:12,265 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:12,265 - DEBUG - service bird restart 2025-11-17 03:59:14,094 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-11-17 03:59:14,094 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 03:59:14,094 - DEBUG - service bird restart 2025-11-17 03:59:15,682 - DEBUG - bird stop/waiting bird start/running, process 1507 2025-11-17 03:59:15,683 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:59:15,683 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-17 03:59:15,701 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-11-17 03:59:21,703 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-17 03:59:21,717 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-11-17 03:59:21,723 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:59:21,741 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-17 03:59:27,760 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-17 03:59:27,766 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 47.81.167.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:27,766 - DEBUG - ping -s 56 -c 3 -W 1 47.81.167.20 2025-11-17 03:59:30,346 - DEBUG - PING 47.81.167.20 (47.81.167.20) 56(84) bytes of data. 64 bytes from 47.81.167.20: icmp_seq=1 ttl=64 time=1.98 ms 64 bytes from 47.81.167.20: icmp_seq=2 ttl=64 time=0.918 ms 64 bytes from 47.81.167.20: icmp_seq=3 ttl=64 time=0.815 ms --- 47.81.167.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.815/1.238/1.983/0.529 ms 2025-11-17 03:59:30,346 - INFO - Ping to IP 47.81.167.20 from VM ctest-TestBGPaasZone-23100938-02705995 passed 2025-11-17 03:59:30,639 - INFO - We will configure BGP on the VM 2025-11-17 03:59:30,857 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:59:30,857 - INFO - Configuring BGP on ctest-TestBGPaasZone-23100938-48152215 2025-11-17 03:59:30,857 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:30,857 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS 2025-11-17 03:59:31,409 - DEBUG - None 2025-11-17 03:59:31,409 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:31,409 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 47.81.167.3; protocol bgp bgp_1{ local as 65000; neighbor 47.81.167.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 47.81.167.3; } protocol bfd { neighbor 47.81.167.1 local 47.81.167.3 multihop on; } EOS 2025-11-17 03:59:31,967 - DEBUG - None 2025-11-17 03:59:31,967 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:31,967 - DEBUG - service bird restart 2025-11-17 03:59:33,817 - DEBUG - bird stop/waiting bird start/running, process 1501 2025-11-17 03:59:33,817 - INFO - Attaching VMI 8b21803f-250c-4ce9-8945-021d9fd72e49 to BGPaaS 7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:59:33,840 - INFO - Attaching the VMI 72abf7a8-6714-4aee-9b07-56e6c6ca92e1 to the BGPaaS 7b284897-b1ad-4200-bb61-ffd60cb76441 object 2025-11-17 03:59:33,840 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 47.81.167.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:33,840 - DEBUG - sudo ip addr add 47.81.167.20 dev eth0 2025-11-17 03:59:34,578 - DEBUG - RTNETLINK answers: File exists 2025-11-17 03:59:34,579 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:34,579 - DEBUG - service bird restart 2025-11-17 03:59:36,377 - DEBUG - bird stop/waiting bird start/running, process 1528 2025-11-17 03:59:36,377 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 03:59:36,377 - DEBUG - service bird restart 2025-11-17 03:59:37,925 - DEBUG - bird stop/waiting bird start/running, process 1529 2025-11-17 03:59:37,925 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:59:37,940 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-17 03:59:43,955 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-17 03:59:43,961 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 03:59:43,978 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-17 03:59:49,998 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-17 03:59:50,003 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 47.81.167.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 03:59:50,004 - DEBUG - ping -s 56 -c 3 -W 1 47.81.167.20 2025-11-17 03:59:52,542 - DEBUG - PING 47.81.167.20 (47.81.167.20) 56(84) bytes of data. 64 bytes from 47.81.167.20: icmp_seq=1 ttl=64 time=5.64 ms 64 bytes from 47.81.167.20: icmp_seq=2 ttl=64 time=1.26 ms 64 bytes from 47.81.167.20: icmp_seq=3 ttl=64 time=1.29 ms --- 47.81.167.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.267/2.736/5.643/2.055 ms 2025-11-17 03:59:52,542 - INFO - Ping to IP 47.81.167.20 from VM ctest-TestBGPaasZone-23100938-02705995 passed 2025-11-17 03:59:52,542 - INFO - Detaching VMI 8b21803f-250c-4ce9-8945-021d9fd72e49 from BGPaaS 7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:59:52,617 - INFO - Detaching VMI 523a915e-f83b-4fd9-bb7c-b0ca222769bd from BGPaaS c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b 2025-11-17 03:59:52,713 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-23100938-04636497(c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b) 2025-11-17 03:59:52,782 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b 2025-11-17 03:59:52,789 - DEBUG - Response Code: 404 2025-11-17 03:59:52,789 - DEBUG - BGPaaS: c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b deleted from api server 2025-11-17 03:59:52,789 - INFO - BGPaaS(c42b6e7a-f37a-4899-a7d6-bd5e744fbd2b): verify_on_cleanup passed 2025-11-17 03:59:52,790 - INFO - Detaching VMI 8b21803f-250c-4ce9-8945-021d9fd72e49 from BGPaaS 7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:59:52,813 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-23100938-76360638(7b284897-b1ad-4200-bb61-ffd60cb76441) 2025-11-17 03:59:52,888 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/7b284897-b1ad-4200-bb61-ffd60cb76441 2025-11-17 03:59:52,897 - DEBUG - Response Code: 404 2025-11-17 03:59:52,898 - DEBUG - BGPaaS: 7b284897-b1ad-4200-bb61-ffd60cb76441 deleted from api server 2025-11-17 03:59:52,898 - INFO - BGPaaS(7b284897-b1ad-4200-bb61-ffd60cb76441): verify_on_cleanup passed 2025-11-17 03:59:52,898 - INFO - Deleting Control node zone ctest-test-zone-44811492(50840cd0-c49e-4eb6-b1bb-f22035465645) 2025-11-17 03:59:53,074 - INFO - Deleting Control node zone ctest-test-zone-45046179(c5d2bdb7-392e-426c-9b93-df0313b7b67d) 2025-11-17 03:59:53,240 - INFO - Deleting Control node zone ctest-test-zone-11915102(9177c5fc-9cc4-4d2e-9211-5fb0606426ad) 2025-11-17 03:59:53,329 - INFO - Deleting VM ctest-TestBGPaasZone-23100938-02705995 2025-11-17 03:59:53,433 - INFO - Deleting VM ctest-TestBGPaasZone-23100938-09119735 2025-11-17 03:59:53,509 - INFO - Deleting VM ctest-TestBGPaasZone-23100938-48152215 2025-11-17 03:59:53,587 - INFO - Deleting VN ctest-cnz_vn-35930463 2025-11-17 03:59:53,635 - DEBUG - VN 504cea95-07a9-4c51-b5c8-31540c8f9efd still in use: Unable to complete operation on network 504cea95-07a9-4c51-b5c8-31540c8f9efd. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7898935d-98f5-4b5d-bc57-94efda489f1c'] 2025-11-17 03:59:53,635 - WARNING - Deleting VN ctest-cnz_vn-35930463 failed..Will retry 2025-11-17 03:59:55,844 - DEBUG - Response for deleting network () 2025-11-17 03:59:57,116 - DEBUG - Skipping xmpp flap check 2025-11-17 03:59:57,116 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:38] 2025-11-17 03:59:57,116 - INFO - -------------------------------------------------------------------------------- 2025-11-17 03:59:57,120 - INFO - ================================================================================ 2025-11-17 03:59:57,120 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-11-17 03:59:58,395 - DEBUG - Skipping xmpp flap check 2025-11-17 03:59:58,396 - INFO - Initial checks done. Running the testcase now 2025-11-17 03:59:58,396 - INFO - 2025-11-17 03:59:58,396 - INFO - executing bgp_control_zone agent restart test 2025-11-17 03:59:58,717 - DEBUG - Response for create_network : {'network': {'id': '0ce2a8ba-5cc2-40bc-8eaa-cc39ad72f3bc', 'name': 'ctest-cnz_vn-83233704', 'tenant_id': '0fc0f0432de94b2a8b97a3040463c391', 'project_id': '0fc0f0432de94b2a8b97a3040463c391', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-23100938', 'ctest-cnz_vn-83233704'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:59:59,033 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd95246a8-4e96-4a31-9efa-76dddc368954', 'name': '', 'tenant_id': '0fc0f0432de94b2a8b97a3040463c391', 'network_id': '0ce2a8ba-5cc2-40bc-8eaa-cc39ad72f3bc', 'ip_version': 4, 'cidr': '149.5.174.128/26', 'allocation_pools': [{'start': '149.5.174.130', 'end': '149.5.174.190'}], 'gateway_ip': '149.5.174.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.5.174.130', 'tags': [], 'project_id': '0fc0f0432de94b2a8b97a3040463c391'}} 2025-11-17 03:59:59,070 - INFO - Created VN ctest-cnz_vn-83233704 2025-11-17 03:59:59,085 - DEBUG - VN ctest-cnz_vn-83233704 UUID is 0ce2a8ba-5cc2-40bc-8eaa-cc39ad72f3bc 2025-11-17 04:00:00,561 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-2) 2025-11-17 04:00:02,327 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-1) 2025-11-17 04:00:04,072 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-2) 2025-11-17 04:00:04,072 - INFO - Waiting for VM ctest-TestBGPaasZone-23100938-69965675 to be up.. 2025-11-17 04:00:04,180 - DEBUG - VM is in ACTIVE state now 2025-11-17 04:00:04,180 - INFO - VM name : ctest-TestBGPaasZone-23100938-69965675 2025-11-17 04:00:04,268 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 ID is 4a9885f1-8dfb-451f-823c-dba457b59876 2025-11-17 04:00:04,269 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 launched on Node an-jenkins-deploy-platform-ansible-os-4736-2 2025-11-17 04:00:04,371 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4a9885f1-8dfb-451f-823c-dba457b59876 2025-11-17 04:00:04,380 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/f725142a-fd81-4564-87ad-6598e221e525 2025-11-17 04:00:07,591 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-11-17 04:00:07,591 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:07,607 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:11,688 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-11-17 04:00:11,688 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:11,703 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:15,787 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-17 04:00:15,787 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:15,802 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:19,880 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-17 04:00:19,881 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:19,896 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:23,978 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-17 04:00:23,978 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:24,023 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:28,101 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-17 04:00:28,101 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:28,119 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:32,202 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-17 04:00:32,202 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:32,218 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:36,298 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-17 04:00:36,298 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:36,313 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:40,391 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-17 04:00:40,391 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:40,405 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:44,489 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-17 04:00:44,489 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:44,506 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:48,584 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-17 04:00:48,584 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:48,601 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:52,674 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-17 04:00:52,674 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:52,688 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:00:56,778 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-17 04:00:56,778 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:00:56,795 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:01:00,875 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-17 04:01:00,875 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:01:00,892 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:01:04,967 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-11-17 04:01:04,967 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:01:04,980 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:01:09,070 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-17 04:01:09,070 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 failed! 2025-11-17 04:01:09,085 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-23100938:ctest-cnz_vn-83233704 is 149.5.174.129 and allocation pool is NOT set 2025-11-17 04:01:11,153 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.72 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.899 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.899/2.810/4.721/1.911 ms') 2025-11-17 04:01:11,153 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-69965675 passed 2025-11-17 04:01:11,243 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:11,243 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:11,314 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:11,556 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:16,556 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:16,556 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:16,621 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:16,742 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:21,743 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:21,743 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:21,804 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:21,926 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:26,927 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:26,927 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:26,983 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:27,070 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:32,071 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:32,071 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:32,127 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:32,222 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:37,223 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:37,223 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:37,279 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:37,371 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:42,372 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:42,372 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:42,437 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:42,534 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:47,535 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:47,535 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:47,591 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:47,681 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:52,681 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:52,682 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:52,749 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:52,832 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:01:57,833 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:57,833 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-69965675, IP 149.5.174.131, Port 22 2025-11-17 04:01:58,002 - DEBUG - VM ctest-TestBGPaasZone-23100938-69965675 is ready for SSH connections 2025-11-17 04:01:58,002 - INFO - Waiting for VM ctest-TestBGPaasZone-23100938-28232109 to be up.. 2025-11-17 04:01:58,089 - DEBUG - VM is in ACTIVE state now 2025-11-17 04:01:58,089 - INFO - VM name : ctest-TestBGPaasZone-23100938-28232109 2025-11-17 04:01:58,174 - DEBUG - VM ctest-TestBGPaasZone-23100938-28232109 ID is 9ea00352-7761-4c79-b00d-bfe442701518 2025-11-17 04:01:58,174 - DEBUG - VM ctest-TestBGPaasZone-23100938-28232109 launched on Node an-jenkins-deploy-platform-ansible-os-4736-1 2025-11-17 04:01:58,262 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/9ea00352-7761-4c79-b00d-bfe442701518 2025-11-17 04:01:58,303 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/e29e9f4c-8a4f-4df4-9df0-75fe1ee2ee69 2025-11-17 04:01:59,469 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.31 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.642 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.642/2.475/4.309/1.833 ms') 2025-11-17 04:01:59,469 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-23100938-28232109 passed 2025-11-17 04:01:59,538 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:01:59,538 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-28232109, IP 149.5.174.132, Port 22 2025-11-17 04:01:59,606 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:01:59,696 - DEBUG - VM ctest-TestBGPaasZone-23100938-28232109 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:02:04,697 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:04,697 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-28232109, IP 149.5.174.132, Port 22 2025-11-17 04:02:04,766 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-17 04:02:04,887 - DEBUG - VM ctest-TestBGPaasZone-23100938-28232109 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-17 04:02:09,888 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:09,888 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-28232109, IP 149.5.174.132, Port 22 2025-11-17 04:02:10,059 - DEBUG - VM ctest-TestBGPaasZone-23100938-28232109 is ready for SSH connections 2025-11-17 04:02:10,059 - INFO - Waiting for VM ctest-TestBGPaasZone-23100938-30662238 to be up.. 2025-11-17 04:02:10,159 - DEBUG - VM is in ACTIVE state now 2025-11-17 04:02:10,160 - INFO - VM name : ctest-TestBGPaasZone-23100938-30662238 2025-11-17 04:02:10,267 - DEBUG - VM ctest-TestBGPaasZone-23100938-30662238 ID is dac9e58b-0902-474d-b580-84384ccf44b8 2025-11-17 04:02:10,268 - DEBUG - VM ctest-TestBGPaasZone-23100938-30662238 launched on Node an-jenkins-deploy-platform-ansible-os-4736-2 2025-11-17 04:02:10,370 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/dac9e58b-0902-474d-b580-84384ccf44b8 2025-11-17 04:02:10,386 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/343f5071-e929-4191-96cc-76ac373d1974 2025-11-17 04:02:11,563 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.41 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.42 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.421/3.916/6.411/2.495 ms') 2025-11-17 04:02:11,564 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-23100938-30662238 passed 2025-11-17 04:02:11,637 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:11,637 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-23100938-30662238, IP 149.5.174.133, Port 22 2025-11-17 04:02:11,799 - DEBUG - VM ctest-TestBGPaasZone-23100938-30662238 is ready for SSH connections 2025-11-17 04:02:11,937 - INFO - Created control node zone ctest-test-zone-27377434(ab1d92ce-fdf3-457a-9bdc-bac3f1d43642) 2025-11-17 04:02:12,304 - INFO - Created control node zone ctest-test-zone-80667492(eff3ea5b-5731-4dc9-8191-25bd9c5784a3) 2025-11-17 04:02:12,757 - INFO - Created control node zone ctest-test-zone-42087031(f30e7c35-12f9-4c17-842c-d970491f7e0e) 2025-11-17 04:02:13,041 - INFO - Creating BGPaaS ctest-TestBGPaasZone-23100938-63984495 2025-11-17 04:02:13,121 - INFO - BGPaaS: ctest-TestBGPaasZone-23100938-63984495(b26e04e1-9e21-464c-8c00-b170b1b26681) 2025-11-17 04:02:13,121 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/b26e04e1-9e21-464c-8c00-b170b1b26681 2025-11-17 04:02:13,133 - INFO - verify_in_api_server passed for BGPaaS obj b26e04e1-9e21-464c-8c00-b170b1b26681 2025-11-17 04:02:13,133 - INFO - BGPaaS(b26e04e1-9e21-464c-8c00-b170b1b26681): verify_on_setup passed 2025-11-17 04:02:13,134 - INFO - We will configure BGP on the VM 2025-11-17 04:02:13,589 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:13,589 - INFO - Configuring BGP on ctest-TestBGPaasZone-23100938-69965675 2025-11-17 04:02:13,589 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 149.5.174.131; protocol bgp bgp_1{ local as 65000; neighbor 149.5.174.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.131; } protocol bfd { neighbor 149.5.174.129 local 149.5.174.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 04:02:13,589 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 149.5.174.131; protocol bgp bgp_1{ local as 65000; neighbor 149.5.174.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.131; } protocol bfd { neighbor 149.5.174.129 local 149.5.174.131 multihop on; } EOS 2025-11-17 04:02:29,034 - DEBUG - None 2025-11-17 04:02:29,035 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 149.5.174.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.131; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 04:02:29,035 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 149.5.174.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.131; } EOS 2025-11-17 04:02:29,519 - DEBUG - None 2025-11-17 04:02:29,519 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 04:02:29,519 - DEBUG - service bird restart 2025-11-17 04:02:31,121 - DEBUG - bird stop/waiting bird start/running, process 1433 2025-11-17 04:02:31,122 - INFO - Attaching VMI f725142a-fd81-4564-87ad-6598e221e525 to BGPaaS b26e04e1-9e21-464c-8c00-b170b1b26681 2025-11-17 04:02:31,197 - INFO - Attaching the VMI 4a9885f1-8dfb-451f-823c-dba457b59876 to the BGPaaS b26e04e1-9e21-464c-8c00-b170b1b26681 object 2025-11-17 04:02:31,197 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 149.5.174.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 04:02:31,197 - DEBUG - sudo ip addr add 149.5.174.148 dev eth0 2025-11-17 04:02:31,831 - DEBUG - None 2025-11-17 04:02:31,893 - INFO - Creating BGPaaS ctest-TestBGPaasZone-23100938-65342550 2025-11-17 04:02:31,973 - INFO - BGPaaS: ctest-TestBGPaasZone-23100938-65342550(daaa3b6e-b8bb-4276-8a1b-525d63ecce3a) 2025-11-17 04:02:31,973 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/daaa3b6e-b8bb-4276-8a1b-525d63ecce3a 2025-11-17 04:02:31,984 - INFO - verify_in_api_server passed for BGPaaS obj daaa3b6e-b8bb-4276-8a1b-525d63ecce3a 2025-11-17 04:02:31,984 - INFO - BGPaaS(daaa3b6e-b8bb-4276-8a1b-525d63ecce3a): verify_on_setup passed 2025-11-17 04:02:31,984 - INFO - We will configure BGP on the VM 2025-11-17 04:02:32,417 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:32,417 - INFO - Configuring BGP on ctest-TestBGPaasZone-23100938-28232109 2025-11-17 04:02:32,417 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 149.5.174.132; protocol bgp bgp_1{ local as 65000; neighbor 149.5.174.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.132; } protocol bfd { neighbor 149.5.174.129 local 149.5.174.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 04:02:32,417 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 149.5.174.132; protocol bgp bgp_1{ local as 65000; neighbor 149.5.174.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.132; } protocol bfd { neighbor 149.5.174.129 local 149.5.174.132 multihop on; } EOS 2025-11-17 04:02:48,321 - DEBUG - None 2025-11-17 04:02:48,321 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 149.5.174.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.132; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 04:02:48,321 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 149.5.174.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 149.5.174.132; } EOS 2025-11-17 04:02:48,861 - DEBUG - None 2025-11-17 04:02:48,861 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 04:02:48,861 - DEBUG - service bird restart 2025-11-17 04:02:50,911 - DEBUG - bird stop/waiting bird start/running, process 1442 2025-11-17 04:02:50,911 - INFO - Attaching VMI e29e9f4c-8a4f-4df4-9df0-75fe1ee2ee69 to BGPaaS daaa3b6e-b8bb-4276-8a1b-525d63ecce3a 2025-11-17 04:02:50,985 - INFO - Attaching the VMI 9ea00352-7761-4c79-b00d-bfe442701518 to the BGPaaS daaa3b6e-b8bb-4276-8a1b-525d63ecce3a object 2025-11-17 04:02:50,985 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 149.5.174.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-11-17 04:02:50,985 - DEBUG - sudo ip addr add 149.5.174.148 dev eth0 2025-11-17 04:02:51,677 - DEBUG - None 2025-11-17 04:02:51,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:51,693 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-17 04:02:51,694 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:51,715 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-17 04:02:51,721 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:51,737 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-17 04:02:57,754 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-17 04:02:57,755 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:02:57,772 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-11-17 04:03:03,790 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-17 04:03:03,797 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 149.5.174.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 04:03:03,797 - DEBUG - ping -s 56 -c 3 -W 1 149.5.174.148 2025-11-17 04:03:14,761 - DEBUG - PING 149.5.174.148 (149.5.174.148) 56(84) bytes of data. 64 bytes from 149.5.174.148: icmp_seq=1 ttl=64 time=10.6 ms 64 bytes from 149.5.174.148: icmp_seq=2 ttl=64 time=1.68 ms 64 bytes from 149.5.174.148: icmp_seq=3 ttl=64 time=1.65 ms --- 149.5.174.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.655/4.674/10.683/4.249 ms 2025-11-17 04:03:14,761 - INFO - Ping to IP 149.5.174.148 from VM ctest-TestBGPaasZone-23100938-30662238 passed 2025-11-17 04:03:14,762 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:03:14,776 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-17 04:03:14,777 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:03:14,797 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-17 04:03:14,803 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:03:14,817 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-17 04:03:14,817 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-17 04:03:14,834 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-11-17 04:03:14,840 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 149.5.174.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-17 04:03:14,840 - DEBUG - ping -s 56 -c 3 -W 1 149.5.174.148 2025-11-17 04:03:17,308 - DEBUG - PING 149.5.174.148 (149.5.174.148) 56(84) bytes of data. 64 bytes from 149.5.174.148: icmp_seq=1 ttl=64 time=3.64 ms 64 bytes from 149.5.174.148: icmp_seq=2 ttl=64 time=0.910 ms 64 bytes from 149.5.174.148: icmp_seq=3 ttl=64 time=0.838 ms --- 149.5.174.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.838/1.797/3.644/1.306 ms 2025-11-17 04:03:17,308 - INFO - Ping to IP 149.5.174.148 from VM ctest-TestBGPaasZone-23100938-30662238 passed 2025-11-17 04:03:17,308 - INFO - Detaching VMI e29e9f4c-8a4f-4df4-9df0-75fe1ee2ee69 from BGPaaS daaa3b6e-b8bb-4276-8a1b-525d63ecce3a 2025-11-17 04:03:17,385 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-23100938-65342550(daaa3b6e-b8bb-4276-8a1b-525d63ecce3a) 2025-11-17 04:03:17,434 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/daaa3b6e-b8bb-4276-8a1b-525d63ecce3a 2025-11-17 04:03:17,440 - DEBUG - Response Code: 404 2025-11-17 04:03:17,441 - DEBUG - BGPaaS: daaa3b6e-b8bb-4276-8a1b-525d63ecce3a deleted from api server 2025-11-17 04:03:17,441 - INFO - BGPaaS(daaa3b6e-b8bb-4276-8a1b-525d63ecce3a): verify_on_cleanup passed 2025-11-17 04:03:17,441 - INFO - Detaching VMI f725142a-fd81-4564-87ad-6598e221e525 from BGPaaS b26e04e1-9e21-464c-8c00-b170b1b26681 2025-11-17 04:03:17,517 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-23100938-63984495(b26e04e1-9e21-464c-8c00-b170b1b26681) 2025-11-17 04:03:17,569 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/b26e04e1-9e21-464c-8c00-b170b1b26681 2025-11-17 04:03:17,576 - DEBUG - Response Code: 404 2025-11-17 04:03:17,576 - DEBUG - BGPaaS: b26e04e1-9e21-464c-8c00-b170b1b26681 deleted from api server 2025-11-17 04:03:17,576 - INFO - BGPaaS(b26e04e1-9e21-464c-8c00-b170b1b26681): verify_on_cleanup passed 2025-11-17 04:03:17,577 - INFO - Deleting Control node zone ctest-test-zone-42087031(f30e7c35-12f9-4c17-842c-d970491f7e0e) 2025-11-17 04:03:17,725 - INFO - Deleting Control node zone ctest-test-zone-80667492(eff3ea5b-5731-4dc9-8191-25bd9c5784a3) 2025-11-17 04:03:17,872 - INFO - Deleting Control node zone ctest-test-zone-27377434(ab1d92ce-fdf3-457a-9bdc-bac3f1d43642) 2025-11-17 04:03:18,058 - INFO - Deleting VM ctest-TestBGPaasZone-23100938-30662238 2025-11-17 04:03:18,185 - INFO - Deleting VM ctest-TestBGPaasZone-23100938-28232109 2025-11-17 04:03:18,273 - INFO - Deleting VM ctest-TestBGPaasZone-23100938-69965675 2025-11-17 04:03:18,356 - INFO - Deleting VN ctest-cnz_vn-83233704 2025-11-17 04:03:18,408 - DEBUG - VN 0ce2a8ba-5cc2-40bc-8eaa-cc39ad72f3bc still in use: Unable to complete operation on network 0ce2a8ba-5cc2-40bc-8eaa-cc39ad72f3bc. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-5e6c98d9-74f8-4a46-be82-ff5fa2a709f1'] 2025-11-17 04:03:18,408 - WARNING - Deleting VN ctest-cnz_vn-83233704 failed..Will retry 2025-11-17 04:03:20,663 - DEBUG - Response for deleting network () 2025-11-17 04:03:21,952 - DEBUG - Skipping xmpp flap check 2025-11-17 04:03:21,952 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:24] 2025-11-17 04:03:21,952 - INFO - -------------------------------------------------------------------------------- 2025-11-17 04:03:23,367 - INFO - Deleted project: ctest-TestBGPaasZone-23100938, ID : 0fc0f043-2de9-4b2a-8b97-a3040463c391