2025-12-11 03:54:53,575 - INFO - Domain Default found not creating 2025-12-11 03:54:54,046 - INFO - Project ctest-TestBGPaasZone-13679907 not found, creating it 2025-12-11 03:54:54,600 - INFO - Created Project:ctest-TestBGPaasZone-13679907, ID : d54f434e-80ca-4f4c-b8df-4999ea16ebd0 2025-12-11 03:54:56,035 - DEBUG - Services list from nova: [, , , ] 2025-12-11 03:54:56,035 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4883-2', 'an-jenkins-deploy-platform-ansible-os-4883-1']} 2025-12-11 03:54:56,037 - INFO - ================================================================================ 2025-12-11 03:54:56,037 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-12-11 03:54:57,303 - DEBUG - Skipping xmpp flap check 2025-12-11 03:54:57,303 - INFO - Initial checks done. Running the testcase now 2025-12-11 03:54:57,303 - INFO - 2025-12-11 03:54:57,303 - INFO - executing bgp_control_zone test 2025-12-11 03:54:57,951 - DEBUG - Response for create_network : {'network': {'id': '5c20f1f8-9d1a-4d34-8cbd-e09b02170dff', 'name': 'ctest-cnz_vn-43511775', 'tenant_id': 'd54f434e80ca4f4cb8df4999ea16ebd0', 'project_id': 'd54f434e80ca4f4cb8df4999ea16ebd0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-13679907', 'ctest-cnz_vn-43511775'], 'port_security_enabled': True, 'description': ''}} 2025-12-11 03:54:58,175 - DEBUG - Response for create_subnet : {'subnet': {'id': '5abc8726-7cc5-4bc8-b293-7ad12c47c26b', 'name': '', 'tenant_id': 'd54f434e80ca4f4cb8df4999ea16ebd0', 'network_id': '5c20f1f8-9d1a-4d34-8cbd-e09b02170dff', 'ip_version': 4, 'cidr': '26.238.82.64/26', 'allocation_pools': [{'start': '26.238.82.66', 'end': '26.238.82.126'}], 'gateway_ip': '26.238.82.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '26.238.82.66', 'tags': [], 'project_id': 'd54f434e80ca4f4cb8df4999ea16ebd0'}} 2025-12-11 03:54:58,199 - INFO - Created VN ctest-cnz_vn-43511775 2025-12-11 03:54:58,209 - DEBUG - VN ctest-cnz_vn-43511775 UUID is 5c20f1f8-9d1a-4d34-8cbd-e09b02170dff 2025-12-11 03:54:59,372 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4883-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4883-2) 2025-12-11 03:55:00,814 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4883-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4883-1) 2025-12-11 03:55:02,524 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4883-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4883-2) 2025-12-11 03:55:02,525 - INFO - Waiting for VM ctest-TestBGPaasZone-13679907-09935377 to be up.. 2025-12-11 03:55:02,658 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-11 03:55:07,773 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-11 03:55:12,857 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-11 03:55:17,960 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-11 03:55:23,041 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-11 03:55:28,116 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-11 03:55:33,192 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-11 03:55:38,277 - DEBUG - VM is in ACTIVE state now 2025-12-11 03:55:38,277 - INFO - VM name : ctest-TestBGPaasZone-13679907-09935377 2025-12-11 03:55:38,358 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 ID is 206b02a9-465a-491c-8d4d-cfa77c3f12a4 2025-12-11 03:55:38,384 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 launched on Node an-jenkins-deploy-platform-ansible-os-4883-2 2025-12-11 03:55:38,457 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/206b02a9-465a-491c-8d4d-cfa77c3f12a4 2025-12-11 03:55:38,753 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/206b02a9-465a-491c-8d4d-cfa77c3f12a4 2025-12-11 03:55:38,788 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/718678b1-45bd-4ee6-8fcb-d16aacf03ff0 2025-12-11 03:55:41,940 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-12-11 03:55:41,940 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:55:41,954 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:55:46,037 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-12-11 03:55:46,037 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:55:46,052 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:55:50,137 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-12-11 03:55:50,138 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:55:50,151 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:55:54,229 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-11 03:55:54,229 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:55:54,242 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:55:58,333 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-12-11 03:55:58,333 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:55:58,348 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:02,424 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-11 03:56:02,424 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:02,440 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:06,525 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-11 03:56:06,525 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:06,540 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:10,614 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-11 03:56:10,614 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:10,629 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:14,717 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-12-11 03:56:14,717 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:14,732 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:18,811 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-11 03:56:18,812 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:18,824 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:22,904 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-12-11 03:56:22,904 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:22,925 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:27,003 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-11 03:56:27,003 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:27,015 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:31,102 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-11 03:56:31,102 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:31,118 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:35,198 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-11 03:56:35,198 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:35,223 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:39,317 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-12-11 03:56:39,318 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:39,331 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:43,422 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-12-11 03:56:43,423 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:43,436 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:47,510 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-11 03:56:47,510 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:47,523 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:51,605 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-12-11 03:56:51,605 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:51,619 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:55,701 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-11 03:56:55,701 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 failed! 2025-12-11 03:56:55,714 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-43511775 is 26.238.82.65 and allocation pool is NOT set 2025-12-11 03:56:57,776 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.98 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.762 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.762/2.371/3.980/1.609 ms') 2025-12-11 03:56:57,776 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-09935377 passed 2025-12-11 03:56:57,846 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:56:57,846 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:56:57,914 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:56:58,031 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:03,032 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:03,032 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:03,102 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:03,187 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:08,188 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:08,188 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:08,258 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:08,337 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:13,338 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:13,338 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:13,395 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:13,474 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:18,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:18,475 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:18,541 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:18,621 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:23,621 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:23,622 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:23,689 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:23,765 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:28,766 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:28,766 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:28,833 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:28,917 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:33,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:33,918 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:33,986 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:34,062 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:39,063 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:39,063 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:39,129 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 03:57:39,216 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 03:57:44,218 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:44,218 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-09935377, IP 26.238.82.67, Port 22 2025-12-11 03:57:44,386 - DEBUG - VM ctest-TestBGPaasZone-13679907-09935377 is ready for SSH connections 2025-12-11 03:57:44,386 - INFO - Waiting for VM ctest-TestBGPaasZone-13679907-17609832 to be up.. 2025-12-11 03:57:44,468 - DEBUG - VM is in ACTIVE state now 2025-12-11 03:57:44,468 - INFO - VM name : ctest-TestBGPaasZone-13679907-17609832 2025-12-11 03:57:44,554 - DEBUG - VM ctest-TestBGPaasZone-13679907-17609832 ID is 513b2a96-8a85-4fb4-81c5-1d3770a4a76a 2025-12-11 03:57:44,555 - DEBUG - VM ctest-TestBGPaasZone-13679907-17609832 launched on Node an-jenkins-deploy-platform-ansible-os-4883-1 2025-12-11 03:57:44,641 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/513b2a96-8a85-4fb4-81c5-1d3770a4a76a 2025-12-11 03:57:44,653 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/9a705423-a2ab-49e9-9fd2-b501199ddf07 2025-12-11 03:57:45,818 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.559 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.559/2.716/4.874/2.157 ms') 2025-12-11 03:57:45,818 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-17609832 passed 2025-12-11 03:57:45,891 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:45,891 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-17609832, IP 26.238.82.68, Port 22 2025-12-11 03:57:46,064 - DEBUG - VM ctest-TestBGPaasZone-13679907-17609832 is ready for SSH connections 2025-12-11 03:57:46,064 - INFO - Waiting for VM ctest-TestBGPaasZone-13679907-15895823 to be up.. 2025-12-11 03:57:46,141 - DEBUG - VM is in ACTIVE state now 2025-12-11 03:57:46,141 - INFO - VM name : ctest-TestBGPaasZone-13679907-15895823 2025-12-11 03:57:46,216 - DEBUG - VM ctest-TestBGPaasZone-13679907-15895823 ID is b7f791af-33f0-4647-983c-2067b4fbd4f6 2025-12-11 03:57:46,217 - DEBUG - VM ctest-TestBGPaasZone-13679907-15895823 launched on Node an-jenkins-deploy-platform-ansible-os-4883-2 2025-12-11 03:57:46,293 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/b7f791af-33f0-4647-983c-2067b4fbd4f6 2025-12-11 03:57:46,303 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/37ad0796-0bed-48bc-a00f-6851cf42a78b 2025-12-11 03:57:47,463 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.99 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.97 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.969/2.477/2.986/0.508 ms') 2025-12-11 03:57:47,463 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-13679907-15895823 passed 2025-12-11 03:57:47,532 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:47,533 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-15895823, IP 26.238.82.69, Port 22 2025-12-11 03:57:47,697 - DEBUG - VM ctest-TestBGPaasZone-13679907-15895823 is ready for SSH connections 2025-12-11 03:57:47,836 - INFO - Created control node zone ctest-test-zone-31559220(d30760a6-c319-4888-a353-e9bf8b9bf657) 2025-12-11 03:57:48,192 - INFO - Created control node zone ctest-test-zone-62579167(083a8a3a-cfea-4f92-903b-8aeb720f3fa8) 2025-12-11 03:57:48,540 - INFO - Created control node zone ctest-test-zone-41594256(291fb1e5-02fb-41d8-94a5-d126643622c7) 2025-12-11 03:57:48,844 - INFO - Creating BGPaaS ctest-TestBGPaasZone-13679907-57800058 2025-12-11 03:57:48,920 - INFO - BGPaaS: ctest-TestBGPaasZone-13679907-57800058(cef29e78-bd40-4ab4-85ac-29261908ef0e) 2025-12-11 03:57:48,920 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:57:49,242 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:57:49,275 - INFO - verify_in_api_server passed for BGPaaS obj cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:57:49,275 - INFO - BGPaaS(cef29e78-bd40-4ab4-85ac-29261908ef0e): verify_on_setup passed 2025-12-11 03:57:49,275 - INFO - We will configure BGP on the VM 2025-12-11 03:57:49,520 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:57:49,520 - INFO - Configuring BGP on ctest-TestBGPaasZone-13679907-09935377 2025-12-11 03:57:49,521 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:57:49,521 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS 2025-12-11 03:58:03,884 - DEBUG - None 2025-12-11 03:58:03,884 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:03,884 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS 2025-12-11 03:58:04,865 - DEBUG - None 2025-12-11 03:58:04,865 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:04,866 - DEBUG - service bird restart 2025-12-11 03:58:08,015 - DEBUG - bird stop/waiting bird start/running, process 1432 2025-12-11 03:58:08,015 - INFO - Attaching VMI 718678b1-45bd-4ee6-8fcb-d16aacf03ff0 to BGPaaS cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:58:08,093 - INFO - Attaching the VMI 206b02a9-465a-491c-8d4d-cfa77c3f12a4 to the BGPaaS cef29e78-bd40-4ab4-85ac-29261908ef0e object 2025-12-11 03:58:08,094 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.238.82.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:08,094 - DEBUG - sudo ip addr add 26.238.82.84 dev eth0 2025-12-11 03:58:09,524 - DEBUG - None 2025-12-11 03:58:09,584 - INFO - Creating BGPaaS ctest-TestBGPaasZone-13679907-43486412 2025-12-11 03:58:09,660 - INFO - BGPaaS: ctest-TestBGPaasZone-13679907-43486412(07964591-5908-4a93-96ec-b75255a43027) 2025-12-11 03:58:09,660 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/07964591-5908-4a93-96ec-b75255a43027 2025-12-11 03:58:09,670 - INFO - verify_in_api_server passed for BGPaaS obj 07964591-5908-4a93-96ec-b75255a43027 2025-12-11 03:58:09,670 - INFO - BGPaaS(07964591-5908-4a93-96ec-b75255a43027): verify_on_setup passed 2025-12-11 03:58:09,670 - INFO - We will configure BGP on the VM 2025-12-11 03:58:09,908 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:09,908 - INFO - Configuring BGP on ctest-TestBGPaasZone-13679907-17609832 2025-12-11 03:58:09,908 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.68; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.68; } protocol bfd { neighbor 26.238.82.66 local 26.238.82.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 03:58:09,909 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.68; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.68; } protocol bfd { neighbor 26.238.82.66 local 26.238.82.68 multihop on; } EOS 2025-12-11 03:58:15,526 - DEBUG - None 2025-12-11 03:58:15,526 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.68; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.68; } protocol bfd { neighbor 26.238.82.66 local 26.238.82.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 03:58:15,527 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.68; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.68; } protocol bfd { neighbor 26.238.82.66 local 26.238.82.68 multihop on; } EOS 2025-12-11 03:58:16,090 - DEBUG - None 2025-12-11 03:58:16,091 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 03:58:16,091 - DEBUG - service bird restart 2025-12-11 03:58:17,794 - DEBUG - bird stop/waiting bird start/running, process 1434 2025-12-11 03:58:17,794 - INFO - Attaching VMI 9a705423-a2ab-49e9-9fd2-b501199ddf07 to BGPaaS 07964591-5908-4a93-96ec-b75255a43027 2025-12-11 03:58:17,864 - INFO - Attaching the VMI 513b2a96-8a85-4fb4-81c5-1d3770a4a76a to the BGPaaS 07964591-5908-4a93-96ec-b75255a43027 object 2025-12-11 03:58:17,864 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.238.82.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 03:58:17,864 - DEBUG - sudo ip addr add 26.238.82.84 dev eth0 2025-12-11 03:58:18,580 - DEBUG - None 2025-12-11 03:58:18,581 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:18,582 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 03:58:18,602 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-11 03:58:18,609 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:18,628 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-12-11 03:58:24,644 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-11 03:58:24,649 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.238.82.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:24,649 - DEBUG - ping -s 56 -c 3 -W 1 26.238.82.84 2025-12-11 03:58:31,179 - DEBUG - PING 26.238.82.84 (26.238.82.84) 56(84) bytes of data. 64 bytes from 26.238.82.84: icmp_seq=1 ttl=64 time=6.93 ms 64 bytes from 26.238.82.84: icmp_seq=2 ttl=64 time=0.985 ms 64 bytes from 26.238.82.84: icmp_seq=3 ttl=64 time=0.921 ms --- 26.238.82.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.921/2.946/6.934/2.820 ms 2025-12-11 03:58:31,179 - INFO - Ping to IP 26.238.82.84 from VM ctest-TestBGPaasZone-13679907-15895823 passed 2025-12-11 03:58:31,976 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:31,976 - DEBUG - service bird restart 2025-12-11 03:58:33,774 - DEBUG - bird stop/waiting bird start/running, process 1470 2025-12-11 03:58:33,774 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 03:58:33,775 - DEBUG - service bird restart 2025-12-11 03:58:35,691 - DEBUG - bird stop/waiting bird start/running, process 1461 2025-12-11 03:58:35,692 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:35,708 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.252'] 2025-12-11 03:58:41,726 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-12-11 03:58:41,733 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:41,750 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-11 03:58:41,756 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.238.82.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:41,757 - DEBUG - ping -s 56 -c 3 -W 1 26.238.82.84 2025-12-11 03:58:44,254 - DEBUG - PING 26.238.82.84 (26.238.82.84) 56(84) bytes of data. 64 bytes from 26.238.82.84: icmp_seq=1 ttl=64 time=5.99 ms 64 bytes from 26.238.82.84: icmp_seq=2 ttl=64 time=1.62 ms 64 bytes from 26.238.82.84: icmp_seq=3 ttl=64 time=1.24 ms --- 26.238.82.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.249/2.956/5.993/2.153 ms 2025-12-11 03:58:44,254 - INFO - Ping to IP 26.238.82.84 from VM ctest-TestBGPaasZone-13679907-15895823 passed 2025-12-11 03:58:44,548 - INFO - We will configure BGP on the VM 2025-12-11 03:58:44,740 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:44,740 - INFO - Configuring BGP on ctest-TestBGPaasZone-13679907-09935377 2025-12-11 03:58:44,741 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:44,741 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS 2025-12-11 03:58:45,247 - DEBUG - None 2025-12-11 03:58:45,247 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:45,247 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.238.82.67; protocol bgp bgp_1{ local as 65000; neighbor 26.238.82.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.238.82.67; } protocol bfd { neighbor 26.238.82.65 local 26.238.82.67 multihop on; } EOS 2025-12-11 03:58:45,754 - DEBUG - None 2025-12-11 03:58:45,754 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:45,754 - DEBUG - service bird restart 2025-12-11 03:58:47,419 - DEBUG - bird stop/waiting bird start/running, process 1502 2025-12-11 03:58:47,419 - INFO - Attaching VMI 718678b1-45bd-4ee6-8fcb-d16aacf03ff0 to BGPaaS cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:58:47,439 - INFO - Attaching the VMI 206b02a9-465a-491c-8d4d-cfa77c3f12a4 to the BGPaaS cef29e78-bd40-4ab4-85ac-29261908ef0e object 2025-12-11 03:58:47,439 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.238.82.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:47,439 - DEBUG - sudo ip addr add 26.238.82.84 dev eth0 2025-12-11 03:58:48,169 - DEBUG - RTNETLINK answers: File exists 2025-12-11 03:58:48,169 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:48,169 - DEBUG - service bird restart 2025-12-11 03:58:49,913 - DEBUG - bird stop/waiting bird start/running, process 1529 2025-12-11 03:58:49,914 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 03:58:49,914 - DEBUG - service bird restart 2025-12-11 03:58:51,691 - DEBUG - bird stop/waiting bird start/running, process 1483 2025-12-11 03:58:51,691 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:51,691 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 03:58:51,705 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-12-11 03:58:57,706 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 03:58:57,718 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-11 03:58:57,724 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 03:58:57,745 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-11 03:58:57,751 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.238.82.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 03:58:57,751 - DEBUG - ping -s 56 -c 3 -W 1 26.238.82.84 2025-12-11 03:59:00,308 - DEBUG - PING 26.238.82.84 (26.238.82.84) 56(84) bytes of data. 64 bytes from 26.238.82.84: icmp_seq=1 ttl=64 time=4.01 ms 64 bytes from 26.238.82.84: icmp_seq=2 ttl=64 time=1.38 ms 64 bytes from 26.238.82.84: icmp_seq=3 ttl=64 time=1.37 ms --- 26.238.82.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.376/2.256/4.012/1.241 ms 2025-12-11 03:59:00,308 - INFO - Ping to IP 26.238.82.84 from VM ctest-TestBGPaasZone-13679907-15895823 passed 2025-12-11 03:59:00,308 - INFO - Detaching VMI 718678b1-45bd-4ee6-8fcb-d16aacf03ff0 from BGPaaS cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:59:00,380 - INFO - Detaching VMI 9a705423-a2ab-49e9-9fd2-b501199ddf07 from BGPaaS 07964591-5908-4a93-96ec-b75255a43027 2025-12-11 03:59:00,452 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-13679907-43486412(07964591-5908-4a93-96ec-b75255a43027) 2025-12-11 03:59:00,511 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/07964591-5908-4a93-96ec-b75255a43027 2025-12-11 03:59:00,518 - DEBUG - Response Code: 404 2025-12-11 03:59:00,518 - DEBUG - BGPaaS: 07964591-5908-4a93-96ec-b75255a43027 deleted from api server 2025-12-11 03:59:00,518 - INFO - BGPaaS(07964591-5908-4a93-96ec-b75255a43027): verify_on_cleanup passed 2025-12-11 03:59:00,518 - INFO - Detaching VMI 718678b1-45bd-4ee6-8fcb-d16aacf03ff0 from BGPaaS cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:59:00,534 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-13679907-57800058(cef29e78-bd40-4ab4-85ac-29261908ef0e) 2025-12-11 03:59:00,577 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/cef29e78-bd40-4ab4-85ac-29261908ef0e 2025-12-11 03:59:00,586 - DEBUG - Response Code: 404 2025-12-11 03:59:00,586 - DEBUG - BGPaaS: cef29e78-bd40-4ab4-85ac-29261908ef0e deleted from api server 2025-12-11 03:59:00,586 - INFO - BGPaaS(cef29e78-bd40-4ab4-85ac-29261908ef0e): verify_on_cleanup passed 2025-12-11 03:59:00,586 - INFO - Deleting Control node zone ctest-test-zone-41594256(291fb1e5-02fb-41d8-94a5-d126643622c7) 2025-12-11 03:59:00,731 - INFO - Deleting Control node zone ctest-test-zone-62579167(083a8a3a-cfea-4f92-903b-8aeb720f3fa8) 2025-12-11 03:59:00,880 - INFO - Deleting Control node zone ctest-test-zone-31559220(d30760a6-c319-4888-a353-e9bf8b9bf657) 2025-12-11 03:59:00,970 - INFO - Deleting VM ctest-TestBGPaasZone-13679907-15895823 2025-12-11 03:59:01,113 - INFO - Deleting VM ctest-TestBGPaasZone-13679907-17609832 2025-12-11 03:59:01,240 - INFO - Deleting VM ctest-TestBGPaasZone-13679907-09935377 2025-12-11 03:59:01,339 - INFO - Deleting VN ctest-cnz_vn-43511775 2025-12-11 03:59:01,392 - DEBUG - VN 5c20f1f8-9d1a-4d34-8cbd-e09b02170dff still in use: Unable to complete operation on network 5c20f1f8-9d1a-4d34-8cbd-e09b02170dff. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-2d90bd86-3930-4aab-8f47-b765aa60c2ab'] 2025-12-11 03:59:01,392 - WARNING - Deleting VN ctest-cnz_vn-43511775 failed..Will retry 2025-12-11 03:59:03,607 - DEBUG - Response for deleting network () 2025-12-11 03:59:04,891 - DEBUG - Skipping xmpp flap check 2025-12-11 03:59:04,891 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:08] 2025-12-11 03:59:04,891 - INFO - -------------------------------------------------------------------------------- 2025-12-11 03:59:04,894 - INFO - ================================================================================ 2025-12-11 03:59:04,894 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-12-11 03:59:06,143 - DEBUG - Skipping xmpp flap check 2025-12-11 03:59:06,143 - INFO - Initial checks done. Running the testcase now 2025-12-11 03:59:06,143 - INFO - 2025-12-11 03:59:06,143 - INFO - executing bgp_control_zone agent restart test 2025-12-11 03:59:06,405 - DEBUG - Response for create_network : {'network': {'id': 'b824b686-3cb8-4abc-8b7f-e4f48cc9f78c', 'name': 'ctest-cnz_vn-17306213', 'tenant_id': 'd54f434e80ca4f4cb8df4999ea16ebd0', 'project_id': 'd54f434e80ca4f4cb8df4999ea16ebd0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-13679907', 'ctest-cnz_vn-17306213'], 'port_security_enabled': True, 'description': ''}} 2025-12-11 03:59:06,638 - DEBUG - Response for create_subnet : {'subnet': {'id': '9bf33629-de4e-4eee-8f54-862bcab33c60', 'name': '', 'tenant_id': 'd54f434e80ca4f4cb8df4999ea16ebd0', 'network_id': 'b824b686-3cb8-4abc-8b7f-e4f48cc9f78c', 'ip_version': 4, 'cidr': '197.137.188.128/26', 'allocation_pools': [{'start': '197.137.188.130', 'end': '197.137.188.190'}], 'gateway_ip': '197.137.188.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.137.188.130', 'tags': [], 'project_id': 'd54f434e80ca4f4cb8df4999ea16ebd0'}} 2025-12-11 03:59:06,658 - INFO - Created VN ctest-cnz_vn-17306213 2025-12-11 03:59:06,669 - DEBUG - VN ctest-cnz_vn-17306213 UUID is b824b686-3cb8-4abc-8b7f-e4f48cc9f78c 2025-12-11 03:59:07,845 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4883-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4883-1) 2025-12-11 03:59:09,115 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4883-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4883-2) 2025-12-11 03:59:10,372 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4883-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4883-1) 2025-12-11 03:59:10,373 - INFO - Waiting for VM ctest-TestBGPaasZone-13679907-33788537 to be up.. 2025-12-11 03:59:10,461 - DEBUG - VM is in ACTIVE state now 2025-12-11 03:59:10,461 - INFO - VM name : ctest-TestBGPaasZone-13679907-33788537 2025-12-11 03:59:10,546 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 ID is d6e6bcc1-f65e-4b47-9887-6f6fcc398944 2025-12-11 03:59:10,546 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 launched on Node an-jenkins-deploy-platform-ansible-os-4883-1 2025-12-11 03:59:10,626 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/d6e6bcc1-f65e-4b47-9887-6f6fcc398944 2025-12-11 03:59:10,635 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/0437504d-ecbe-49fe-bc5b-2872559ef353 2025-12-11 03:59:13,818 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-11 03:59:13,818 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:13,831 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:17,908 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-11 03:59:17,908 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:17,921 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:22,004 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-11 03:59:22,004 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:22,017 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:26,096 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-12-11 03:59:26,096 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:26,109 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:30,193 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-12-11 03:59:30,193 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:30,205 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:34,295 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-12-11 03:59:34,295 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:34,307 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:38,385 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-11 03:59:38,385 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:38,398 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:42,489 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-12-11 03:59:42,489 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:42,504 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:46,579 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-11 03:59:46,580 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:46,595 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:50,672 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-12-11 03:59:50,672 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:50,686 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:54,770 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-12-11 03:59:54,770 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:54,784 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 03:59:58,874 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-11 03:59:58,874 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 03:59:58,914 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:02,998 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-12-11 04:00:02,998 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 04:00:03,015 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:07,095 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-11 04:00:07,095 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 04:00:07,107 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:11,187 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-11 04:00:11,187 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 04:00:11,201 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:15,288 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-11 04:00:15,288 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 04:00:15,302 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:19,380 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-11 04:00:19,380 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 04:00:19,393 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:23,479 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-11 04:00:23,479 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 04:00:23,493 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:27,581 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-12-11 04:00:27,581 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 failed! 2025-12-11 04:00:27,595 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-13679907:ctest-cnz_vn-17306213 is 197.137.188.129 and allocation pool is NOT set 2025-12-11 04:00:29,659 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.62 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.50 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.499/2.561/3.624/1.062 ms') 2025-12-11 04:00:29,659 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-33788537 passed 2025-12-11 04:00:29,724 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:00:29,724 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:00:29,788 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:00:29,962 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:00:34,963 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:00:34,963 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:00:35,028 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:00:35,140 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:00:40,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:00:40,141 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:00:40,208 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:00:40,283 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:00:45,284 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:00:45,284 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:00:45,343 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:00:45,424 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:00:50,425 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:00:50,425 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:00:50,492 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:00:50,571 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:00:55,572 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:00:55,572 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:00:55,626 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:00:55,703 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:01:00,703 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:00,704 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:01:00,772 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:01:00,858 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:01:05,859 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:05,859 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:01:05,924 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:01:06,005 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:01:11,006 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:11,006 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:01:11,073 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:01:11,174 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:01:16,174 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:16,175 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:01:16,240 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:01:16,340 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:01:21,341 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:21,341 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-33788537, IP 197.137.188.131, Port 22 2025-12-11 04:01:21,508 - DEBUG - VM ctest-TestBGPaasZone-13679907-33788537 is ready for SSH connections 2025-12-11 04:01:21,508 - INFO - Waiting for VM ctest-TestBGPaasZone-13679907-30263377 to be up.. 2025-12-11 04:01:21,585 - DEBUG - VM is in ACTIVE state now 2025-12-11 04:01:21,585 - INFO - VM name : ctest-TestBGPaasZone-13679907-30263377 2025-12-11 04:01:21,662 - DEBUG - VM ctest-TestBGPaasZone-13679907-30263377 ID is 753288ce-7e96-46d2-b75e-60ca955adb0f 2025-12-11 04:01:21,662 - DEBUG - VM ctest-TestBGPaasZone-13679907-30263377 launched on Node an-jenkins-deploy-platform-ansible-os-4883-2 2025-12-11 04:01:21,739 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/753288ce-7e96-46d2-b75e-60ca955adb0f 2025-12-11 04:01:21,781 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/854c255f-5017-42d6-9f1c-6c083e860335 2025-12-11 04:01:22,932 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.54 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.541 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.541/2.540/4.540/1.999 ms') 2025-12-11 04:01:22,932 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-13679907-30263377 passed 2025-12-11 04:01:22,996 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:22,997 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-30263377, IP 197.137.188.132, Port 22 2025-12-11 04:01:23,159 - DEBUG - VM ctest-TestBGPaasZone-13679907-30263377 is ready for SSH connections 2025-12-11 04:01:23,159 - INFO - Waiting for VM ctest-TestBGPaasZone-13679907-86678730 to be up.. 2025-12-11 04:01:23,238 - DEBUG - VM is in ACTIVE state now 2025-12-11 04:01:23,238 - INFO - VM name : ctest-TestBGPaasZone-13679907-86678730 2025-12-11 04:01:23,312 - DEBUG - VM ctest-TestBGPaasZone-13679907-86678730 ID is 1a34a8b8-3137-4fdd-881f-b5ca3ed8dce2 2025-12-11 04:01:23,312 - DEBUG - VM ctest-TestBGPaasZone-13679907-86678730 launched on Node an-jenkins-deploy-platform-ansible-os-4883-1 2025-12-11 04:01:23,395 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/1a34a8b8-3137-4fdd-881f-b5ca3ed8dce2 2025-12-11 04:01:23,404 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/aefaecb5-8a09-4638-8072-71119879599c 2025-12-11 04:01:24,565 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.40 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.533 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.533/1.967/3.402/1.434 ms') 2025-12-11 04:01:24,565 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-13679907-86678730 passed 2025-12-11 04:01:24,643 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:24,643 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-86678730, IP 197.137.188.133, Port 22 2025-12-11 04:01:24,699 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-11 04:01:24,773 - DEBUG - VM ctest-TestBGPaasZone-13679907-86678730 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-11 04:01:29,774 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:29,774 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-13679907-86678730, IP 197.137.188.133, Port 22 2025-12-11 04:01:29,945 - DEBUG - VM ctest-TestBGPaasZone-13679907-86678730 is ready for SSH connections 2025-12-11 04:01:30,072 - INFO - Created control node zone ctest-test-zone-21548636(135fa91f-cd95-4fb7-be3e-2ca3ba6fcd22) 2025-12-11 04:01:30,424 - INFO - Created control node zone ctest-test-zone-16545795(6b4709ea-2320-49f9-a9af-d5d5492805c3) 2025-12-11 04:01:30,772 - INFO - Created control node zone ctest-test-zone-60993681(04ffe439-dfd8-45aa-89b8-4e719dc263c8) 2025-12-11 04:01:31,052 - INFO - Creating BGPaaS ctest-TestBGPaasZone-13679907-66674407 2025-12-11 04:01:31,132 - INFO - BGPaaS: ctest-TestBGPaasZone-13679907-66674407(56a2f0fc-f4f5-42b6-b7d9-503357a7238d) 2025-12-11 04:01:31,132 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/56a2f0fc-f4f5-42b6-b7d9-503357a7238d 2025-12-11 04:01:31,142 - INFO - verify_in_api_server passed for BGPaaS obj 56a2f0fc-f4f5-42b6-b7d9-503357a7238d 2025-12-11 04:01:31,142 - INFO - BGPaaS(56a2f0fc-f4f5-42b6-b7d9-503357a7238d): verify_on_setup passed 2025-12-11 04:01:31,142 - INFO - We will configure BGP on the VM 2025-12-11 04:01:31,560 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:31,560 - INFO - Configuring BGP on ctest-TestBGPaasZone-13679907-33788537 2025-12-11 04:01:31,560 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 197.137.188.131; protocol bgp bgp_1{ local as 65000; neighbor 197.137.188.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.131; } protocol bfd { neighbor 197.137.188.129 local 197.137.188.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 04:01:31,561 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 197.137.188.131; protocol bgp bgp_1{ local as 65000; neighbor 197.137.188.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.131; } protocol bfd { neighbor 197.137.188.129 local 197.137.188.131 multihop on; } EOS 2025-12-11 04:01:43,560 - DEBUG - None 2025-12-11 04:01:43,560 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 197.137.188.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.131; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 04:01:43,560 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 197.137.188.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.131; } EOS 2025-12-11 04:01:44,069 - DEBUG - None 2025-12-11 04:01:44,069 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 04:01:44,069 - DEBUG - service bird restart 2025-12-11 04:01:45,983 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-12-11 04:01:45,983 - INFO - Attaching VMI 0437504d-ecbe-49fe-bc5b-2872559ef353 to BGPaaS 56a2f0fc-f4f5-42b6-b7d9-503357a7238d 2025-12-11 04:01:46,060 - INFO - Attaching the VMI d6e6bcc1-f65e-4b47-9887-6f6fcc398944 to the BGPaaS 56a2f0fc-f4f5-42b6-b7d9-503357a7238d object 2025-12-11 04:01:46,060 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 197.137.188.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 04:01:46,060 - DEBUG - sudo ip addr add 197.137.188.148 dev eth0 2025-12-11 04:01:46,766 - DEBUG - None 2025-12-11 04:01:46,828 - INFO - Creating BGPaaS ctest-TestBGPaasZone-13679907-92205269 2025-12-11 04:01:46,908 - INFO - BGPaaS: ctest-TestBGPaasZone-13679907-92205269(ddd97d86-a0cc-448a-89fe-4ee5f0861fbe) 2025-12-11 04:01:46,908 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/ddd97d86-a0cc-448a-89fe-4ee5f0861fbe 2025-12-11 04:01:46,919 - INFO - verify_in_api_server passed for BGPaaS obj ddd97d86-a0cc-448a-89fe-4ee5f0861fbe 2025-12-11 04:01:46,919 - INFO - BGPaaS(ddd97d86-a0cc-448a-89fe-4ee5f0861fbe): verify_on_setup passed 2025-12-11 04:01:46,919 - INFO - We will configure BGP on the VM 2025-12-11 04:01:47,364 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:47,364 - INFO - Configuring BGP on ctest-TestBGPaasZone-13679907-30263377 2025-12-11 04:01:47,364 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 197.137.188.132; protocol bgp bgp_1{ local as 65000; neighbor 197.137.188.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.132; } protocol bfd { neighbor 197.137.188.129 local 197.137.188.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 04:01:47,364 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 197.137.188.132; protocol bgp bgp_1{ local as 65000; neighbor 197.137.188.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.132; } protocol bfd { neighbor 197.137.188.129 local 197.137.188.132 multihop on; } EOS 2025-12-11 04:01:52,776 - DEBUG - None 2025-12-11 04:01:52,777 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 197.137.188.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.132; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 04:01:52,777 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 197.137.188.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 197.137.188.132; } EOS 2025-12-11 04:01:53,295 - DEBUG - None 2025-12-11 04:01:53,295 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 04:01:53,296 - DEBUG - service bird restart 2025-12-11 04:01:55,101 - DEBUG - bird stop/waiting bird start/running, process 1434 2025-12-11 04:01:55,101 - INFO - Attaching VMI 854c255f-5017-42d6-9f1c-6c083e860335 to BGPaaS ddd97d86-a0cc-448a-89fe-4ee5f0861fbe 2025-12-11 04:01:55,180 - INFO - Attaching the VMI 753288ce-7e96-46d2-b75e-60ca955adb0f to the BGPaaS ddd97d86-a0cc-448a-89fe-4ee5f0861fbe object 2025-12-11 04:01:55,180 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 197.137.188.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-12-11 04:01:55,180 - DEBUG - sudo ip addr add 197.137.188.148 dev eth0 2025-12-11 04:01:55,880 - DEBUG - None 2025-12-11 04:01:55,881 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:55,881 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 04:01:55,892 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-11 04:01:55,893 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:55,907 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-11 04:01:55,915 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:01:55,915 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 04:01:55,931 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-12-11 04:02:01,931 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 04:02:01,943 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-11 04:02:01,943 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:02:01,957 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-12-11 04:02:07,973 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-11 04:02:07,978 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 197.137.188.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 04:02:07,979 - DEBUG - ping -s 56 -c 3 -W 1 197.137.188.148 2025-12-11 04:02:14,743 - DEBUG - PING 197.137.188.148 (197.137.188.148) 56(84) bytes of data. 64 bytes from 197.137.188.148: icmp_seq=1 ttl=64 time=9.29 ms 64 bytes from 197.137.188.148: icmp_seq=2 ttl=64 time=1.63 ms 64 bytes from 197.137.188.148: icmp_seq=3 ttl=64 time=1.21 ms --- 197.137.188.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2006ms rtt min/avg/max/mdev = 1.213/4.049/9.296/3.714 ms 2025-12-11 04:02:14,743 - INFO - Ping to IP 197.137.188.148 from VM ctest-TestBGPaasZone-13679907-86678730 passed 2025-12-11 04:02:14,743 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:02:14,743 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 04:02:14,755 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-11 04:02:14,756 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:02:14,772 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-11 04:02:14,778 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:02:14,778 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-11 04:02:14,790 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-11 04:02:14,791 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-11 04:02:14,806 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-11 04:02:14,812 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 197.137.188.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-12-11 04:02:14,812 - DEBUG - ping -s 56 -c 3 -W 1 197.137.188.148 2025-12-11 04:02:17,289 - DEBUG - PING 197.137.188.148 (197.137.188.148) 56(84) bytes of data. 64 bytes from 197.137.188.148: icmp_seq=1 ttl=64 time=5.01 ms 64 bytes from 197.137.188.148: icmp_seq=2 ttl=64 time=1.49 ms 64 bytes from 197.137.188.148: icmp_seq=3 ttl=64 time=1.21 ms --- 197.137.188.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.218/2.576/5.015/1.728 ms 2025-12-11 04:02:17,289 - INFO - Ping to IP 197.137.188.148 from VM ctest-TestBGPaasZone-13679907-86678730 passed 2025-12-11 04:02:17,290 - INFO - Detaching VMI 854c255f-5017-42d6-9f1c-6c083e860335 from BGPaaS ddd97d86-a0cc-448a-89fe-4ee5f0861fbe 2025-12-11 04:02:17,368 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-13679907-92205269(ddd97d86-a0cc-448a-89fe-4ee5f0861fbe) 2025-12-11 04:02:17,460 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/ddd97d86-a0cc-448a-89fe-4ee5f0861fbe 2025-12-11 04:02:17,474 - DEBUG - Response Code: 404 2025-12-11 04:02:17,474 - DEBUG - BGPaaS: ddd97d86-a0cc-448a-89fe-4ee5f0861fbe deleted from api server 2025-12-11 04:02:17,474 - INFO - BGPaaS(ddd97d86-a0cc-448a-89fe-4ee5f0861fbe): verify_on_cleanup passed 2025-12-11 04:02:17,474 - INFO - Detaching VMI 0437504d-ecbe-49fe-bc5b-2872559ef353 from BGPaaS 56a2f0fc-f4f5-42b6-b7d9-503357a7238d 2025-12-11 04:02:17,556 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-13679907-66674407(56a2f0fc-f4f5-42b6-b7d9-503357a7238d) 2025-12-11 04:02:17,623 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/56a2f0fc-f4f5-42b6-b7d9-503357a7238d 2025-12-11 04:02:17,628 - DEBUG - Response Code: 404 2025-12-11 04:02:17,628 - DEBUG - BGPaaS: 56a2f0fc-f4f5-42b6-b7d9-503357a7238d deleted from api server 2025-12-11 04:02:17,628 - INFO - BGPaaS(56a2f0fc-f4f5-42b6-b7d9-503357a7238d): verify_on_cleanup passed 2025-12-11 04:02:17,629 - INFO - Deleting Control node zone ctest-test-zone-60993681(04ffe439-dfd8-45aa-89b8-4e719dc263c8) 2025-12-11 04:02:17,787 - INFO - Deleting Control node zone ctest-test-zone-16545795(6b4709ea-2320-49f9-a9af-d5d5492805c3) 2025-12-11 04:02:17,938 - INFO - Deleting Control node zone ctest-test-zone-21548636(135fa91f-cd95-4fb7-be3e-2ca3ba6fcd22) 2025-12-11 04:02:18,090 - INFO - Deleting VM ctest-TestBGPaasZone-13679907-86678730 2025-12-11 04:02:18,162 - INFO - Deleting VM ctest-TestBGPaasZone-13679907-30263377 2025-12-11 04:02:18,234 - INFO - Deleting VM ctest-TestBGPaasZone-13679907-33788537 2025-12-11 04:02:18,306 - INFO - Deleting VN ctest-cnz_vn-17306213 2025-12-11 04:02:18,347 - DEBUG - VN b824b686-3cb8-4abc-8b7f-e4f48cc9f78c still in use: Unable to complete operation on network b824b686-3cb8-4abc-8b7f-e4f48cc9f78c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4e0f4265-6cc2-4c28-b2c1-1a093d24d128'] 2025-12-11 04:02:18,347 - WARNING - Deleting VN ctest-cnz_vn-17306213 failed..Will retry 2025-12-11 04:02:20,583 - DEBUG - Response for deleting network () 2025-12-11 04:02:21,855 - DEBUG - Skipping xmpp flap check 2025-12-11 04:02:21,855 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:17] 2025-12-11 04:02:21,855 - INFO - -------------------------------------------------------------------------------- 2025-12-11 04:02:22,654 - INFO - Deleted project: ctest-TestBGPaasZone-13679907, ID : d54f434e-80ca-4f4c-b8df-4999ea16ebd0