2025-11-27 03:44:50,124 - INFO - Domain Default found not creating 2025-11-27 03:44:50,284 - INFO - Project ctest-TestBGPaasZone-31440575 not found, creating it 2025-11-27 03:44:50,783 - INFO - Created Project:ctest-TestBGPaasZone-31440575, ID : c3a6da30-7581-4594-bb0a-c312657da5e1 2025-11-27 03:44:52,329 - DEBUG - Services list from nova: [, , , ] 2025-11-27 03:44:52,329 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4820-2', 'an-jenkins-deploy-platform-ansible-os-4820-1']} 2025-11-27 03:44:52,331 - INFO - ================================================================================ 2025-11-27 03:44:52,331 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-11-27 03:44:53,593 - DEBUG - Skipping xmpp flap check 2025-11-27 03:44:53,593 - INFO - Initial checks done. Running the testcase now 2025-11-27 03:44:53,593 - INFO - 2025-11-27 03:44:53,593 - INFO - executing bgp_control_zone test 2025-11-27 03:44:54,296 - DEBUG - Response for create_network : {'network': {'id': '984ebf70-d105-47eb-ab07-eae355ee89b3', 'name': 'ctest-cnz_vn-10991340', 'tenant_id': 'c3a6da3075814594bb0ac312657da5e1', 'project_id': 'c3a6da3075814594bb0ac312657da5e1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-31440575', 'ctest-cnz_vn-10991340'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:44:54,547 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f4ff9c95-919f-42ac-84da-1bdfe54784bc', 'name': '', 'tenant_id': 'c3a6da3075814594bb0ac312657da5e1', 'network_id': '984ebf70-d105-47eb-ab07-eae355ee89b3', 'ip_version': 4, 'cidr': '6.98.17.192/26', 'allocation_pools': [{'start': '6.98.17.194', 'end': '6.98.17.254'}], 'gateway_ip': '6.98.17.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '6.98.17.194', 'tags': [], 'project_id': 'c3a6da3075814594bb0ac312657da5e1'}} 2025-11-27 03:44:54,571 - INFO - Created VN ctest-cnz_vn-10991340 2025-11-27 03:44:54,581 - DEBUG - VN ctest-cnz_vn-10991340 UUID is 984ebf70-d105-47eb-ab07-eae355ee89b3 2025-11-27 03:44:55,766 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-2) 2025-11-27 03:44:57,181 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-1) 2025-11-27 03:44:59,066 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-2) 2025-11-27 03:44:59,067 - INFO - Waiting for VM ctest-TestBGPaasZone-31440575-55459897 to be up.. 2025-11-27 03:44:59,209 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:04,337 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:09,454 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:14,540 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:19,623 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:24,716 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:29,796 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:34,873 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-27 03:45:39,964 - DEBUG - VM is in ACTIVE state now 2025-11-27 03:45:39,964 - INFO - VM name : ctest-TestBGPaasZone-31440575-55459897 2025-11-27 03:45:40,046 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 ID is 81bb4dd9-3238-4446-ab91-f628c036fec9 2025-11-27 03:45:40,070 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 launched on Node an-jenkins-deploy-platform-ansible-os-4820-2 2025-11-27 03:45:40,145 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/81bb4dd9-3238-4446-ab91-f628c036fec9 2025-11-27 03:45:40,441 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/81bb4dd9-3238-4446-ab91-f628c036fec9 2025-11-27 03:45:40,475 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/665efb35-fe47-4f10-8605-eebd3ab8393a 2025-11-27 03:45:43,626 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-11-27 03:45:43,626 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:45:43,641 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:45:47,731 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-11-27 03:45:47,731 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:45:47,752 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:45:51,822 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-27 03:45:51,822 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:45:51,836 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:45:55,914 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-27 03:45:55,914 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:45:55,929 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:00,024 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-11-27 03:46:00,024 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:00,038 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:04,118 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-27 03:46:04,118 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:04,131 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:08,205 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-27 03:46:08,206 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:08,218 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:12,306 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-27 03:46:12,307 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:12,320 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:16,398 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-27 03:46:16,399 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:16,414 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:20,498 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-27 03:46:20,499 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:20,515 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:24,591 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-27 03:46:24,591 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:24,604 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:28,686 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-27 03:46:28,686 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:28,698 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:32,780 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-27 03:46:32,780 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:32,793 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:36,881 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-27 03:46:36,881 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:36,894 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:40,975 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-27 03:46:40,975 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:40,988 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:45,070 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-27 03:46:45,070 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:45,084 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:49,169 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-27 03:46:49,169 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 failed! 2025-11-27 03:46:49,181 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-10991340 is 6.98.17.193 and allocation pool is NOT set 2025-11-27 03:46:51,248 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.32 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.36 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.359/2.341/3.323/0.982 ms') 2025-11-27 03:46:51,248 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-55459897 passed 2025-11-27 03:46:51,312 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:46:51,312 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:46:51,378 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:46:51,464 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:46:56,465 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:46:56,465 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:46:56,530 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:46:56,606 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:01,608 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:01,608 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:01,675 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:47:01,771 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:06,772 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:06,772 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:06,839 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:47:06,928 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:11,928 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:11,928 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:11,984 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:47:12,066 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:17,066 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:17,067 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:17,134 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:47:17,216 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:22,216 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:22,216 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:22,272 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:47:22,357 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:27,358 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:27,358 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:27,426 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:47:27,535 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:32,536 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:32,536 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:32,602 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:47:32,679 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:47:37,680 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:37,680 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-55459897, IP 6.98.17.195, Port 22 2025-11-27 03:47:37,850 - DEBUG - VM ctest-TestBGPaasZone-31440575-55459897 is ready for SSH connections 2025-11-27 03:47:37,851 - INFO - Waiting for VM ctest-TestBGPaasZone-31440575-54082180 to be up.. 2025-11-27 03:47:37,938 - DEBUG - VM is in ACTIVE state now 2025-11-27 03:47:37,938 - INFO - VM name : ctest-TestBGPaasZone-31440575-54082180 2025-11-27 03:47:38,011 - DEBUG - VM ctest-TestBGPaasZone-31440575-54082180 ID is 0c78bc6c-60e7-4908-ac01-51f83fd13ee9 2025-11-27 03:47:38,011 - DEBUG - VM ctest-TestBGPaasZone-31440575-54082180 launched on Node an-jenkins-deploy-platform-ansible-os-4820-1 2025-11-27 03:47:38,082 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/0c78bc6c-60e7-4908-ac01-51f83fd13ee9 2025-11-27 03:47:38,091 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/315f5ddd-3deb-4943-b53e-c78af3d70d76 2025-11-27 03:47:39,242 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.10 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.532 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.532/1.816/3.101/1.284 ms') 2025-11-27 03:47:39,242 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-54082180 passed 2025-11-27 03:47:39,308 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:39,308 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-54082180, IP 6.98.17.196, Port 22 2025-11-27 03:47:39,476 - DEBUG - VM ctest-TestBGPaasZone-31440575-54082180 is ready for SSH connections 2025-11-27 03:47:39,476 - INFO - Waiting for VM ctest-TestBGPaasZone-31440575-70688301 to be up.. 2025-11-27 03:47:39,553 - DEBUG - VM is in ACTIVE state now 2025-11-27 03:47:39,553 - INFO - VM name : ctest-TestBGPaasZone-31440575-70688301 2025-11-27 03:47:39,629 - DEBUG - VM ctest-TestBGPaasZone-31440575-70688301 ID is 131212cd-b1cc-46b7-a8c2-a6d53b388adf 2025-11-27 03:47:39,629 - DEBUG - VM ctest-TestBGPaasZone-31440575-70688301 launched on Node an-jenkins-deploy-platform-ansible-os-4820-2 2025-11-27 03:47:39,701 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/131212cd-b1cc-46b7-a8c2-a6d53b388adf 2025-11-27 03:47:39,715 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/b47bdcbc-5663-4886-8de6-77a5584f9776 2025-11-27 03:47:40,879 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.96 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.90 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.895/2.929/2.963/0.034 ms') 2025-11-27 03:47:40,879 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-31440575-70688301 passed 2025-11-27 03:47:40,949 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:40,949 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-70688301, IP 6.98.17.197, Port 22 2025-11-27 03:47:41,119 - DEBUG - VM ctest-TestBGPaasZone-31440575-70688301 is ready for SSH connections 2025-11-27 03:47:41,268 - INFO - Created control node zone ctest-test-zone-04438983(da6a74b2-0cde-4ed8-8304-0d267da10ac5) 2025-11-27 03:47:41,624 - INFO - Created control node zone ctest-test-zone-00435816(d2bd9c3f-d13b-45f9-a661-197032c9de2d) 2025-11-27 03:47:41,972 - INFO - Created control node zone ctest-test-zone-85026087(d3ecdcb5-3a45-4f6d-81fc-3bf1caede083) 2025-11-27 03:47:42,244 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31440575-05366671 2025-11-27 03:47:42,320 - INFO - BGPaaS: ctest-TestBGPaasZone-31440575-05366671(32cec166-567a-419f-a3db-aa8eb64860d8) 2025-11-27 03:47:42,320 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:47:42,619 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:47:42,651 - INFO - verify_in_api_server passed for BGPaaS obj 32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:47:42,651 - INFO - BGPaaS(32cec166-567a-419f-a3db-aa8eb64860d8): verify_on_setup passed 2025-11-27 03:47:42,651 - INFO - We will configure BGP on the VM 2025-11-27 03:47:42,904 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:47:42,904 - INFO - Configuring BGP on ctest-TestBGPaasZone-31440575-55459897 2025-11-27 03:47:42,904 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:47:42,904 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS 2025-11-27 03:47:57,722 - DEBUG - None 2025-11-27 03:47:57,722 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:47:57,722 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS 2025-11-27 03:47:58,220 - DEBUG - None 2025-11-27 03:47:58,220 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:47:58,220 - DEBUG - service bird restart 2025-11-27 03:47:59,874 - DEBUG - bird stop/waiting bird start/running, process 1436 2025-11-27 03:47:59,874 - INFO - Attaching VMI 665efb35-fe47-4f10-8605-eebd3ab8393a to BGPaaS 32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:47:59,944 - INFO - Attaching the VMI 81bb4dd9-3238-4446-ab91-f628c036fec9 to the BGPaaS 32cec166-567a-419f-a3db-aa8eb64860d8 object 2025-11-27 03:47:59,944 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 6.98.17.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:47:59,944 - DEBUG - sudo ip addr add 6.98.17.212 dev eth0 2025-11-27 03:48:00,591 - DEBUG - None 2025-11-27 03:48:00,652 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31440575-54695813 2025-11-27 03:48:00,724 - INFO - BGPaaS: ctest-TestBGPaasZone-31440575-54695813(fe9c9023-8f5d-4ab6-8a30-e4849ceb542f) 2025-11-27 03:48:00,724 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/fe9c9023-8f5d-4ab6-8a30-e4849ceb542f 2025-11-27 03:48:00,734 - INFO - verify_in_api_server passed for BGPaaS obj fe9c9023-8f5d-4ab6-8a30-e4849ceb542f 2025-11-27 03:48:00,734 - INFO - BGPaaS(fe9c9023-8f5d-4ab6-8a30-e4849ceb542f): verify_on_setup passed 2025-11-27 03:48:00,734 - INFO - We will configure BGP on the VM 2025-11-27 03:48:00,984 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:48:00,984 - INFO - Configuring BGP on ctest-TestBGPaasZone-31440575-54082180 2025-11-27 03:48:00,984 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.196; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.196; } protocol bfd { neighbor 6.98.17.194 local 6.98.17.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:48:00,984 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.196; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.196; } protocol bfd { neighbor 6.98.17.194 local 6.98.17.196 multihop on; } EOS 2025-11-27 03:48:16,270 - DEBUG - None 2025-11-27 03:48:16,270 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.196; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.196; } protocol bfd { neighbor 6.98.17.194 local 6.98.17.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:48:16,270 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.196; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.196; } protocol bfd { neighbor 6.98.17.194 local 6.98.17.196 multihop on; } EOS 2025-11-27 03:48:16,745 - DEBUG - None 2025-11-27 03:48:16,745 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:48:16,746 - DEBUG - service bird restart 2025-11-27 03:48:18,413 - DEBUG - bird stop/waiting bird start/running, process 1440 2025-11-27 03:48:18,413 - INFO - Attaching VMI 315f5ddd-3deb-4943-b53e-c78af3d70d76 to BGPaaS fe9c9023-8f5d-4ab6-8a30-e4849ceb542f 2025-11-27 03:48:18,484 - INFO - Attaching the VMI 0c78bc6c-60e7-4908-ac01-51f83fd13ee9 to the BGPaaS fe9c9023-8f5d-4ab6-8a30-e4849ceb542f object 2025-11-27 03:48:18,484 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 6.98.17.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:48:18,484 - DEBUG - sudo ip addr add 6.98.17.212 dev eth0 2025-11-27 03:48:19,116 - DEBUG - None 2025-11-27 03:48:19,116 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:48:19,133 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-27 03:48:19,143 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:48:19,143 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:48:19,161 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-11-27 03:48:25,162 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:48:25,178 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-11-27 03:48:31,179 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:48:31,194 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-27 03:48:31,200 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 6.98.17.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:48:31,200 - DEBUG - ping -s 56 -c 3 -W 1 6.98.17.212 2025-11-27 03:48:42,575 - DEBUG - PING 6.98.17.212 (6.98.17.212) 56(84) bytes of data. 64 bytes from 6.98.17.212: icmp_seq=1 ttl=64 time=7.00 ms 64 bytes from 6.98.17.212: icmp_seq=2 ttl=64 time=0.850 ms 64 bytes from 6.98.17.212: icmp_seq=3 ttl=64 time=0.824 ms --- 6.98.17.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.824/2.892/7.002/2.906 ms 2025-11-27 03:48:42,575 - INFO - Ping to IP 6.98.17.212 from VM ctest-TestBGPaasZone-31440575-70688301 passed 2025-11-27 03:48:43,392 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:48:43,392 - DEBUG - service bird restart 2025-11-27 03:48:45,020 - DEBUG - bird stop/waiting bird start/running, process 1463 2025-11-27 03:48:45,020 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:48:45,020 - DEBUG - service bird restart 2025-11-27 03:48:46,602 - DEBUG - bird stop/waiting bird start/running, process 1467 2025-11-27 03:48:46,602 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:48:46,619 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.192'] 2025-11-27 03:48:52,637 - INFO - BGPaaS session seen in control-node 10.20.0.192 2025-11-27 03:48:52,644 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:48:52,644 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:48:52,662 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-11-27 03:48:58,662 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:48:58,679 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-27 03:48:58,684 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 6.98.17.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:48:58,684 - DEBUG - ping -s 56 -c 3 -W 1 6.98.17.212 2025-11-27 03:49:01,159 - DEBUG - PING 6.98.17.212 (6.98.17.212) 56(84) bytes of data. 64 bytes from 6.98.17.212: icmp_seq=1 ttl=64 time=1.40 ms 64 bytes from 6.98.17.212: icmp_seq=2 ttl=64 time=0.924 ms 64 bytes from 6.98.17.212: icmp_seq=3 ttl=64 time=0.894 ms --- 6.98.17.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.894/1.073/1.402/0.234 ms 2025-11-27 03:49:01,159 - INFO - Ping to IP 6.98.17.212 from VM ctest-TestBGPaasZone-31440575-70688301 passed 2025-11-27 03:49:01,457 - INFO - We will configure BGP on the VM 2025-11-27 03:49:01,664 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:49:01,664 - INFO - Configuring BGP on ctest-TestBGPaasZone-31440575-55459897 2025-11-27 03:49:01,664 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:49:01,665 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS 2025-11-27 03:49:02,130 - DEBUG - None 2025-11-27 03:49:02,130 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:49:02,130 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 6.98.17.195; protocol bgp bgp_1{ local as 65000; neighbor 6.98.17.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 6.98.17.195; } protocol bfd { neighbor 6.98.17.193 local 6.98.17.195 multihop on; } EOS 2025-11-27 03:49:02,621 - DEBUG - None 2025-11-27 03:49:02,621 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:49:02,621 - DEBUG - service bird restart 2025-11-27 03:49:04,264 - DEBUG - bird stop/waiting bird start/running, process 1495 2025-11-27 03:49:04,264 - INFO - Attaching VMI 665efb35-fe47-4f10-8605-eebd3ab8393a to BGPaaS 32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:49:04,287 - INFO - Attaching the VMI 81bb4dd9-3238-4446-ab91-f628c036fec9 to the BGPaaS 32cec166-567a-419f-a3db-aa8eb64860d8 object 2025-11-27 03:49:04,287 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 6.98.17.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:49:04,287 - DEBUG - sudo ip addr add 6.98.17.212 dev eth0 2025-11-27 03:49:04,959 - DEBUG - RTNETLINK answers: File exists 2025-11-27 03:49:04,959 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:49:04,959 - DEBUG - service bird restart 2025-11-27 03:49:06,632 - DEBUG - bird stop/waiting bird start/running, process 1522 2025-11-27 03:49:06,632 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:49:06,632 - DEBUG - service bird restart 2025-11-27 03:49:08,348 - DEBUG - bird stop/waiting bird start/running, process 1489 2025-11-27 03:49:08,348 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:49:08,364 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-11-27 03:49:14,377 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-27 03:49:14,383 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:49:14,383 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:49:14,399 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-27 03:49:14,405 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 6.98.17.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:49:14,406 - DEBUG - ping -s 56 -c 3 -W 1 6.98.17.212 2025-11-27 03:49:16,878 - DEBUG - PING 6.98.17.212 (6.98.17.212) 56(84) bytes of data. 64 bytes from 6.98.17.212: icmp_seq=1 ttl=64 time=1.97 ms 64 bytes from 6.98.17.212: icmp_seq=2 ttl=64 time=0.934 ms 64 bytes from 6.98.17.212: icmp_seq=3 ttl=64 time=0.903 ms --- 6.98.17.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.903/1.269/1.971/0.497 ms 2025-11-27 03:49:16,878 - INFO - Ping to IP 6.98.17.212 from VM ctest-TestBGPaasZone-31440575-70688301 passed 2025-11-27 03:49:16,878 - INFO - Detaching VMI 665efb35-fe47-4f10-8605-eebd3ab8393a from BGPaaS 32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:49:16,952 - INFO - Detaching VMI 315f5ddd-3deb-4943-b53e-c78af3d70d76 from BGPaaS fe9c9023-8f5d-4ab6-8a30-e4849ceb542f 2025-11-27 03:49:17,036 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31440575-54695813(fe9c9023-8f5d-4ab6-8a30-e4849ceb542f) 2025-11-27 03:49:17,079 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/fe9c9023-8f5d-4ab6-8a30-e4849ceb542f 2025-11-27 03:49:17,091 - DEBUG - Response Code: 404 2025-11-27 03:49:17,092 - DEBUG - BGPaaS: fe9c9023-8f5d-4ab6-8a30-e4849ceb542f deleted from api server 2025-11-27 03:49:17,092 - INFO - BGPaaS(fe9c9023-8f5d-4ab6-8a30-e4849ceb542f): verify_on_cleanup passed 2025-11-27 03:49:17,092 - INFO - Detaching VMI 665efb35-fe47-4f10-8605-eebd3ab8393a from BGPaaS 32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:49:17,121 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31440575-05366671(32cec166-567a-419f-a3db-aa8eb64860d8) 2025-11-27 03:49:17,167 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/32cec166-567a-419f-a3db-aa8eb64860d8 2025-11-27 03:49:17,181 - DEBUG - Response Code: 404 2025-11-27 03:49:17,181 - DEBUG - BGPaaS: 32cec166-567a-419f-a3db-aa8eb64860d8 deleted from api server 2025-11-27 03:49:17,181 - INFO - BGPaaS(32cec166-567a-419f-a3db-aa8eb64860d8): verify_on_cleanup passed 2025-11-27 03:49:17,181 - INFO - Deleting Control node zone ctest-test-zone-85026087(d3ecdcb5-3a45-4f6d-81fc-3bf1caede083) 2025-11-27 03:49:17,324 - INFO - Deleting Control node zone ctest-test-zone-00435816(d2bd9c3f-d13b-45f9-a661-197032c9de2d) 2025-11-27 03:49:17,464 - INFO - Deleting Control node zone ctest-test-zone-04438983(da6a74b2-0cde-4ed8-8304-0d267da10ac5) 2025-11-27 03:49:17,540 - INFO - Deleting VM ctest-TestBGPaasZone-31440575-70688301 2025-11-27 03:49:17,618 - INFO - Deleting VM ctest-TestBGPaasZone-31440575-54082180 2025-11-27 03:49:17,683 - INFO - Deleting VM ctest-TestBGPaasZone-31440575-55459897 2025-11-27 03:49:17,746 - INFO - Deleting VN ctest-cnz_vn-10991340 2025-11-27 03:49:17,791 - DEBUG - VN 984ebf70-d105-47eb-ab07-eae355ee89b3 still in use: Unable to complete operation on network 984ebf70-d105-47eb-ab07-eae355ee89b3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-654f869a-87de-42c6-87e4-5b04ccde69d8'] 2025-11-27 03:49:17,791 - WARNING - Deleting VN ctest-cnz_vn-10991340 failed..Will retry 2025-11-27 03:49:19,994 - DEBUG - Response for deleting network () 2025-11-27 03:49:21,307 - DEBUG - Skipping xmpp flap check 2025-11-27 03:49:21,308 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:29] 2025-11-27 03:49:21,308 - INFO - -------------------------------------------------------------------------------- 2025-11-27 03:49:21,312 - INFO - ================================================================================ 2025-11-27 03:49:21,313 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-11-27 03:49:22,584 - DEBUG - Skipping xmpp flap check 2025-11-27 03:49:22,584 - INFO - Initial checks done. Running the testcase now 2025-11-27 03:49:22,584 - INFO - 2025-11-27 03:49:22,585 - INFO - executing bgp_control_zone agent restart test 2025-11-27 03:49:22,848 - DEBUG - Response for create_network : {'network': {'id': 'f1d546f0-9796-45c9-9b18-ffa6e5a4fb1a', 'name': 'ctest-cnz_vn-55074640', 'tenant_id': 'c3a6da3075814594bb0ac312657da5e1', 'project_id': 'c3a6da3075814594bb0ac312657da5e1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-31440575', 'ctest-cnz_vn-55074640'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:49:23,097 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e12702f5-b004-441c-94be-1362972c45bf', 'name': '', 'tenant_id': 'c3a6da3075814594bb0ac312657da5e1', 'network_id': 'f1d546f0-9796-45c9-9b18-ffa6e5a4fb1a', 'ip_version': 4, 'cidr': '26.215.211.64/26', 'allocation_pools': [{'start': '26.215.211.66', 'end': '26.215.211.126'}], 'gateway_ip': '26.215.211.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '26.215.211.66', 'tags': [], 'project_id': 'c3a6da3075814594bb0ac312657da5e1'}} 2025-11-27 03:49:23,124 - INFO - Created VN ctest-cnz_vn-55074640 2025-11-27 03:49:23,136 - DEBUG - VN ctest-cnz_vn-55074640 UUID is f1d546f0-9796-45c9-9b18-ffa6e5a4fb1a 2025-11-27 03:49:24,379 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-1) 2025-11-27 03:49:25,666 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-2) 2025-11-27 03:49:27,062 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-1) 2025-11-27 03:49:27,063 - INFO - Waiting for VM ctest-TestBGPaasZone-31440575-67639060 to be up.. 2025-11-27 03:49:27,146 - DEBUG - VM is in ACTIVE state now 2025-11-27 03:49:27,146 - INFO - VM name : ctest-TestBGPaasZone-31440575-67639060 2025-11-27 03:49:27,231 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 ID is b7d2b6ef-53f9-4be2-b54e-5e14c0e51772 2025-11-27 03:49:27,231 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 launched on Node an-jenkins-deploy-platform-ansible-os-4820-1 2025-11-27 03:49:27,323 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b7d2b6ef-53f9-4be2-b54e-5e14c0e51772 2025-11-27 03:49:27,333 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/db40846e-bc4e-4c9a-af07-16bfb15458a6 2025-11-27 03:49:30,529 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-11-27 03:49:30,529 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:30,542 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:49:34,625 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-27 03:49:34,625 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:34,638 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:49:38,724 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-11-27 03:49:38,724 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:38,741 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:49:42,821 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-27 03:49:42,821 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:42,834 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:49:46,912 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-27 03:49:46,912 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:46,925 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:49:51,017 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-11-27 03:49:51,018 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:51,037 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:49:55,110 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-27 03:49:55,110 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:55,157 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:49:59,241 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-27 03:49:59,241 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:49:59,254 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:03,328 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-11-27 03:50:03,328 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:03,341 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:07,437 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-11-27 03:50:07,438 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:07,452 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:11,520 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-27 03:50:11,521 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:11,536 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:15,621 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-27 03:50:15,621 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:15,634 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:19,715 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-27 03:50:19,715 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:19,730 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:23,817 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-27 03:50:23,817 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:23,832 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:27,917 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-27 03:50:27,917 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:27,933 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:32,007 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-11-27 03:50:32,007 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:32,023 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:36,096 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-27 03:50:36,096 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:36,109 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:40,200 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-27 03:50:40,200 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 failed! 2025-11-27 03:50:40,213 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31440575:ctest-cnz_vn-55074640 is 26.215.211.65 and allocation pool is NOT set 2025-11-27 03:50:42,276 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.09 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.20 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.196/6.140/9.085/2.944 ms') 2025-11-27 03:50:42,276 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-67639060 passed 2025-11-27 03:50:42,340 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:50:42,340 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:50:42,408 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:50:42,567 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:50:47,568 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:50:47,568 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:50:47,636 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:50:47,765 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:50:52,766 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:50:52,766 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:50:52,842 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:50:52,921 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:50:57,921 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:50:57,921 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:50:57,989 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:50:58,065 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:51:03,065 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:03,065 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:51:03,132 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:51:03,213 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:51:08,214 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:08,214 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:51:08,280 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:51:08,357 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:51:13,358 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:13,358 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:51:13,424 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:51:13,514 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:51:18,514 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:18,514 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:51:18,579 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:51:18,660 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:51:23,661 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:23,661 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:51:23,718 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:51:23,793 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:51:28,793 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:28,793 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:51:28,860 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-27 03:51:28,936 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-27 03:51:33,936 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:33,936 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-67639060, IP 26.215.211.67, Port 22 2025-11-27 03:51:34,098 - DEBUG - VM ctest-TestBGPaasZone-31440575-67639060 is ready for SSH connections 2025-11-27 03:51:34,098 - INFO - Waiting for VM ctest-TestBGPaasZone-31440575-12976440 to be up.. 2025-11-27 03:51:34,198 - DEBUG - VM is in ACTIVE state now 2025-11-27 03:51:34,198 - INFO - VM name : ctest-TestBGPaasZone-31440575-12976440 2025-11-27 03:51:34,284 - DEBUG - VM ctest-TestBGPaasZone-31440575-12976440 ID is 93b7d004-511e-43e5-911d-661059231d09 2025-11-27 03:51:34,284 - DEBUG - VM ctest-TestBGPaasZone-31440575-12976440 launched on Node an-jenkins-deploy-platform-ansible-os-4820-2 2025-11-27 03:51:34,375 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/93b7d004-511e-43e5-911d-661059231d09 2025-11-27 03:51:34,434 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/fb0394f2-e585-4ee3-9c69-239554ae0171 2025-11-27 03:51:35,595 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.75 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.613 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.613/2.182/3.752/1.569 ms') 2025-11-27 03:51:35,595 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31440575-12976440 passed 2025-11-27 03:51:35,664 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:35,664 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-12976440, IP 26.215.211.68, Port 22 2025-11-27 03:51:35,834 - DEBUG - VM ctest-TestBGPaasZone-31440575-12976440 is ready for SSH connections 2025-11-27 03:51:35,834 - INFO - Waiting for VM ctest-TestBGPaasZone-31440575-60456671 to be up.. 2025-11-27 03:51:35,921 - DEBUG - VM is in ACTIVE state now 2025-11-27 03:51:35,921 - INFO - VM name : ctest-TestBGPaasZone-31440575-60456671 2025-11-27 03:51:36,004 - DEBUG - VM ctest-TestBGPaasZone-31440575-60456671 ID is dcea69ba-5f4e-4d28-895b-7620b23941c8 2025-11-27 03:51:36,004 - DEBUG - VM ctest-TestBGPaasZone-31440575-60456671 launched on Node an-jenkins-deploy-platform-ansible-os-4820-1 2025-11-27 03:51:36,084 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/dcea69ba-5f4e-4d28-895b-7620b23941c8 2025-11-27 03:51:36,093 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/49a334d6-1997-4753-96c2-d77ff6d672a9 2025-11-27 03:51:37,263 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.55 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.913 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.913/2.231/3.549/1.318 ms') 2025-11-27 03:51:37,263 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-31440575-60456671 passed 2025-11-27 03:51:37,328 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:37,328 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31440575-60456671, IP 26.215.211.69, Port 22 2025-11-27 03:51:37,503 - DEBUG - VM ctest-TestBGPaasZone-31440575-60456671 is ready for SSH connections 2025-11-27 03:51:37,648 - INFO - Created control node zone ctest-test-zone-72180969(d7d19f24-7828-467f-969e-b8bd1f0cdbb6) 2025-11-27 03:51:38,008 - INFO - Created control node zone ctest-test-zone-46087305(a01b466a-a15a-47d5-a960-84b7da9d3e87) 2025-11-27 03:51:38,352 - INFO - Created control node zone ctest-test-zone-33200372(a3c161f7-6ffc-489f-a4f6-e29dc069b650) 2025-11-27 03:51:38,636 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31440575-56548312 2025-11-27 03:51:38,712 - INFO - BGPaaS: ctest-TestBGPaasZone-31440575-56548312(35964170-8cab-42a8-8ea8-02d4015f27f1) 2025-11-27 03:51:38,713 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/35964170-8cab-42a8-8ea8-02d4015f27f1 2025-11-27 03:51:38,721 - INFO - verify_in_api_server passed for BGPaaS obj 35964170-8cab-42a8-8ea8-02d4015f27f1 2025-11-27 03:51:38,721 - INFO - BGPaaS(35964170-8cab-42a8-8ea8-02d4015f27f1): verify_on_setup passed 2025-11-27 03:51:38,722 - INFO - We will configure BGP on the VM 2025-11-27 03:51:39,140 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:39,140 - INFO - Configuring BGP on ctest-TestBGPaasZone-31440575-67639060 2025-11-27 03:51:39,141 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.215.211.67; protocol bgp bgp_1{ local as 65000; neighbor 26.215.211.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.67; } protocol bfd { neighbor 26.215.211.65 local 26.215.211.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:51:39,141 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.215.211.67; protocol bgp bgp_1{ local as 65000; neighbor 26.215.211.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.67; } protocol bfd { neighbor 26.215.211.65 local 26.215.211.67 multihop on; } EOS 2025-11-27 03:51:52,065 - DEBUG - None 2025-11-27 03:51:52,065 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 26.215.211.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.67; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:51:52,065 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 26.215.211.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.67; } EOS 2025-11-27 03:51:53,119 - DEBUG - None 2025-11-27 03:51:53,119 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:51:53,119 - DEBUG - service bird restart 2025-11-27 03:51:56,553 - DEBUG - bird stop/waiting bird start/running, process 1429 2025-11-27 03:51:56,553 - INFO - Attaching VMI db40846e-bc4e-4c9a-af07-16bfb15458a6 to BGPaaS 35964170-8cab-42a8-8ea8-02d4015f27f1 2025-11-27 03:51:56,628 - INFO - Attaching the VMI b7d2b6ef-53f9-4be2-b54e-5e14c0e51772 to the BGPaaS 35964170-8cab-42a8-8ea8-02d4015f27f1 object 2025-11-27 03:51:56,628 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.215.211.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:51:56,628 - DEBUG - sudo ip addr add 26.215.211.84 dev eth0 2025-11-27 03:51:58,225 - DEBUG - None 2025-11-27 03:51:58,288 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31440575-25580883 2025-11-27 03:51:58,373 - INFO - BGPaaS: ctest-TestBGPaasZone-31440575-25580883(e837518b-7d38-4d7d-ae91-08e7c63e06cf) 2025-11-27 03:51:58,373 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/e837518b-7d38-4d7d-ae91-08e7c63e06cf 2025-11-27 03:51:58,384 - INFO - verify_in_api_server passed for BGPaaS obj e837518b-7d38-4d7d-ae91-08e7c63e06cf 2025-11-27 03:51:58,384 - INFO - BGPaaS(e837518b-7d38-4d7d-ae91-08e7c63e06cf): verify_on_setup passed 2025-11-27 03:51:58,384 - INFO - We will configure BGP on the VM 2025-11-27 03:51:58,804 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:51:58,804 - INFO - Configuring BGP on ctest-TestBGPaasZone-31440575-12976440 2025-11-27 03:51:58,804 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.215.211.68; protocol bgp bgp_1{ local as 65000; neighbor 26.215.211.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.68; } protocol bfd { neighbor 26.215.211.65 local 26.215.211.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:51:58,804 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.215.211.68; protocol bgp bgp_1{ local as 65000; neighbor 26.215.211.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.68; } protocol bfd { neighbor 26.215.211.65 local 26.215.211.68 multihop on; } EOS 2025-11-27 03:52:04,247 - DEBUG - None 2025-11-27 03:52:04,247 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 26.215.211.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.68; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:52:04,247 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 26.215.211.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.215.211.68; } EOS 2025-11-27 03:52:04,787 - DEBUG - None 2025-11-27 03:52:04,787 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:52:04,787 - DEBUG - service bird restart 2025-11-27 03:52:06,417 - DEBUG - bird stop/waiting bird start/running, process 1442 2025-11-27 03:52:06,417 - INFO - Attaching VMI fb0394f2-e585-4ee3-9c69-239554ae0171 to BGPaaS e837518b-7d38-4d7d-ae91-08e7c63e06cf 2025-11-27 03:52:06,484 - INFO - Attaching the VMI 93b7d004-511e-43e5-911d-661059231d09 to the BGPaaS e837518b-7d38-4d7d-ae91-08e7c63e06cf object 2025-11-27 03:52:06,484 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.215.211.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-11-27 03:52:06,485 - DEBUG - sudo ip addr add 26.215.211.84 dev eth0 2025-11-27 03:52:07,120 - DEBUG - None 2025-11-27 03:52:07,121 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:07,133 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-27 03:52:07,133 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:07,134 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:52:07,152 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-27 03:52:07,157 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:07,172 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-11-27 03:52:13,187 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-11-27 03:52:19,201 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-27 03:52:19,202 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:19,202 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:52:19,219 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-27 03:52:19,225 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.215.211.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:52:19,225 - DEBUG - ping -s 56 -c 3 -W 1 26.215.211.84 2025-11-27 03:52:25,547 - DEBUG - PING 26.215.211.84 (26.215.211.84) 56(84) bytes of data. 64 bytes from 26.215.211.84: icmp_seq=1 ttl=64 time=7.69 ms 64 bytes from 26.215.211.84: icmp_seq=2 ttl=64 time=1.12 ms 64 bytes from 26.215.211.84: icmp_seq=3 ttl=64 time=1.52 ms --- 26.215.211.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.124/3.447/7.690/3.004 ms 2025-11-27 03:52:25,547 - INFO - Ping to IP 26.215.211.84 from VM ctest-TestBGPaasZone-31440575-60456671 passed 2025-11-27 03:52:25,548 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:25,564 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-27 03:52:25,565 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:25,565 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:52:25,583 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-27 03:52:25,588 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:25,601 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-27 03:52:25,602 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-27 03:52:25,602 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-27 03:52:25,619 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-27 03:52:25,625 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.215.211.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-27 03:52:25,625 - DEBUG - ping -s 56 -c 3 -W 1 26.215.211.84 2025-11-27 03:52:28,098 - DEBUG - PING 26.215.211.84 (26.215.211.84) 56(84) bytes of data. 64 bytes from 26.215.211.84: icmp_seq=1 ttl=64 time=5.58 ms 64 bytes from 26.215.211.84: icmp_seq=2 ttl=64 time=0.810 ms 64 bytes from 26.215.211.84: icmp_seq=3 ttl=64 time=0.886 ms --- 26.215.211.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.810/2.427/5.585/2.233 ms 2025-11-27 03:52:28,098 - INFO - Ping to IP 26.215.211.84 from VM ctest-TestBGPaasZone-31440575-60456671 passed 2025-11-27 03:52:28,098 - INFO - Detaching VMI fb0394f2-e585-4ee3-9c69-239554ae0171 from BGPaaS e837518b-7d38-4d7d-ae91-08e7c63e06cf 2025-11-27 03:52:28,172 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31440575-25580883(e837518b-7d38-4d7d-ae91-08e7c63e06cf) 2025-11-27 03:52:28,233 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/e837518b-7d38-4d7d-ae91-08e7c63e06cf 2025-11-27 03:52:28,240 - DEBUG - Response Code: 404 2025-11-27 03:52:28,241 - DEBUG - BGPaaS: e837518b-7d38-4d7d-ae91-08e7c63e06cf deleted from api server 2025-11-27 03:52:28,241 - INFO - BGPaaS(e837518b-7d38-4d7d-ae91-08e7c63e06cf): verify_on_cleanup passed 2025-11-27 03:52:28,241 - INFO - Detaching VMI db40846e-bc4e-4c9a-af07-16bfb15458a6 from BGPaaS 35964170-8cab-42a8-8ea8-02d4015f27f1 2025-11-27 03:52:28,344 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31440575-56548312(35964170-8cab-42a8-8ea8-02d4015f27f1) 2025-11-27 03:52:28,415 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/35964170-8cab-42a8-8ea8-02d4015f27f1 2025-11-27 03:52:28,442 - DEBUG - Response Code: 404 2025-11-27 03:52:28,443 - DEBUG - BGPaaS: 35964170-8cab-42a8-8ea8-02d4015f27f1 deleted from api server 2025-11-27 03:52:28,443 - INFO - BGPaaS(35964170-8cab-42a8-8ea8-02d4015f27f1): verify_on_cleanup passed 2025-11-27 03:52:28,443 - INFO - Deleting Control node zone ctest-test-zone-33200372(a3c161f7-6ffc-489f-a4f6-e29dc069b650) 2025-11-27 03:52:28,582 - INFO - Deleting Control node zone ctest-test-zone-46087305(a01b466a-a15a-47d5-a960-84b7da9d3e87) 2025-11-27 03:52:28,721 - INFO - Deleting Control node zone ctest-test-zone-72180969(d7d19f24-7828-467f-969e-b8bd1f0cdbb6) 2025-11-27 03:52:28,854 - INFO - Deleting VM ctest-TestBGPaasZone-31440575-60456671 2025-11-27 03:52:28,933 - INFO - Deleting VM ctest-TestBGPaasZone-31440575-12976440 2025-11-27 03:52:29,001 - INFO - Deleting VM ctest-TestBGPaasZone-31440575-67639060 2025-11-27 03:52:29,076 - INFO - Deleting VN ctest-cnz_vn-55074640 2025-11-27 03:52:29,119 - DEBUG - VN f1d546f0-9796-45c9-9b18-ffa6e5a4fb1a still in use: Unable to complete operation on network f1d546f0-9796-45c9-9b18-ffa6e5a4fb1a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7353bb84-7896-4380-8741-69bb898e65ae'] 2025-11-27 03:52:29,119 - WARNING - Deleting VN ctest-cnz_vn-55074640 failed..Will retry 2025-11-27 03:52:31,345 - DEBUG - Response for deleting network () 2025-11-27 03:52:32,637 - DEBUG - Skipping xmpp flap check 2025-11-27 03:52:32,637 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:11] 2025-11-27 03:52:32,637 - INFO - -------------------------------------------------------------------------------- 2025-11-27 03:52:33,363 - INFO - Deleted project: ctest-TestBGPaasZone-31440575, ID : c3a6da30-7581-4594-bb0a-c312657da5e1