2025-08-14 03:40:08,558 - INFO - Domain Default found not creating 2025-08-14 03:40:08,693 - INFO - Project ctest-TestBGPaasZone-05752830 not found, creating it 2025-08-14 03:40:09,198 - INFO - Created Project:ctest-TestBGPaasZone-05752830, ID : b5d2a027-a4e6-44e6-b8e5-3f8310544415 2025-08-14 03:40:10,577 - DEBUG - Services list from nova: [, , , ] 2025-08-14 03:40:10,577 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3851-2', 'an-jenkins-deploy-platform-ansible-os-3851-1']} 2025-08-14 03:40:10,579 - INFO - ================================================================================ 2025-08-14 03:40:10,580 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-08-14 03:40:11,822 - DEBUG - Skipping xmpp flap check 2025-08-14 03:40:11,823 - INFO - Initial checks done. Running the testcase now 2025-08-14 03:40:11,823 - INFO - 2025-08-14 03:40:11,823 - INFO - executing bgp_control_zone test 2025-08-14 03:40:12,461 - DEBUG - Response for create_network : {'network': {'id': '2ab6eee5-10c6-44e1-94f4-6d90ee5c26d1', 'name': 'ctest-cnz_vn-82386727', 'tenant_id': 'b5d2a027a4e644e6b8e53f8310544415', 'project_id': 'b5d2a027a4e644e6b8e53f8310544415', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-05752830', 'ctest-cnz_vn-82386727'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:40:12,753 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bf2367c1-9272-4690-8e2a-d535c4cf415b', 'name': '', 'tenant_id': 'b5d2a027a4e644e6b8e53f8310544415', 'network_id': '2ab6eee5-10c6-44e1-94f4-6d90ee5c26d1', 'ip_version': 4, 'cidr': '37.110.20.192/26', 'allocation_pools': [{'start': '37.110.20.194', 'end': '37.110.20.254'}], 'gateway_ip': '37.110.20.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '37.110.20.194', 'tags': [], 'project_id': 'b5d2a027a4e644e6b8e53f8310544415'}} 2025-08-14 03:40:12,773 - INFO - Created VN ctest-cnz_vn-82386727 2025-08-14 03:40:12,785 - DEBUG - VN ctest-cnz_vn-82386727 UUID is 2ab6eee5-10c6-44e1-94f4-6d90ee5c26d1 2025-08-14 03:40:13,927 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2) 2025-08-14 03:40:15,189 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1) 2025-08-14 03:40:16,605 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2) 2025-08-14 03:40:16,605 - INFO - Waiting for VM ctest-TestBGPaasZone-05752830-42847380 to be up.. 2025-08-14 03:40:16,744 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-14 03:40:21,826 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-14 03:40:26,906 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-14 03:40:31,981 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-14 03:40:37,052 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-14 03:40:42,122 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-14 03:40:47,203 - DEBUG - VM is in ACTIVE state now 2025-08-14 03:40:47,203 - INFO - VM name : ctest-TestBGPaasZone-05752830-42847380 2025-08-14 03:40:47,271 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 ID is f2a51c2e-2675-442e-af05-183932dc68f8 2025-08-14 03:40:47,293 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 launched on Node an-jenkins-deploy-platform-ansible-os-3851-2 2025-08-14 03:40:47,363 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/f2a51c2e-2675-442e-af05-183932dc68f8 2025-08-14 03:40:47,652 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/f2a51c2e-2675-442e-af05-183932dc68f8 2025-08-14 03:40:47,682 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/2962a392-ad57-4b08-8cb1-392300d945ee 2025-08-14 03:40:50,858 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-14 03:40:50,858 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:40:50,872 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:40:54,953 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-14 03:40:54,953 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:40:54,968 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:40:59,050 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-14 03:40:59,050 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:40:59,065 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:03,150 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-14 03:41:03,151 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:03,167 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:07,245 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-14 03:41:07,245 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:07,261 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:11,341 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-08-14 03:41:11,341 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:11,355 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:15,441 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-08-14 03:41:15,441 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:15,455 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:19,529 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-14 03:41:19,529 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:19,543 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:23,633 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-14 03:41:23,633 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:23,648 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:27,720 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-14 03:41:27,720 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:27,735 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:31,827 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-14 03:41:31,827 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:31,842 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:35,919 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-08-14 03:41:35,919 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:35,935 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:40,018 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-14 03:41:40,018 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:40,036 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:44,114 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-08-14 03:41:44,114 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:44,129 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:48,202 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-14 03:41:48,202 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:48,216 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:52,297 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-14 03:41:52,297 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 failed! 2025-08-14 03:41:52,310 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-82386727 is 37.110.20.193 and allocation pool is NOT set 2025-08-14 03:41:54,371 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.38 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.377/3.140/3.904/0.763 ms') 2025-08-14 03:41:54,371 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-42847380 passed 2025-08-14 03:41:54,439 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:41:54,440 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:41:54,505 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:41:54,577 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:41:59,578 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:41:59,578 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:41:59,648 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:41:59,743 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:42:04,746 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:04,747 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:42:04,813 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:42:04,893 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:42:09,893 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:09,893 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:42:09,975 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:42:10,049 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:42:15,050 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:15,050 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:42:15,117 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:42:15,190 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:42:20,191 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:20,192 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:42:20,256 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:42:20,333 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:42:25,334 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:25,334 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:42:25,400 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:42:25,470 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:42:30,471 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:30,471 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:42:30,536 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:42:30,621 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:42:35,622 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:35,622 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-42847380, IP 37.110.20.195, Port 22 2025-08-14 03:42:35,793 - DEBUG - VM ctest-TestBGPaasZone-05752830-42847380 is ready for SSH connections 2025-08-14 03:42:35,793 - INFO - Waiting for VM ctest-TestBGPaasZone-05752830-02395613 to be up.. 2025-08-14 03:42:35,867 - DEBUG - VM is in ACTIVE state now 2025-08-14 03:42:35,867 - INFO - VM name : ctest-TestBGPaasZone-05752830-02395613 2025-08-14 03:42:35,936 - DEBUG - VM ctest-TestBGPaasZone-05752830-02395613 ID is 4116dad5-e9de-4542-938b-52dce6c39a4b 2025-08-14 03:42:35,936 - DEBUG - VM ctest-TestBGPaasZone-05752830-02395613 launched on Node an-jenkins-deploy-platform-ansible-os-3851-1 2025-08-14 03:42:36,005 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4116dad5-e9de-4542-938b-52dce6c39a4b 2025-08-14 03:42:36,017 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ac286613-d248-4abd-bb0a-be7d5b3d7795 2025-08-14 03:42:37,176 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.92 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.419 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.419/1.670/2.921/1.251 ms') 2025-08-14 03:42:37,176 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-02395613 passed 2025-08-14 03:42:37,248 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:37,248 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-02395613, IP 37.110.20.196, Port 22 2025-08-14 03:42:37,415 - DEBUG - VM ctest-TestBGPaasZone-05752830-02395613 is ready for SSH connections 2025-08-14 03:42:37,416 - INFO - Waiting for VM ctest-TestBGPaasZone-05752830-46459544 to be up.. 2025-08-14 03:42:37,486 - DEBUG - VM is in ACTIVE state now 2025-08-14 03:42:37,486 - INFO - VM name : ctest-TestBGPaasZone-05752830-46459544 2025-08-14 03:42:37,555 - DEBUG - VM ctest-TestBGPaasZone-05752830-46459544 ID is 6b69c083-4bb1-484b-ae13-bbfe495af985 2025-08-14 03:42:37,555 - DEBUG - VM ctest-TestBGPaasZone-05752830-46459544 launched on Node an-jenkins-deploy-platform-ansible-os-3851-2 2025-08-14 03:42:37,630 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6b69c083-4bb1-484b-ae13-bbfe495af985 2025-08-14 03:42:37,640 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/66643c6c-247e-4c11-bb3f-49aa0b07dd2a 2025-08-14 03:42:38,797 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.84 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.421 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.421/2.129/3.837/1.708 ms') 2025-08-14 03:42:38,797 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-05752830-46459544 passed 2025-08-14 03:42:38,869 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:38,869 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-46459544, IP 37.110.20.197, Port 22 2025-08-14 03:42:39,040 - DEBUG - VM ctest-TestBGPaasZone-05752830-46459544 is ready for SSH connections 2025-08-14 03:42:39,179 - INFO - Created control node zone ctest-test-zone-17757278(629f27ab-b51e-4c31-86c8-ba461559346f) 2025-08-14 03:42:39,531 - INFO - Created control node zone ctest-test-zone-73666165(c5eb5e04-6ef3-431f-8e31-702739892483) 2025-08-14 03:42:39,892 - INFO - Created control node zone ctest-test-zone-85294258(e0ff2aa9-d00a-454c-9c8a-158e0ed24c96) 2025-08-14 03:42:40,179 - INFO - Creating BGPaaS ctest-TestBGPaasZone-05752830-43704615 2025-08-14 03:42:40,252 - INFO - BGPaaS: ctest-TestBGPaasZone-05752830-43704615(873faece-b2ac-4c91-b379-8908471c8d50) 2025-08-14 03:42:40,252 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:42:40,551 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:42:40,582 - INFO - verify_in_api_server passed for BGPaaS obj 873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:42:40,582 - INFO - BGPaaS(873faece-b2ac-4c91-b379-8908471c8d50): verify_on_setup passed 2025-08-14 03:42:40,582 - INFO - We will configure BGP on the VM 2025-08-14 03:42:40,831 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:40,832 - INFO - Configuring BGP on ctest-TestBGPaasZone-05752830-42847380 2025-08-14 03:42:40,832 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:42:40,832 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS 2025-08-14 03:42:53,320 - DEBUG - None 2025-08-14 03:42:53,320 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:42:53,320 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS 2025-08-14 03:42:54,223 - DEBUG - None 2025-08-14 03:42:54,223 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:42:54,223 - DEBUG - service bird restart 2025-08-14 03:42:56,963 - DEBUG - bird stop/waiting bird start/running, process 1437 2025-08-14 03:42:56,963 - INFO - Attaching VMI 2962a392-ad57-4b08-8cb1-392300d945ee to BGPaaS 873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:42:57,038 - INFO - Attaching the VMI f2a51c2e-2675-442e-af05-183932dc68f8 to the BGPaaS 873faece-b2ac-4c91-b379-8908471c8d50 object 2025-08-14 03:42:57,039 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 37.110.20.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:42:57,039 - DEBUG - sudo ip addr add 37.110.20.212 dev eth0 2025-08-14 03:42:58,283 - DEBUG - None 2025-08-14 03:42:58,348 - INFO - Creating BGPaaS ctest-TestBGPaasZone-05752830-24412003 2025-08-14 03:42:58,428 - INFO - BGPaaS: ctest-TestBGPaasZone-05752830-24412003(181b3601-1acd-4d7f-bc43-82008d151eec) 2025-08-14 03:42:58,428 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/181b3601-1acd-4d7f-bc43-82008d151eec 2025-08-14 03:42:58,442 - INFO - verify_in_api_server passed for BGPaaS obj 181b3601-1acd-4d7f-bc43-82008d151eec 2025-08-14 03:42:58,442 - INFO - BGPaaS(181b3601-1acd-4d7f-bc43-82008d151eec): verify_on_setup passed 2025-08-14 03:42:58,443 - INFO - We will configure BGP on the VM 2025-08-14 03:42:58,692 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:42:58,692 - INFO - Configuring BGP on ctest-TestBGPaasZone-05752830-02395613 2025-08-14 03:42:58,692 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.196; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.196; } protocol bfd { neighbor 37.110.20.194 local 37.110.20.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:42:58,692 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.196; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.196; } protocol bfd { neighbor 37.110.20.194 local 37.110.20.196 multihop on; } EOS 2025-08-14 03:43:03,802 - DEBUG - None 2025-08-14 03:43:03,802 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.196; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.196; } protocol bfd { neighbor 37.110.20.194 local 37.110.20.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:43:03,802 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.196; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.196; } protocol bfd { neighbor 37.110.20.194 local 37.110.20.196 multihop on; } EOS 2025-08-14 03:43:04,269 - DEBUG - None 2025-08-14 03:43:04,269 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:43:04,269 - DEBUG - service bird restart 2025-08-14 03:43:05,854 - DEBUG - bird stop/waiting bird start/running, process 1443 2025-08-14 03:43:05,855 - INFO - Attaching VMI ac286613-d248-4abd-bb0a-be7d5b3d7795 to BGPaaS 181b3601-1acd-4d7f-bc43-82008d151eec 2025-08-14 03:43:05,927 - INFO - Attaching the VMI 4116dad5-e9de-4542-938b-52dce6c39a4b to the BGPaaS 181b3601-1acd-4d7f-bc43-82008d151eec object 2025-08-14 03:43:05,928 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 37.110.20.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:43:05,928 - DEBUG - sudo ip addr add 37.110.20.212 dev eth0 2025-08-14 03:43:06,541 - DEBUG - None 2025-08-14 03:43:06,541 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:43:06,541 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:43:06,564 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-14 03:43:12,566 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:43:12,580 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-14 03:43:12,586 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:43:12,605 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-08-14 03:43:18,623 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-14 03:43:18,629 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 37.110.20.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:18,629 - DEBUG - ping -s 56 -c 3 -W 1 37.110.20.212 2025-08-14 03:43:24,008 - DEBUG - PING 37.110.20.212 (37.110.20.212) 56(84) bytes of data. 64 bytes from 37.110.20.212: icmp_seq=1 ttl=64 time=6.74 ms 64 bytes from 37.110.20.212: icmp_seq=2 ttl=64 time=1.08 ms 64 bytes from 37.110.20.212: icmp_seq=3 ttl=64 time=1.01 ms --- 37.110.20.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.010/2.947/6.749/2.688 ms 2025-08-14 03:43:24,008 - INFO - Ping to IP 37.110.20.212 from VM ctest-TestBGPaasZone-05752830-46459544 passed 2025-08-14 03:43:24,815 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:24,816 - DEBUG - service bird restart 2025-08-14 03:43:26,248 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-08-14 03:43:26,248 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:43:26,249 - DEBUG - service bird restart 2025-08-14 03:43:27,894 - DEBUG - bird stop/waiting bird start/running, process 1470 2025-08-14 03:43:27,895 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:43:27,912 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-08-14 03:43:33,929 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-08-14 03:43:33,935 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:43:33,952 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-08-14 03:43:39,970 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-14 03:43:39,976 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 37.110.20.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:39,976 - DEBUG - ping -s 56 -c 3 -W 1 37.110.20.212 2025-08-14 03:43:42,415 - DEBUG - PING 37.110.20.212 (37.110.20.212) 56(84) bytes of data. 64 bytes from 37.110.20.212: icmp_seq=1 ttl=64 time=5.29 ms 64 bytes from 37.110.20.212: icmp_seq=2 ttl=64 time=1.22 ms 64 bytes from 37.110.20.212: icmp_seq=3 ttl=64 time=1.15 ms --- 37.110.20.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.156/2.559/5.295/1.935 ms 2025-08-14 03:43:42,416 - INFO - Ping to IP 37.110.20.212 from VM ctest-TestBGPaasZone-05752830-46459544 passed 2025-08-14 03:43:42,735 - INFO - We will configure BGP on the VM 2025-08-14 03:43:42,944 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:43:42,944 - INFO - Configuring BGP on ctest-TestBGPaasZone-05752830-42847380 2025-08-14 03:43:42,944 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:42,944 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS 2025-08-14 03:43:43,392 - DEBUG - None 2025-08-14 03:43:43,393 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:43,393 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 37.110.20.195; protocol bgp bgp_1{ local as 65000; neighbor 37.110.20.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 37.110.20.195; } protocol bfd { neighbor 37.110.20.193 local 37.110.20.195 multihop on; } EOS 2025-08-14 03:43:43,839 - DEBUG - None 2025-08-14 03:43:43,839 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:43,839 - DEBUG - service bird restart 2025-08-14 03:43:45,323 - DEBUG - bird stop/waiting bird start/running, process 1501 2025-08-14 03:43:45,323 - INFO - Attaching VMI 2962a392-ad57-4b08-8cb1-392300d945ee to BGPaaS 873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:43:45,342 - INFO - Attaching the VMI f2a51c2e-2675-442e-af05-183932dc68f8 to the BGPaaS 873faece-b2ac-4c91-b379-8908471c8d50 object 2025-08-14 03:43:45,342 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 37.110.20.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:45,342 - DEBUG - sudo ip addr add 37.110.20.212 dev eth0 2025-08-14 03:43:46,009 - DEBUG - RTNETLINK answers: File exists 2025-08-14 03:43:46,009 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:43:46,009 - DEBUG - service bird restart 2025-08-14 03:43:47,488 - DEBUG - bird stop/waiting bird start/running, process 1528 2025-08-14 03:43:47,488 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:43:47,488 - DEBUG - service bird restart 2025-08-14 03:43:49,021 - DEBUG - bird stop/waiting bird start/running, process 1492 2025-08-14 03:43:49,021 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:43:49,021 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:43:49,036 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-14 03:43:55,037 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:43:55,052 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-14 03:43:55,058 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:43:55,075 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-08-14 03:44:01,095 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-14 03:44:01,102 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 37.110.20.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:44:01,102 - DEBUG - ping -s 56 -c 3 -W 1 37.110.20.212 2025-08-14 03:44:03,547 - DEBUG - PING 37.110.20.212 (37.110.20.212) 56(84) bytes of data. 64 bytes from 37.110.20.212: icmp_seq=1 ttl=64 time=2.38 ms 64 bytes from 37.110.20.212: icmp_seq=2 ttl=64 time=1.09 ms 64 bytes from 37.110.20.212: icmp_seq=3 ttl=64 time=0.990 ms --- 37.110.20.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.990/1.487/2.380/0.632 ms 2025-08-14 03:44:03,548 - INFO - Ping to IP 37.110.20.212 from VM ctest-TestBGPaasZone-05752830-46459544 passed 2025-08-14 03:44:03,548 - INFO - Detaching VMI 2962a392-ad57-4b08-8cb1-392300d945ee from BGPaaS 873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:44:03,628 - INFO - Detaching VMI ac286613-d248-4abd-bb0a-be7d5b3d7795 from BGPaaS 181b3601-1acd-4d7f-bc43-82008d151eec 2025-08-14 03:44:03,731 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-05752830-24412003(181b3601-1acd-4d7f-bc43-82008d151eec) 2025-08-14 03:44:03,821 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/181b3601-1acd-4d7f-bc43-82008d151eec 2025-08-14 03:44:03,827 - DEBUG - Response Code: 404 2025-08-14 03:44:03,828 - DEBUG - BGPaaS: 181b3601-1acd-4d7f-bc43-82008d151eec deleted from api server 2025-08-14 03:44:03,828 - INFO - BGPaaS(181b3601-1acd-4d7f-bc43-82008d151eec): verify_on_cleanup passed 2025-08-14 03:44:03,828 - INFO - Detaching VMI 2962a392-ad57-4b08-8cb1-392300d945ee from BGPaaS 873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:44:03,874 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-05752830-43704615(873faece-b2ac-4c91-b379-8908471c8d50) 2025-08-14 03:44:03,958 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/873faece-b2ac-4c91-b379-8908471c8d50 2025-08-14 03:44:03,965 - DEBUG - Response Code: 404 2025-08-14 03:44:03,965 - DEBUG - BGPaaS: 873faece-b2ac-4c91-b379-8908471c8d50 deleted from api server 2025-08-14 03:44:03,965 - INFO - BGPaaS(873faece-b2ac-4c91-b379-8908471c8d50): verify_on_cleanup passed 2025-08-14 03:44:03,965 - INFO - Deleting Control node zone ctest-test-zone-85294258(e0ff2aa9-d00a-454c-9c8a-158e0ed24c96) 2025-08-14 03:44:04,122 - INFO - Deleting Control node zone ctest-test-zone-73666165(c5eb5e04-6ef3-431f-8e31-702739892483) 2025-08-14 03:44:04,277 - INFO - Deleting Control node zone ctest-test-zone-17757278(629f27ab-b51e-4c31-86c8-ba461559346f) 2025-08-14 03:44:04,366 - INFO - Deleting VM ctest-TestBGPaasZone-05752830-46459544 2025-08-14 03:44:04,438 - INFO - Deleting VM ctest-TestBGPaasZone-05752830-02395613 2025-08-14 03:44:04,509 - INFO - Deleting VM ctest-TestBGPaasZone-05752830-42847380 2025-08-14 03:44:04,586 - INFO - Deleting VN ctest-cnz_vn-82386727 2025-08-14 03:44:04,626 - DEBUG - VN 2ab6eee5-10c6-44e1-94f4-6d90ee5c26d1 still in use: Unable to complete operation on network 2ab6eee5-10c6-44e1-94f4-6d90ee5c26d1. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-fd6293cd-a21a-4907-a195-c0a47e52f9c8'] 2025-08-14 03:44:04,626 - WARNING - Deleting VN ctest-cnz_vn-82386727 failed..Will retry 2025-08-14 03:44:07,147 - DEBUG - Response for deleting network () 2025-08-14 03:44:08,411 - DEBUG - Skipping xmpp flap check 2025-08-14 03:44:08,411 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:03:58] 2025-08-14 03:44:08,411 - INFO - -------------------------------------------------------------------------------- 2025-08-14 03:44:08,414 - INFO - ================================================================================ 2025-08-14 03:44:08,414 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-08-14 03:44:09,690 - DEBUG - Skipping xmpp flap check 2025-08-14 03:44:09,690 - INFO - Initial checks done. Running the testcase now 2025-08-14 03:44:09,690 - INFO - 2025-08-14 03:44:09,690 - INFO - executing bgp_control_zone agent restart test 2025-08-14 03:44:10,000 - DEBUG - Response for create_network : {'network': {'id': '6724287c-5e85-44ac-8fe4-d5f120fc7593', 'name': 'ctest-cnz_vn-02439740', 'tenant_id': 'b5d2a027a4e644e6b8e53f8310544415', 'project_id': 'b5d2a027a4e644e6b8e53f8310544415', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-05752830', 'ctest-cnz_vn-02439740'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:44:10,270 - DEBUG - Response for create_subnet : {'subnet': {'id': '932547d3-0815-4e26-96c5-7415a3ffd251', 'name': '', 'tenant_id': 'b5d2a027a4e644e6b8e53f8310544415', 'network_id': '6724287c-5e85-44ac-8fe4-d5f120fc7593', 'ip_version': 4, 'cidr': '1.102.79.128/26', 'allocation_pools': [{'start': '1.102.79.130', 'end': '1.102.79.190'}], 'gateway_ip': '1.102.79.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '1.102.79.130', 'tags': [], 'project_id': 'b5d2a027a4e644e6b8e53f8310544415'}} 2025-08-14 03:44:10,292 - INFO - Created VN ctest-cnz_vn-02439740 2025-08-14 03:44:10,305 - DEBUG - VN ctest-cnz_vn-02439740 UUID is 6724287c-5e85-44ac-8fe4-d5f120fc7593 2025-08-14 03:44:11,490 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1) 2025-08-14 03:44:12,792 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2) 2025-08-14 03:44:14,137 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1) 2025-08-14 03:44:14,137 - INFO - Waiting for VM ctest-TestBGPaasZone-05752830-27150868 to be up.. 2025-08-14 03:44:14,214 - DEBUG - VM is in ACTIVE state now 2025-08-14 03:44:14,214 - INFO - VM name : ctest-TestBGPaasZone-05752830-27150868 2025-08-14 03:44:14,295 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 ID is 9b473166-525f-4588-aaf6-b69b70fd424d 2025-08-14 03:44:14,296 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 launched on Node an-jenkins-deploy-platform-ansible-os-3851-1 2025-08-14 03:44:14,374 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/9b473166-525f-4588-aaf6-b69b70fd424d 2025-08-14 03:44:14,385 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/dc426599-5c23-4373-88ca-ae54941aa9cf 2025-08-14 03:44:17,589 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-14 03:44:17,589 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:17,603 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:21,677 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-14 03:44:21,677 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:21,692 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:25,778 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-14 03:44:25,779 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:25,793 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:29,868 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-08-14 03:44:29,868 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:29,885 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:33,964 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-14 03:44:33,964 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:33,979 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:38,062 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-14 03:44:38,062 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:38,078 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:42,156 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-14 03:44:42,156 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:42,180 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:46,253 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-14 03:44:46,253 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:46,269 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:50,355 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-14 03:44:50,355 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:50,371 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:54,443 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-14 03:44:54,443 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:54,459 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:44:58,546 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-14 03:44:58,546 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:44:58,561 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:45:02,637 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-14 03:45:02,637 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:45:02,652 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:45:06,738 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-14 03:45:06,738 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:45:06,758 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:45:10,838 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-14 03:45:10,838 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:45:10,853 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:45:14,928 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-14 03:45:14,928 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:45:14,962 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:45:19,024 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-08-14 03:45:19,024 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 failed! 2025-08-14 03:45:19,041 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-05752830:ctest-cnz_vn-02439740 is 1.102.79.129 and allocation pool is NOT set 2025-08-14 03:45:21,107 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.15 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.624 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.624/2.889/5.154/2.265 ms') 2025-08-14 03:45:21,107 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-27150868 passed 2025-08-14 03:45:21,183 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:21,183 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:21,252 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:21,392 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:45:26,393 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:26,393 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:26,460 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:26,555 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:45:31,556 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:31,556 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:31,624 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:31,701 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:45:36,702 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:36,702 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:36,768 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:36,844 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:45:41,845 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:41,845 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:41,917 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:41,998 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:45:47,000 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:47,000 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:47,057 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:47,130 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:45:52,131 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:52,132 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:52,204 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:52,283 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:45:57,283 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:45:57,284 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:45:57,356 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:45:57,438 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:46:02,438 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:02,439 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:46:02,498 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:46:02,574 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:46:07,575 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:07,575 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-27150868, IP 1.102.79.131, Port 22 2025-08-14 03:46:07,733 - DEBUG - VM ctest-TestBGPaasZone-05752830-27150868 is ready for SSH connections 2025-08-14 03:46:07,733 - INFO - Waiting for VM ctest-TestBGPaasZone-05752830-10741962 to be up.. 2025-08-14 03:46:07,813 - DEBUG - VM is in ACTIVE state now 2025-08-14 03:46:07,813 - INFO - VM name : ctest-TestBGPaasZone-05752830-10741962 2025-08-14 03:46:07,898 - DEBUG - VM ctest-TestBGPaasZone-05752830-10741962 ID is 55d5782e-aee5-49ea-adc0-9d5a6e2b0659 2025-08-14 03:46:07,898 - DEBUG - VM ctest-TestBGPaasZone-05752830-10741962 launched on Node an-jenkins-deploy-platform-ansible-os-3851-2 2025-08-14 03:46:07,970 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/55d5782e-aee5-49ea-adc0-9d5a6e2b0659 2025-08-14 03:46:08,022 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ded17aea-51d9-4cd8-beb0-7e2fc7be880a 2025-08-14 03:46:09,190 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.53 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.487 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.487/1.507/2.527/1.020 ms') 2025-08-14 03:46:09,190 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-05752830-10741962 passed 2025-08-14 03:46:09,260 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:09,260 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-10741962, IP 1.102.79.132, Port 22 2025-08-14 03:46:09,424 - DEBUG - VM ctest-TestBGPaasZone-05752830-10741962 is ready for SSH connections 2025-08-14 03:46:09,425 - INFO - Waiting for VM ctest-TestBGPaasZone-05752830-90954517 to be up.. 2025-08-14 03:46:09,497 - DEBUG - VM is in ACTIVE state now 2025-08-14 03:46:09,497 - INFO - VM name : ctest-TestBGPaasZone-05752830-90954517 2025-08-14 03:46:09,566 - DEBUG - VM ctest-TestBGPaasZone-05752830-90954517 ID is e87c9f75-b9ef-42ec-b5fb-950c1994434f 2025-08-14 03:46:09,566 - DEBUG - VM ctest-TestBGPaasZone-05752830-90954517 launched on Node an-jenkins-deploy-platform-ansible-os-3851-1 2025-08-14 03:46:09,642 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e87c9f75-b9ef-42ec-b5fb-950c1994434f 2025-08-14 03:46:09,652 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/f10d60bd-6985-4e45-8962-304f5ca68203 2025-08-14 03:46:10,823 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.38 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=4.88 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.384/3.631/4.878/1.247 ms') 2025-08-14 03:46:10,823 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-05752830-90954517 passed 2025-08-14 03:46:10,896 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:10,896 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-90954517, IP 1.102.79.133, Port 22 2025-08-14 03:46:10,964 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 03:46:11,035 - DEBUG - VM ctest-TestBGPaasZone-05752830-90954517 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 03:46:16,037 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:16,037 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-05752830-90954517, IP 1.102.79.133, Port 22 2025-08-14 03:46:16,204 - DEBUG - VM ctest-TestBGPaasZone-05752830-90954517 is ready for SSH connections 2025-08-14 03:46:16,332 - INFO - Created control node zone ctest-test-zone-57345815(27ec6f69-79c3-4f3d-9ed2-5a0ed4e95129) 2025-08-14 03:46:16,683 - INFO - Created control node zone ctest-test-zone-08700982(741c9c21-9660-4c24-a01a-ffdcbd90fafa) 2025-08-14 03:46:17,031 - INFO - Created control node zone ctest-test-zone-61540094(65a142f4-9ddc-462c-bdab-4b38ca128588) 2025-08-14 03:46:17,307 - INFO - Creating BGPaaS ctest-TestBGPaasZone-05752830-00726542 2025-08-14 03:46:17,380 - INFO - BGPaaS: ctest-TestBGPaasZone-05752830-00726542(ee26ac9a-578a-4171-9ee1-1aa2134fceed) 2025-08-14 03:46:17,380 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/ee26ac9a-578a-4171-9ee1-1aa2134fceed 2025-08-14 03:46:17,390 - INFO - verify_in_api_server passed for BGPaaS obj ee26ac9a-578a-4171-9ee1-1aa2134fceed 2025-08-14 03:46:17,390 - INFO - BGPaaS(ee26ac9a-578a-4171-9ee1-1aa2134fceed): verify_on_setup passed 2025-08-14 03:46:17,390 - INFO - We will configure BGP on the VM 2025-08-14 03:46:17,791 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:17,792 - INFO - Configuring BGP on ctest-TestBGPaasZone-05752830-27150868 2025-08-14 03:46:17,792 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 1.102.79.131; protocol bgp bgp_1{ local as 65000; neighbor 1.102.79.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.131; } protocol bfd { neighbor 1.102.79.129 local 1.102.79.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:46:17,792 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 1.102.79.131; protocol bgp bgp_1{ local as 65000; neighbor 1.102.79.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.131; } protocol bfd { neighbor 1.102.79.129 local 1.102.79.131 multihop on; } EOS 2025-08-14 03:46:24,205 - DEBUG - None 2025-08-14 03:46:24,205 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 1.102.79.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.131; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:46:24,205 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 1.102.79.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.131; } EOS 2025-08-14 03:46:24,718 - DEBUG - None 2025-08-14 03:46:24,718 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:46:24,718 - DEBUG - service bird restart 2025-08-14 03:46:26,421 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-08-14 03:46:26,421 - INFO - Attaching VMI dc426599-5c23-4373-88ca-ae54941aa9cf to BGPaaS ee26ac9a-578a-4171-9ee1-1aa2134fceed 2025-08-14 03:46:26,500 - INFO - Attaching the VMI 9b473166-525f-4588-aaf6-b69b70fd424d to the BGPaaS ee26ac9a-578a-4171-9ee1-1aa2134fceed object 2025-08-14 03:46:26,500 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 1.102.79.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:46:26,500 - DEBUG - sudo ip addr add 1.102.79.148 dev eth0 2025-08-14 03:46:27,142 - DEBUG - None 2025-08-14 03:46:27,207 - INFO - Creating BGPaaS ctest-TestBGPaasZone-05752830-21604448 2025-08-14 03:46:27,292 - INFO - BGPaaS: ctest-TestBGPaasZone-05752830-21604448(19559e72-ad0f-45e3-9407-7bd6e5956a62) 2025-08-14 03:46:27,292 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/19559e72-ad0f-45e3-9407-7bd6e5956a62 2025-08-14 03:46:27,303 - INFO - verify_in_api_server passed for BGPaaS obj 19559e72-ad0f-45e3-9407-7bd6e5956a62 2025-08-14 03:46:27,303 - INFO - BGPaaS(19559e72-ad0f-45e3-9407-7bd6e5956a62): verify_on_setup passed 2025-08-14 03:46:27,303 - INFO - We will configure BGP on the VM 2025-08-14 03:46:27,724 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:27,724 - INFO - Configuring BGP on ctest-TestBGPaasZone-05752830-10741962 2025-08-14 03:46:27,724 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 1.102.79.132; protocol bgp bgp_1{ local as 65000; neighbor 1.102.79.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.132; } protocol bfd { neighbor 1.102.79.129 local 1.102.79.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:46:27,724 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 1.102.79.132; protocol bgp bgp_1{ local as 65000; neighbor 1.102.79.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.132; } protocol bfd { neighbor 1.102.79.129 local 1.102.79.132 multihop on; } EOS 2025-08-14 03:46:32,700 - DEBUG - None 2025-08-14 03:46:32,700 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 1.102.79.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.132; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:46:32,700 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 1.102.79.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 1.102.79.132; } EOS 2025-08-14 03:46:33,144 - DEBUG - None 2025-08-14 03:46:33,144 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:46:33,144 - DEBUG - service bird restart 2025-08-14 03:46:34,634 - DEBUG - bird stop/waiting bird start/running, process 1481 2025-08-14 03:46:34,634 - INFO - Attaching VMI ded17aea-51d9-4cd8-beb0-7e2fc7be880a to BGPaaS 19559e72-ad0f-45e3-9407-7bd6e5956a62 2025-08-14 03:46:34,715 - INFO - Attaching the VMI 55d5782e-aee5-49ea-adc0-9d5a6e2b0659 to the BGPaaS 19559e72-ad0f-45e3-9407-7bd6e5956a62 object 2025-08-14 03:46:34,716 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 1.102.79.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 03:46:34,716 - DEBUG - sudo ip addr add 1.102.79.148 dev eth0 2025-08-14 03:46:35,326 - DEBUG - None 2025-08-14 03:46:35,326 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:35,326 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:46:35,339 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-14 03:46:35,339 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:35,356 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-14 03:46:35,363 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:35,363 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:46:35,376 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-14 03:46:41,377 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:46:41,394 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-14 03:46:47,395 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:46:47,408 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-14 03:46:47,409 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:47,425 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-14 03:46:47,435 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 1.102.79.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:46:47,435 - DEBUG - ping -s 56 -c 3 -W 1 1.102.79.148 2025-08-14 03:46:53,533 - DEBUG - PING 1.102.79.148 (1.102.79.148) 56(84) bytes of data. 64 bytes from 1.102.79.148: icmp_seq=1 ttl=64 time=7.03 ms 64 bytes from 1.102.79.148: icmp_seq=2 ttl=64 time=0.882 ms 64 bytes from 1.102.79.148: icmp_seq=3 ttl=64 time=0.926 ms --- 1.102.79.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.882/2.947/7.034/2.890 ms 2025-08-14 03:46:53,533 - INFO - Ping to IP 1.102.79.148 from VM ctest-TestBGPaasZone-05752830-90954517 passed 2025-08-14 03:46:53,533 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:53,533 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:46:53,545 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-14 03:46:53,546 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:53,561 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-14 03:46:53,568 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:53,568 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-14 03:46:53,581 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-14 03:46:53,581 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 03:46:53,599 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-14 03:46:53,607 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 1.102.79.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-14 03:46:53,607 - DEBUG - ping -s 56 -c 3 -W 1 1.102.79.148 2025-08-14 03:46:56,077 - DEBUG - PING 1.102.79.148 (1.102.79.148) 56(84) bytes of data. 64 bytes from 1.102.79.148: icmp_seq=1 ttl=64 time=2.05 ms 64 bytes from 1.102.79.148: icmp_seq=2 ttl=64 time=0.816 ms 64 bytes from 1.102.79.148: icmp_seq=3 ttl=64 time=0.728 ms --- 1.102.79.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.728/1.199/2.053/0.604 ms 2025-08-14 03:46:56,077 - INFO - Ping to IP 1.102.79.148 from VM ctest-TestBGPaasZone-05752830-90954517 passed 2025-08-14 03:46:56,077 - INFO - Detaching VMI ded17aea-51d9-4cd8-beb0-7e2fc7be880a from BGPaaS 19559e72-ad0f-45e3-9407-7bd6e5956a62 2025-08-14 03:46:56,160 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-05752830-21604448(19559e72-ad0f-45e3-9407-7bd6e5956a62) 2025-08-14 03:46:56,226 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/19559e72-ad0f-45e3-9407-7bd6e5956a62 2025-08-14 03:46:56,250 - DEBUG - Response Code: 404 2025-08-14 03:46:56,250 - DEBUG - BGPaaS: 19559e72-ad0f-45e3-9407-7bd6e5956a62 deleted from api server 2025-08-14 03:46:56,250 - INFO - BGPaaS(19559e72-ad0f-45e3-9407-7bd6e5956a62): verify_on_cleanup passed 2025-08-14 03:46:56,251 - INFO - Detaching VMI dc426599-5c23-4373-88ca-ae54941aa9cf from BGPaaS ee26ac9a-578a-4171-9ee1-1aa2134fceed 2025-08-14 03:46:56,332 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-05752830-00726542(ee26ac9a-578a-4171-9ee1-1aa2134fceed) 2025-08-14 03:46:56,401 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/ee26ac9a-578a-4171-9ee1-1aa2134fceed 2025-08-14 03:46:56,409 - DEBUG - Response Code: 404 2025-08-14 03:46:56,412 - DEBUG - BGPaaS: ee26ac9a-578a-4171-9ee1-1aa2134fceed deleted from api server 2025-08-14 03:46:56,412 - INFO - BGPaaS(ee26ac9a-578a-4171-9ee1-1aa2134fceed): verify_on_cleanup passed 2025-08-14 03:46:56,413 - INFO - Deleting Control node zone ctest-test-zone-61540094(65a142f4-9ddc-462c-bdab-4b38ca128588) 2025-08-14 03:46:56,575 - INFO - Deleting Control node zone ctest-test-zone-08700982(741c9c21-9660-4c24-a01a-ffdcbd90fafa) 2025-08-14 03:46:56,724 - INFO - Deleting Control node zone ctest-test-zone-57345815(27ec6f69-79c3-4f3d-9ed2-5a0ed4e95129) 2025-08-14 03:46:56,869 - INFO - Deleting VM ctest-TestBGPaasZone-05752830-90954517 2025-08-14 03:46:56,938 - INFO - Deleting VM ctest-TestBGPaasZone-05752830-10741962 2025-08-14 03:46:57,001 - INFO - Deleting VM ctest-TestBGPaasZone-05752830-27150868 2025-08-14 03:46:57,067 - INFO - Deleting VN ctest-cnz_vn-02439740 2025-08-14 03:46:57,112 - DEBUG - VN 6724287c-5e85-44ac-8fe4-d5f120fc7593 still in use: Unable to complete operation on network 6724287c-5e85-44ac-8fe4-d5f120fc7593. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-421b7334-32f2-4661-a4c4-cfe37e8d3063'] 2025-08-14 03:46:57,112 - WARNING - Deleting VN ctest-cnz_vn-02439740 failed..Will retry 2025-08-14 03:46:59,297 - DEBUG - Response for deleting network () 2025-08-14 03:47:00,544 - DEBUG - Skipping xmpp flap check 2025-08-14 03:47:00,544 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:52] 2025-08-14 03:47:00,544 - INFO - -------------------------------------------------------------------------------- 2025-08-14 03:47:01,256 - INFO - Deleted project: ctest-TestBGPaasZone-05752830, ID : b5d2a027-a4e6-44e6-b8e5-3f8310544415