2025-09-04 03:51:12,307 - INFO - Domain Default found not creating 2025-09-04 03:51:12,452 - INFO - Project ctest-TestBGPaasZone-64699584 not found, creating it 2025-09-04 03:51:13,021 - INFO - Created Project:ctest-TestBGPaasZone-64699584, ID : f792e1a5-de38-4abb-bf82-39319e087f90 2025-09-04 03:51:14,476 - DEBUG - Services list from nova: [, , , ] 2025-09-04 03:51:14,476 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4012-1', 'an-jenkins-deploy-platform-ansible-os-4012-2']} 2025-09-04 03:51:14,479 - INFO - ================================================================================ 2025-09-04 03:51:14,479 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-09-04 03:51:15,741 - DEBUG - Skipping xmpp flap check 2025-09-04 03:51:15,741 - INFO - Initial checks done. Running the testcase now 2025-09-04 03:51:15,741 - INFO - 2025-09-04 03:51:15,741 - INFO - executing bgp_control_zone test 2025-09-04 03:51:16,396 - DEBUG - Response for create_network : {'network': {'id': 'dc150f0d-49d2-43d2-ac5e-5b9dafab8a05', 'name': 'ctest-cnz_vn-62472562', 'tenant_id': 'f792e1a5de384abbbf8239319e087f90', 'project_id': 'f792e1a5de384abbbf8239319e087f90', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-64699584', 'ctest-cnz_vn-62472562'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:51:16,671 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fbf9732a-5afa-4195-8800-78f1ee8698bc', 'name': '', 'tenant_id': 'f792e1a5de384abbbf8239319e087f90', 'network_id': 'dc150f0d-49d2-43d2-ac5e-5b9dafab8a05', 'ip_version': 4, 'cidr': '77.77.178.192/26', 'allocation_pools': [{'start': '77.77.178.194', 'end': '77.77.178.254'}], 'gateway_ip': '77.77.178.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '77.77.178.194', 'tags': [], 'project_id': 'f792e1a5de384abbbf8239319e087f90'}} 2025-09-04 03:51:16,698 - INFO - Created VN ctest-cnz_vn-62472562 2025-09-04 03:51:16,714 - DEBUG - VN ctest-cnz_vn-62472562 UUID is dc150f0d-49d2-43d2-ac5e-5b9dafab8a05 2025-09-04 03:51:17,897 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-1) 2025-09-04 03:51:19,295 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-2) 2025-09-04 03:51:21,089 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-1) 2025-09-04 03:51:21,089 - INFO - Waiting for VM ctest-TestBGPaasZone-64699584-84325977 to be up.. 2025-09-04 03:51:21,197 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-04 03:51:26,324 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-04 03:51:31,420 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-04 03:51:36,504 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-04 03:51:41,595 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-04 03:51:46,680 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-04 03:51:51,779 - DEBUG - VM is in ACTIVE state now 2025-09-04 03:51:51,779 - INFO - VM name : ctest-TestBGPaasZone-64699584-84325977 2025-09-04 03:51:51,893 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 ID is 6b7418e1-0216-4d63-a851-56f8020284f2 2025-09-04 03:51:51,926 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 launched on Node an-jenkins-deploy-platform-ansible-os-4012-1 2025-09-04 03:51:52,031 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/6b7418e1-0216-4d63-a851-56f8020284f2 2025-09-04 03:51:52,329 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/6b7418e1-0216-4d63-a851-56f8020284f2 2025-09-04 03:51:52,367 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/6b2324cb-3fbf-464c-8281-228ecb23f261 2025-09-04 03:51:55,560 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-09-04 03:51:55,560 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:51:55,572 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:51:59,659 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-09-04 03:51:59,659 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:51:59,673 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:03,757 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-09-04 03:52:03,757 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:03,772 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:07,847 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-09-04 03:52:07,847 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:07,863 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:11,941 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-09-04 03:52:11,941 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:11,960 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:16,038 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-09-04 03:52:16,038 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:16,057 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:20,141 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-09-04 03:52:20,141 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:20,157 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:24,232 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-09-04 03:52:24,233 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:24,247 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:28,330 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-09-04 03:52:28,330 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:28,344 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:32,425 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-09-04 03:52:32,426 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:32,438 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:36,517 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-09-04 03:52:36,517 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:36,534 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:40,617 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-09-04 03:52:40,617 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:40,631 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:44,718 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-09-04 03:52:44,718 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:44,735 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:48,815 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-09-04 03:52:48,815 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:48,831 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:52,903 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-09-04 03:52:52,903 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:52,916 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:52:57,007 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-09-04 03:52:57,007 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:52:57,021 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:53:01,093 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-09-04 03:53:01,093 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:53:01,107 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:53:05,196 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-09-04 03:53:05,196 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:53:05,210 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:53:09,288 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-09-04 03:53:09,288 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 failed! 2025-09-04 03:53:09,303 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-62472562 is 77.77.178.193 and allocation pool is NOT set 2025-09-04 03:53:11,365 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.70 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.14 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.137/2.420/3.704/1.283 ms') 2025-09-04 03:53:11,365 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-84325977 passed 2025-09-04 03:53:11,441 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:11,441 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:11,499 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:11,631 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:16,631 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:16,631 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:16,701 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:16,793 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:21,794 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:21,794 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:21,861 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:21,963 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:26,964 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:26,964 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:27,019 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:27,099 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:32,099 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:32,099 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:32,155 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:32,251 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:37,252 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:37,252 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:37,318 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:37,412 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:42,413 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:42,413 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:42,482 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:42,574 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:47,574 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:47,575 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:47,641 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:47,748 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:52,749 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:52,749 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:52,818 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:52,907 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:53:57,908 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:53:57,908 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:53:57,967 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:53:58,046 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:54:03,047 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:03,047 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-84325977, IP 77.77.178.195, Port 22 2025-09-04 03:54:03,213 - DEBUG - VM ctest-TestBGPaasZone-64699584-84325977 is ready for SSH connections 2025-09-04 03:54:03,213 - INFO - Waiting for VM ctest-TestBGPaasZone-64699584-14619781 to be up.. 2025-09-04 03:54:03,300 - DEBUG - VM is in ACTIVE state now 2025-09-04 03:54:03,300 - INFO - VM name : ctest-TestBGPaasZone-64699584-14619781 2025-09-04 03:54:03,377 - DEBUG - VM ctest-TestBGPaasZone-64699584-14619781 ID is b8a0ed3c-f430-46a1-8a94-795ca95b870d 2025-09-04 03:54:03,377 - DEBUG - VM ctest-TestBGPaasZone-64699584-14619781 launched on Node an-jenkins-deploy-platform-ansible-os-4012-2 2025-09-04 03:54:03,457 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/b8a0ed3c-f430-46a1-8a94-795ca95b870d 2025-09-04 03:54:03,467 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/2c474326-695e-4d83-960c-f8aafd5bea4d 2025-09-04 03:54:04,622 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.08 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.557 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.557/2.320/4.083/1.763 ms') 2025-09-04 03:54:04,622 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-14619781 passed 2025-09-04 03:54:04,689 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:04,689 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-14619781, IP 77.77.178.196, Port 22 2025-09-04 03:54:04,859 - DEBUG - VM ctest-TestBGPaasZone-64699584-14619781 is ready for SSH connections 2025-09-04 03:54:04,859 - INFO - Waiting for VM ctest-TestBGPaasZone-64699584-80721188 to be up.. 2025-09-04 03:54:04,951 - DEBUG - VM is in ACTIVE state now 2025-09-04 03:54:04,951 - INFO - VM name : ctest-TestBGPaasZone-64699584-80721188 2025-09-04 03:54:05,033 - DEBUG - VM ctest-TestBGPaasZone-64699584-80721188 ID is f7a0d06a-cc65-4c85-8345-351cb3633b68 2025-09-04 03:54:05,033 - DEBUG - VM ctest-TestBGPaasZone-64699584-80721188 launched on Node an-jenkins-deploy-platform-ansible-os-4012-1 2025-09-04 03:54:05,115 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/f7a0d06a-cc65-4c85-8345-351cb3633b68 2025-09-04 03:54:05,125 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/8fbe7f38-8870-44bf-bcee-b437d2a2d54c 2025-09-04 03:54:06,284 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=9.92 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.63 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.625/6.270/9.915/3.645 ms') 2025-09-04 03:54:06,284 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-64699584-80721188 passed 2025-09-04 03:54:06,359 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:06,359 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-80721188, IP 77.77.178.197, Port 22 2025-09-04 03:54:06,529 - DEBUG - VM ctest-TestBGPaasZone-64699584-80721188 is ready for SSH connections 2025-09-04 03:54:06,672 - INFO - Created control node zone ctest-test-zone-37405985(f90d4bc7-d50b-483d-80ed-935f7c3bfd30) 2025-09-04 03:54:07,036 - INFO - Created control node zone ctest-test-zone-52558570(03cdd737-4ada-49e6-9663-61c2d60aad70) 2025-09-04 03:54:07,400 - INFO - Created control node zone ctest-test-zone-99363206(b44c9471-cbf9-4657-b33f-69126f5993cb) 2025-09-04 03:54:07,680 - INFO - Creating BGPaaS ctest-TestBGPaasZone-64699584-28068725 2025-09-04 03:54:07,756 - INFO - BGPaaS: ctest-TestBGPaasZone-64699584-28068725(54bf3bdd-7175-4c08-8dc8-19432146508e) 2025-09-04 03:54:07,757 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:54:08,061 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:54:08,098 - INFO - verify_in_api_server passed for BGPaaS obj 54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:54:08,098 - INFO - BGPaaS(54bf3bdd-7175-4c08-8dc8-19432146508e): verify_on_setup passed 2025-09-04 03:54:08,098 - INFO - We will configure BGP on the VM 2025-09-04 03:54:08,356 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:08,356 - INFO - Configuring BGP on ctest-TestBGPaasZone-64699584-84325977 2025-09-04 03:54:08,357 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:54:08,357 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS 2025-09-04 03:54:21,321 - DEBUG - None 2025-09-04 03:54:21,321 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:54:21,321 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS 2025-09-04 03:54:22,320 - DEBUG - None 2025-09-04 03:54:22,320 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:54:22,320 - DEBUG - service bird restart 2025-09-04 03:54:26,005 - DEBUG - bird stop/waiting bird start/running, process 1433 2025-09-04 03:54:26,005 - INFO - Attaching VMI 6b2324cb-3fbf-464c-8281-228ecb23f261 to BGPaaS 54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:54:26,080 - INFO - Attaching the VMI 6b7418e1-0216-4d63-a851-56f8020284f2 to the BGPaaS 54bf3bdd-7175-4c08-8dc8-19432146508e object 2025-09-04 03:54:26,080 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 77.77.178.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:54:26,081 - DEBUG - sudo ip addr add 77.77.178.212 dev eth0 2025-09-04 03:54:27,495 - DEBUG - None 2025-09-04 03:54:27,568 - INFO - Creating BGPaaS ctest-TestBGPaasZone-64699584-20091052 2025-09-04 03:54:27,656 - INFO - BGPaaS: ctest-TestBGPaasZone-64699584-20091052(f905b136-13a4-4212-9454-70c251f2a588) 2025-09-04 03:54:27,657 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/f905b136-13a4-4212-9454-70c251f2a588 2025-09-04 03:54:27,667 - INFO - verify_in_api_server passed for BGPaaS obj f905b136-13a4-4212-9454-70c251f2a588 2025-09-04 03:54:27,667 - INFO - BGPaaS(f905b136-13a4-4212-9454-70c251f2a588): verify_on_setup passed 2025-09-04 03:54:27,667 - INFO - We will configure BGP on the VM 2025-09-04 03:54:27,924 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:27,924 - INFO - Configuring BGP on ctest-TestBGPaasZone-64699584-14619781 2025-09-04 03:54:27,924 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.196; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.196; } protocol bfd { neighbor 77.77.178.194 local 77.77.178.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:54:27,925 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.196; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.196; } protocol bfd { neighbor 77.77.178.194 local 77.77.178.196 multihop on; } EOS 2025-09-04 03:54:33,590 - DEBUG - None 2025-09-04 03:54:33,590 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.196; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.196; } protocol bfd { neighbor 77.77.178.194 local 77.77.178.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:54:33,590 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.196; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.196; } protocol bfd { neighbor 77.77.178.194 local 77.77.178.196 multihop on; } EOS 2025-09-04 03:54:34,125 - DEBUG - None 2025-09-04 03:54:34,125 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:54:34,125 - DEBUG - service bird restart 2025-09-04 03:54:35,964 - DEBUG - bird stop/waiting bird start/running, process 1440 2025-09-04 03:54:35,964 - INFO - Attaching VMI 2c474326-695e-4d83-960c-f8aafd5bea4d to BGPaaS f905b136-13a4-4212-9454-70c251f2a588 2025-09-04 03:54:36,040 - INFO - Attaching the VMI b8a0ed3c-f430-46a1-8a94-795ca95b870d to the BGPaaS f905b136-13a4-4212-9454-70c251f2a588 object 2025-09-04 03:54:36,040 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 77.77.178.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:54:36,041 - DEBUG - sudo ip addr add 77.77.178.212 dev eth0 2025-09-04 03:54:36,759 - DEBUG - None 2025-09-04 03:54:36,759 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:36,776 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-09-04 03:54:36,783 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:36,801 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-09-04 03:54:42,820 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-09-04 03:54:48,840 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-09-04 03:54:48,847 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 77.77.178.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:54:48,847 - DEBUG - ping -s 56 -c 3 -W 1 77.77.178.212 2025-09-04 03:54:55,141 - DEBUG - PING 77.77.178.212 (77.77.178.212) 56(84) bytes of data. 64 bytes from 77.77.178.212: icmp_seq=1 ttl=64 time=7.94 ms 64 bytes from 77.77.178.212: icmp_seq=2 ttl=64 time=0.995 ms 64 bytes from 77.77.178.212: icmp_seq=3 ttl=64 time=0.933 ms --- 77.77.178.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.933/3.291/7.945/3.290 ms 2025-09-04 03:54:55,141 - INFO - Ping to IP 77.77.178.212 from VM ctest-TestBGPaasZone-64699584-80721188 passed 2025-09-04 03:54:55,964 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:54:55,965 - DEBUG - service bird restart 2025-09-04 03:54:57,661 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-09-04 03:54:57,661 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:54:57,661 - DEBUG - service bird restart 2025-09-04 03:54:59,503 - DEBUG - bird stop/waiting bird start/running, process 1467 2025-09-04 03:54:59,503 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:54:59,503 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-09-04 03:54:59,526 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-09-04 03:55:05,527 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-09-04 03:55:05,542 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-09-04 03:55:05,550 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:55:05,572 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-09-04 03:55:05,579 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 77.77.178.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:55:05,579 - DEBUG - ping -s 56 -c 3 -W 1 77.77.178.212 2025-09-04 03:55:08,110 - DEBUG - PING 77.77.178.212 (77.77.178.212) 56(84) bytes of data. 64 bytes from 77.77.178.212: icmp_seq=1 ttl=64 time=5.24 ms 64 bytes from 77.77.178.212: icmp_seq=2 ttl=64 time=1.41 ms 64 bytes from 77.77.178.212: icmp_seq=3 ttl=64 time=1.10 ms --- 77.77.178.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.109/2.589/5.247/1.883 ms 2025-09-04 03:55:08,110 - INFO - Ping to IP 77.77.178.212 from VM ctest-TestBGPaasZone-64699584-80721188 passed 2025-09-04 03:55:08,401 - INFO - We will configure BGP on the VM 2025-09-04 03:55:08,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:55:08,620 - INFO - Configuring BGP on ctest-TestBGPaasZone-64699584-84325977 2025-09-04 03:55:08,621 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:55:08,621 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS 2025-09-04 03:55:09,137 - DEBUG - None 2025-09-04 03:55:09,137 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:55:09,137 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 77.77.178.195; protocol bgp bgp_1{ local as 65000; neighbor 77.77.178.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 77.77.178.195; } protocol bfd { neighbor 77.77.178.193 local 77.77.178.195 multihop on; } EOS 2025-09-04 03:55:09,699 - DEBUG - None 2025-09-04 03:55:09,699 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:55:09,699 - DEBUG - service bird restart 2025-09-04 03:55:11,494 - DEBUG - bird stop/waiting bird start/running, process 1501 2025-09-04 03:55:11,494 - INFO - Attaching VMI 6b2324cb-3fbf-464c-8281-228ecb23f261 to BGPaaS 54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:55:11,514 - INFO - Attaching the VMI 6b7418e1-0216-4d63-a851-56f8020284f2 to the BGPaaS 54bf3bdd-7175-4c08-8dc8-19432146508e object 2025-09-04 03:55:11,514 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 77.77.178.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:55:11,514 - DEBUG - sudo ip addr add 77.77.178.212 dev eth0 2025-09-04 03:55:12,267 - DEBUG - RTNETLINK answers: File exists 2025-09-04 03:55:12,267 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:55:12,267 - DEBUG - service bird restart 2025-09-04 03:55:14,031 - DEBUG - bird stop/waiting bird start/running, process 1528 2025-09-04 03:55:14,031 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:55:14,031 - DEBUG - service bird restart 2025-09-04 03:55:15,812 - DEBUG - bird stop/waiting bird start/running, process 1489 2025-09-04 03:55:15,812 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:55:15,828 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-09-04 03:55:21,845 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-09-04 03:55:21,851 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:55:21,868 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-09-04 03:55:21,874 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 77.77.178.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:55:21,874 - DEBUG - ping -s 56 -c 3 -W 1 77.77.178.212 2025-09-04 03:55:24,378 - DEBUG - PING 77.77.178.212 (77.77.178.212) 56(84) bytes of data. 64 bytes from 77.77.178.212: icmp_seq=1 ttl=64 time=3.27 ms 64 bytes from 77.77.178.212: icmp_seq=2 ttl=64 time=0.991 ms 64 bytes from 77.77.178.212: icmp_seq=3 ttl=64 time=1.37 ms --- 77.77.178.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.991/1.879/3.271/0.997 ms 2025-09-04 03:55:24,378 - INFO - Ping to IP 77.77.178.212 from VM ctest-TestBGPaasZone-64699584-80721188 passed 2025-09-04 03:55:24,378 - INFO - Detaching VMI 6b2324cb-3fbf-464c-8281-228ecb23f261 from BGPaaS 54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:55:24,465 - INFO - Detaching VMI 2c474326-695e-4d83-960c-f8aafd5bea4d from BGPaaS f905b136-13a4-4212-9454-70c251f2a588 2025-09-04 03:55:24,565 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-64699584-20091052(f905b136-13a4-4212-9454-70c251f2a588) 2025-09-04 03:55:24,642 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/f905b136-13a4-4212-9454-70c251f2a588 2025-09-04 03:55:24,650 - DEBUG - Response Code: 404 2025-09-04 03:55:24,650 - DEBUG - BGPaaS: f905b136-13a4-4212-9454-70c251f2a588 deleted from api server 2025-09-04 03:55:24,651 - INFO - BGPaaS(f905b136-13a4-4212-9454-70c251f2a588): verify_on_cleanup passed 2025-09-04 03:55:24,651 - INFO - Detaching VMI 6b2324cb-3fbf-464c-8281-228ecb23f261 from BGPaaS 54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:55:24,689 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-64699584-28068725(54bf3bdd-7175-4c08-8dc8-19432146508e) 2025-09-04 03:55:24,778 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/54bf3bdd-7175-4c08-8dc8-19432146508e 2025-09-04 03:55:24,785 - DEBUG - Response Code: 404 2025-09-04 03:55:24,785 - DEBUG - BGPaaS: 54bf3bdd-7175-4c08-8dc8-19432146508e deleted from api server 2025-09-04 03:55:24,785 - INFO - BGPaaS(54bf3bdd-7175-4c08-8dc8-19432146508e): verify_on_cleanup passed 2025-09-04 03:55:24,785 - INFO - Deleting Control node zone ctest-test-zone-99363206(b44c9471-cbf9-4657-b33f-69126f5993cb) 2025-09-04 03:55:24,930 - INFO - Deleting Control node zone ctest-test-zone-52558570(03cdd737-4ada-49e6-9663-61c2d60aad70) 2025-09-04 03:55:25,081 - INFO - Deleting Control node zone ctest-test-zone-37405985(f90d4bc7-d50b-483d-80ed-935f7c3bfd30) 2025-09-04 03:55:25,166 - INFO - Deleting VM ctest-TestBGPaasZone-64699584-80721188 2025-09-04 03:55:25,256 - INFO - Deleting VM ctest-TestBGPaasZone-64699584-14619781 2025-09-04 03:55:25,354 - INFO - Deleting VM ctest-TestBGPaasZone-64699584-84325977 2025-09-04 03:55:25,442 - INFO - Deleting VN ctest-cnz_vn-62472562 2025-09-04 03:55:25,497 - DEBUG - VN dc150f0d-49d2-43d2-ac5e-5b9dafab8a05 still in use: Unable to complete operation on network dc150f0d-49d2-43d2-ac5e-5b9dafab8a05. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-5d252721-744c-43fc-b7b3-cd0beca8e47b'] 2025-09-04 03:55:25,497 - WARNING - Deleting VN ctest-cnz_vn-62472562 failed..Will retry 2025-09-04 03:55:27,723 - DEBUG - Response for deleting network () 2025-09-04 03:55:28,981 - DEBUG - Skipping xmpp flap check 2025-09-04 03:55:28,981 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:14] 2025-09-04 03:55:28,981 - INFO - -------------------------------------------------------------------------------- 2025-09-04 03:55:28,984 - INFO - ================================================================================ 2025-09-04 03:55:28,984 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-09-04 03:55:30,238 - DEBUG - Skipping xmpp flap check 2025-09-04 03:55:30,238 - INFO - Initial checks done. Running the testcase now 2025-09-04 03:55:30,238 - INFO - 2025-09-04 03:55:30,238 - INFO - executing bgp_control_zone agent restart test 2025-09-04 03:55:30,554 - DEBUG - Response for create_network : {'network': {'id': '5368aabe-905d-4ccf-90f2-b4b59a2abd9b', 'name': 'ctest-cnz_vn-50114997', 'tenant_id': 'f792e1a5de384abbbf8239319e087f90', 'project_id': 'f792e1a5de384abbbf8239319e087f90', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-64699584', 'ctest-cnz_vn-50114997'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:55:30,756 - DEBUG - Response for create_subnet : {'subnet': {'id': '2e65b70a-5663-41de-90b4-de3485b6f176', 'name': '', 'tenant_id': 'f792e1a5de384abbbf8239319e087f90', 'network_id': '5368aabe-905d-4ccf-90f2-b4b59a2abd9b', 'ip_version': 4, 'cidr': '117.87.170.128/26', 'allocation_pools': [{'start': '117.87.170.130', 'end': '117.87.170.190'}], 'gateway_ip': '117.87.170.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '117.87.170.130', 'tags': [], 'project_id': 'f792e1a5de384abbbf8239319e087f90'}} 2025-09-04 03:55:30,779 - INFO - Created VN ctest-cnz_vn-50114997 2025-09-04 03:55:30,791 - DEBUG - VN ctest-cnz_vn-50114997 UUID is 5368aabe-905d-4ccf-90f2-b4b59a2abd9b 2025-09-04 03:55:31,997 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-2) 2025-09-04 03:55:33,310 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-1) 2025-09-04 03:55:34,818 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-2) 2025-09-04 03:55:34,818 - INFO - Waiting for VM ctest-TestBGPaasZone-64699584-56784086 to be up.. 2025-09-04 03:55:34,912 - DEBUG - VM is in ACTIVE state now 2025-09-04 03:55:34,912 - INFO - VM name : ctest-TestBGPaasZone-64699584-56784086 2025-09-04 03:55:35,009 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 ID is be40afa8-5d94-4779-9d0c-2dc3e24866fe 2025-09-04 03:55:35,009 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 launched on Node an-jenkins-deploy-platform-ansible-os-4012-2 2025-09-04 03:55:35,091 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/be40afa8-5d94-4779-9d0c-2dc3e24866fe 2025-09-04 03:55:35,100 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/283eeef4-2826-426c-986e-14f60cd39441 2025-09-04 03:55:38,331 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2025-09-04 03:55:38,331 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:55:38,344 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:55:42,429 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-09-04 03:55:42,429 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:55:42,444 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:55:46,521 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-09-04 03:55:46,521 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:55:46,536 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:55:50,617 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-09-04 03:55:50,617 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:55:50,631 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:55:54,712 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-09-04 03:55:54,712 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:55:54,726 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:55:58,806 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-09-04 03:55:58,806 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:55:58,819 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:02,904 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-09-04 03:56:02,904 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:02,919 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:06,996 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-09-04 03:56:06,996 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:07,011 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:11,090 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-09-04 03:56:11,090 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:11,103 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:15,194 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-09-04 03:56:15,194 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:15,208 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:19,291 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-09-04 03:56:19,291 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:19,329 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:23,415 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-09-04 03:56:23,415 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:23,429 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:27,510 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-09-04 03:56:27,510 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:27,530 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:31,610 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-09-04 03:56:31,610 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:31,627 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:35,708 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-09-04 03:56:35,708 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:35,721 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:39,803 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-09-04 03:56:39,803 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:39,819 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:43,899 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-09-04 03:56:43,899 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:43,913 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:47,992 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-09-04 03:56:47,992 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:48,008 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:52,087 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-09-04 03:56:52,088 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 failed! 2025-09-04 03:56:52,102 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-64699584:ctest-cnz_vn-50114997 is 117.87.170.129 and allocation pool is NOT set 2025-09-04 03:56:54,173 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.77 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.24 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.240/4.504/7.769/3.264 ms') 2025-09-04 03:56:54,173 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-56784086 passed 2025-09-04 03:56:54,250 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:56:54,250 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:56:54,319 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:56:54,520 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:56:59,520 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:56:59,521 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:56:59,587 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:56:59,669 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:04,670 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:04,670 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:04,743 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:04,851 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:09,852 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:09,852 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:09,919 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:10,009 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:15,010 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:15,010 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:15,079 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:15,160 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:20,161 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:20,161 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:20,228 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:20,318 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:25,319 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:25,319 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:25,391 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:25,479 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:30,480 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:30,480 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:30,547 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:30,661 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:35,662 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:35,663 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:35,736 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:35,825 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:40,826 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:40,826 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:40,895 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:40,991 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:45,992 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:45,992 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:46,060 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:46,146 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:51,146 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:51,147 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-56784086, IP 117.87.170.131, Port 22 2025-09-04 03:57:51,319 - DEBUG - VM ctest-TestBGPaasZone-64699584-56784086 is ready for SSH connections 2025-09-04 03:57:51,319 - INFO - Waiting for VM ctest-TestBGPaasZone-64699584-00719546 to be up.. 2025-09-04 03:57:51,419 - DEBUG - VM is in ACTIVE state now 2025-09-04 03:57:51,419 - INFO - VM name : ctest-TestBGPaasZone-64699584-00719546 2025-09-04 03:57:51,525 - DEBUG - VM ctest-TestBGPaasZone-64699584-00719546 ID is 7d78bb4b-182b-46d8-9cf4-7d676d37e49a 2025-09-04 03:57:51,526 - DEBUG - VM ctest-TestBGPaasZone-64699584-00719546 launched on Node an-jenkins-deploy-platform-ansible-os-4012-1 2025-09-04 03:57:51,617 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/7d78bb4b-182b-46d8-9cf4-7d676d37e49a 2025-09-04 03:57:51,653 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/ab300e5e-02b1-43ec-a2d1-f49705cd9cfc 2025-09-04 03:57:52,806 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.88 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.580 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.580/2.732/4.884/2.152 ms') 2025-09-04 03:57:52,806 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-64699584-00719546 passed 2025-09-04 03:57:52,873 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:52,873 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-00719546, IP 117.87.170.132, Port 22 2025-09-04 03:57:53,045 - DEBUG - VM ctest-TestBGPaasZone-64699584-00719546 is ready for SSH connections 2025-09-04 03:57:53,046 - INFO - Waiting for VM ctest-TestBGPaasZone-64699584-11113593 to be up.. 2025-09-04 03:57:53,130 - DEBUG - VM is in ACTIVE state now 2025-09-04 03:57:53,130 - INFO - VM name : ctest-TestBGPaasZone-64699584-11113593 2025-09-04 03:57:53,220 - DEBUG - VM ctest-TestBGPaasZone-64699584-11113593 ID is 4f9936fe-c4a9-4338-a49d-47061da08520 2025-09-04 03:57:53,220 - DEBUG - VM ctest-TestBGPaasZone-64699584-11113593 launched on Node an-jenkins-deploy-platform-ansible-os-4012-2 2025-09-04 03:57:53,304 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/4f9936fe-c4a9-4338-a49d-47061da08520 2025-09-04 03:57:53,315 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/b8531a89-ac11-4c8c-9298-bde8258f8b59 2025-09-04 03:57:54,519 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.17 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=10.2 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 6.170/8.207/10.245/2.037 ms') 2025-09-04 03:57:54,519 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-64699584-11113593 passed 2025-09-04 03:57:54,589 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:54,589 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-11113593, IP 117.87.170.133, Port 22 2025-09-04 03:57:54,655 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-04 03:57:54,780 - DEBUG - VM ctest-TestBGPaasZone-64699584-11113593 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-04 03:57:59,780 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:57:59,780 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64699584-11113593, IP 117.87.170.133, Port 22 2025-09-04 03:57:59,952 - DEBUG - VM ctest-TestBGPaasZone-64699584-11113593 is ready for SSH connections 2025-09-04 03:58:00,084 - INFO - Created control node zone ctest-test-zone-00866595(a1538d5a-fe06-4220-82f9-1e3253361c00) 2025-09-04 03:58:00,436 - INFO - Created control node zone ctest-test-zone-49092826(ea1290d1-2f44-4a58-ad04-3d64e72b5d5e) 2025-09-04 03:58:00,788 - INFO - Created control node zone ctest-test-zone-82666512(ddda7553-9706-4a51-88d9-02d091378bfe) 2025-09-04 03:58:01,064 - INFO - Creating BGPaaS ctest-TestBGPaasZone-64699584-59193510 2025-09-04 03:58:01,136 - INFO - BGPaaS: ctest-TestBGPaasZone-64699584-59193510(fcad73ee-6b2a-4443-946e-c5a15afc74f5) 2025-09-04 03:58:01,136 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/fcad73ee-6b2a-4443-946e-c5a15afc74f5 2025-09-04 03:58:01,156 - INFO - verify_in_api_server passed for BGPaaS obj fcad73ee-6b2a-4443-946e-c5a15afc74f5 2025-09-04 03:58:01,156 - INFO - BGPaaS(fcad73ee-6b2a-4443-946e-c5a15afc74f5): verify_on_setup passed 2025-09-04 03:58:01,156 - INFO - We will configure BGP on the VM 2025-09-04 03:58:01,584 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:01,585 - INFO - Configuring BGP on ctest-TestBGPaasZone-64699584-56784086 2025-09-04 03:58:01,585 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 117.87.170.131; protocol bgp bgp_1{ local as 65000; neighbor 117.87.170.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.131; } protocol bfd { neighbor 117.87.170.129 local 117.87.170.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:58:01,585 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 117.87.170.131; protocol bgp bgp_1{ local as 65000; neighbor 117.87.170.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.131; } protocol bfd { neighbor 117.87.170.129 local 117.87.170.131 multihop on; } EOS 2025-09-04 03:58:15,303 - DEBUG - None 2025-09-04 03:58:15,303 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 117.87.170.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.131; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:58:15,303 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 117.87.170.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.131; } EOS 2025-09-04 03:58:16,393 - DEBUG - None 2025-09-04 03:58:16,393 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:58:16,393 - DEBUG - service bird restart 2025-09-04 03:58:18,448 - DEBUG - bird stop/waiting bird start/running, process 1443 2025-09-04 03:58:18,448 - INFO - Attaching VMI 283eeef4-2826-426c-986e-14f60cd39441 to BGPaaS fcad73ee-6b2a-4443-946e-c5a15afc74f5 2025-09-04 03:58:18,520 - INFO - Attaching the VMI be40afa8-5d94-4779-9d0c-2dc3e24866fe to the BGPaaS fcad73ee-6b2a-4443-946e-c5a15afc74f5 object 2025-09-04 03:58:18,521 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 117.87.170.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:58:18,522 - DEBUG - sudo ip addr add 117.87.170.148 dev eth0 2025-09-04 03:58:19,239 - DEBUG - None 2025-09-04 03:58:19,300 - INFO - Creating BGPaaS ctest-TestBGPaasZone-64699584-28234638 2025-09-04 03:58:19,372 - INFO - BGPaaS: ctest-TestBGPaasZone-64699584-28234638(7983157c-7b88-4631-b4e6-decc3778e4b4) 2025-09-04 03:58:19,372 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/7983157c-7b88-4631-b4e6-decc3778e4b4 2025-09-04 03:58:19,383 - INFO - verify_in_api_server passed for BGPaaS obj 7983157c-7b88-4631-b4e6-decc3778e4b4 2025-09-04 03:58:19,383 - INFO - BGPaaS(7983157c-7b88-4631-b4e6-decc3778e4b4): verify_on_setup passed 2025-09-04 03:58:19,383 - INFO - We will configure BGP on the VM 2025-09-04 03:58:19,800 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:19,800 - INFO - Configuring BGP on ctest-TestBGPaasZone-64699584-00719546 2025-09-04 03:58:19,801 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 117.87.170.132; protocol bgp bgp_1{ local as 65000; neighbor 117.87.170.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.132; } protocol bfd { neighbor 117.87.170.129 local 117.87.170.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:58:19,801 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 117.87.170.132; protocol bgp bgp_1{ local as 65000; neighbor 117.87.170.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.132; } protocol bfd { neighbor 117.87.170.129 local 117.87.170.132 multihop on; } EOS 2025-09-04 03:58:25,303 - DEBUG - None 2025-09-04 03:58:25,303 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 117.87.170.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.132; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:58:25,303 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 117.87.170.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 117.87.170.132; } EOS 2025-09-04 03:58:25,802 - DEBUG - None 2025-09-04 03:58:25,802 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:58:25,802 - DEBUG - service bird restart 2025-09-04 03:58:27,558 - DEBUG - bird stop/waiting bird start/running, process 1436 2025-09-04 03:58:27,558 - INFO - Attaching VMI ab300e5e-02b1-43ec-a2d1-f49705cd9cfc to BGPaaS 7983157c-7b88-4631-b4e6-decc3778e4b4 2025-09-04 03:58:27,628 - INFO - Attaching the VMI 7d78bb4b-182b-46d8-9cf4-7d676d37e49a to the BGPaaS 7983157c-7b88-4631-b4e6-decc3778e4b4 object 2025-09-04 03:58:27,628 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 117.87.170.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-09-04 03:58:27,629 - DEBUG - sudo ip addr add 117.87.170.148 dev eth0 2025-09-04 03:58:28,343 - DEBUG - None 2025-09-04 03:58:28,343 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:28,358 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-09-04 03:58:28,358 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:28,375 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-09-04 03:58:28,381 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:28,396 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-09-04 03:58:34,411 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-09-04 03:58:40,431 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-09-04 03:58:40,432 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:40,450 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-09-04 03:58:40,456 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 117.87.170.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:58:40,456 - DEBUG - ping -s 56 -c 3 -W 1 117.87.170.148 2025-09-04 03:58:46,999 - DEBUG - PING 117.87.170.148 (117.87.170.148) 56(84) bytes of data. 64 bytes from 117.87.170.148: icmp_seq=1 ttl=64 time=9.79 ms 64 bytes from 117.87.170.148: icmp_seq=2 ttl=64 time=1.36 ms 64 bytes from 117.87.170.148: icmp_seq=3 ttl=64 time=1.26 ms --- 117.87.170.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.264/4.138/9.791/3.997 ms 2025-09-04 03:58:46,999 - INFO - Ping to IP 117.87.170.148 from VM ctest-TestBGPaasZone-64699584-11113593 passed 2025-09-04 03:58:46,999 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:47,020 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-09-04 03:58:47,021 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:47,041 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-09-04 03:58:47,050 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:47,073 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-09-04 03:58:47,074 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-04 03:58:47,094 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-09-04 03:58:47,102 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 117.87.170.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-09-04 03:58:47,102 - DEBUG - ping -s 56 -c 3 -W 1 117.87.170.148 2025-09-04 03:58:49,644 - DEBUG - PING 117.87.170.148 (117.87.170.148) 56(84) bytes of data. 64 bytes from 117.87.170.148: icmp_seq=1 ttl=64 time=3.68 ms 64 bytes from 117.87.170.148: icmp_seq=2 ttl=64 time=1.44 ms 64 bytes from 117.87.170.148: icmp_seq=3 ttl=64 time=1.44 ms --- 117.87.170.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.447/2.191/3.680/1.053 ms 2025-09-04 03:58:49,644 - INFO - Ping to IP 117.87.170.148 from VM ctest-TestBGPaasZone-64699584-11113593 passed 2025-09-04 03:58:49,644 - INFO - Detaching VMI ab300e5e-02b1-43ec-a2d1-f49705cd9cfc from BGPaaS 7983157c-7b88-4631-b4e6-decc3778e4b4 2025-09-04 03:58:49,720 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-64699584-28234638(7983157c-7b88-4631-b4e6-decc3778e4b4) 2025-09-04 03:58:49,793 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/7983157c-7b88-4631-b4e6-decc3778e4b4 2025-09-04 03:58:49,816 - DEBUG - Response Code: 404 2025-09-04 03:58:49,816 - DEBUG - BGPaaS: 7983157c-7b88-4631-b4e6-decc3778e4b4 deleted from api server 2025-09-04 03:58:49,816 - INFO - BGPaaS(7983157c-7b88-4631-b4e6-decc3778e4b4): verify_on_cleanup passed 2025-09-04 03:58:49,816 - INFO - Detaching VMI 283eeef4-2826-426c-986e-14f60cd39441 from BGPaaS fcad73ee-6b2a-4443-946e-c5a15afc74f5 2025-09-04 03:58:49,908 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-64699584-59193510(fcad73ee-6b2a-4443-946e-c5a15afc74f5) 2025-09-04 03:58:49,986 - DEBUG - Requesting: http://10.0.0.57:8082/bgp-as-a-service/fcad73ee-6b2a-4443-946e-c5a15afc74f5 2025-09-04 03:58:49,992 - DEBUG - Response Code: 404 2025-09-04 03:58:49,992 - DEBUG - BGPaaS: fcad73ee-6b2a-4443-946e-c5a15afc74f5 deleted from api server 2025-09-04 03:58:49,992 - INFO - BGPaaS(fcad73ee-6b2a-4443-946e-c5a15afc74f5): verify_on_cleanup passed 2025-09-04 03:58:49,992 - INFO - Deleting Control node zone ctest-test-zone-82666512(ddda7553-9706-4a51-88d9-02d091378bfe) 2025-09-04 03:58:50,143 - INFO - Deleting Control node zone ctest-test-zone-49092826(ea1290d1-2f44-4a58-ad04-3d64e72b5d5e) 2025-09-04 03:58:50,297 - INFO - Deleting Control node zone ctest-test-zone-00866595(a1538d5a-fe06-4220-82f9-1e3253361c00) 2025-09-04 03:58:50,450 - INFO - Deleting VM ctest-TestBGPaasZone-64699584-11113593 2025-09-04 03:58:50,531 - INFO - Deleting VM ctest-TestBGPaasZone-64699584-00719546 2025-09-04 03:58:50,623 - INFO - Deleting VM ctest-TestBGPaasZone-64699584-56784086 2025-09-04 03:58:50,711 - INFO - Deleting VN ctest-cnz_vn-50114997 2025-09-04 03:58:50,754 - DEBUG - VN 5368aabe-905d-4ccf-90f2-b4b59a2abd9b still in use: Unable to complete operation on network 5368aabe-905d-4ccf-90f2-b4b59a2abd9b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-835d5ee9-c2e5-4c49-adaf-4ccf9754979b'] 2025-09-04 03:58:50,754 - WARNING - Deleting VN ctest-cnz_vn-50114997 failed..Will retry 2025-09-04 03:58:52,997 - DEBUG - Response for deleting network () 2025-09-04 03:58:54,266 - DEBUG - Skipping xmpp flap check 2025-09-04 03:58:54,266 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:26] 2025-09-04 03:58:54,266 - INFO - -------------------------------------------------------------------------------- 2025-09-04 03:58:55,126 - INFO - Deleted project: ctest-TestBGPaasZone-64699584, ID : f792e1a5-de38-4abb-bf82-39319e087f90