is in ACTIVE state now
2026-03-05 03:54:44,973 - INFO - VM name : ctest-TestBGPaasZone-97528824-77265010
2026-03-05 03:54:45,050 - DEBUG - VM ctest-TestBGPaasZone-97528824-77265010 ID is b24627a6-0414-40eb-b65c-48db05778ae2
2026-03-05 03:54:45,050 - DEBUG - VM ctest-TestBGPaasZone-97528824-77265010 launched on Node an-jenkins-deploy-platform-ansible-os-5433-1
2026-03-05 03:54:45,129 - DEBUG - Requesting: http://10.0.0.133:8082/virtual-machine/b24627a6-0414-40eb-b65c-48db05778ae2
2026-03-05 03:54:45,138 - DEBUG - Requesting: http://10.0.0.133:8082/virtual-machine-interface/6dde721d-e482-4940-88ca-dada633e6324
2026-03-05 03:54:46,295 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.69 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.47 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.467/3.076/4.686/1.609 ms')
2026-03-05 03:54:46,295 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-97528824-77265010 passed
2026-03-05 03:54:46,362 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:54:46,362 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-97528824-77265010, IP 152.224.240.197, Port 22
2026-03-05 03:54:46,428 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-05 03:54:46,515 - DEBUG - VM ctest-TestBGPaasZone-97528824-77265010 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-05 03:54:51,516 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:54:51,517 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-97528824-77265010, IP 152.224.240.197, Port 22
2026-03-05 03:54:51,696 - DEBUG - VM ctest-TestBGPaasZone-97528824-77265010 is ready for SSH connections
2026-03-05 03:54:51,829 - INFO - Created control node zone ctest-test-zone-36795159(f54e2ba9-2b6b-4ace-9459-7beb6fefb200)
2026-03-05 03:54:52,169 - INFO - Created control node zone ctest-test-zone-71882888(ea35be05-62e8-44ec-8020-1f4f2a55442e)
2026-03-05 03:54:52,513 - INFO - Created control node zone ctest-test-zone-50008904(a1de1292-ddbb-4228-b6ba-29b4b97ec699)
2026-03-05 03:54:52,789 - INFO - Creating BGPaaS ctest-TestBGPaasZone-97528824-09865208
2026-03-05 03:54:52,865 - INFO - BGPaaS: ctest-TestBGPaasZone-97528824-09865208(b05243ad-1cb3-46c4-9fca-40204e26a022)
2026-03-05 03:54:52,865 - DEBUG - Requesting: http://10.0.0.65:8082/bgp-as-a-service/b05243ad-1cb3-46c4-9fca-40204e26a022
2026-03-05 03:54:52,875 - INFO - verify_in_api_server passed for BGPaaS obj b05243ad-1cb3-46c4-9fca-40204e26a022
2026-03-05 03:54:52,875 - INFO - BGPaaS(b05243ad-1cb3-46c4-9fca-40204e26a022): verify_on_setup passed
2026-03-05 03:54:52,875 - INFO - We will configure BGP on the VM
2026-03-05 03:54:53,297 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:54:53,297 - INFO - Configuring BGP on ctest-TestBGPaasZone-97528824-08161576
2026-03-05 03:54:53,298 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 152.224.240.195;
protocol bgp bgp_1{
local as 65000;
neighbor 152.224.240.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.195;
}
protocol bfd {
neighbor 152.224.240.193 local 152.224.240.195 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-03-05 03:54:53,298 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 152.224.240.195;
protocol bgp bgp_1{
local as 65000;
neighbor 152.224.240.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.195;
}
protocol bfd {
neighbor 152.224.240.193 local 152.224.240.195 multihop on;
}
EOS
2026-03-05 03:55:07,934 - DEBUG - None
2026-03-05 03:55:07,934 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 152.224.240.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.195;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-03-05 03:55:07,934 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 152.224.240.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.195;
}
EOS
2026-03-05 03:55:09,063 - DEBUG - None
2026-03-05 03:55:09,063 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-03-05 03:55:09,064 - DEBUG - service bird restart
2026-03-05 03:55:12,328 - DEBUG - bird stop/waiting
bird start/running, process 1444
2026-03-05 03:55:12,328 - INFO - Attaching VMI 424bde1c-9b26-422a-a62b-797d09a0b2cd to BGPaaS b05243ad-1cb3-46c4-9fca-40204e26a022
2026-03-05 03:55:12,401 - INFO - Attaching the VMI 5244cb4c-701d-4dcf-980f-6fa56bdd2561 to the BGPaaS b05243ad-1cb3-46c4-9fca-40204e26a022 object
2026-03-05 03:55:12,401 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 152.224.240.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-03-05 03:55:12,401 - DEBUG - sudo ip addr add 152.224.240.212 dev eth0
2026-03-05 03:55:13,149 - DEBUG - None
2026-03-05 03:55:13,210 - INFO - Creating BGPaaS ctest-TestBGPaasZone-97528824-49825258
2026-03-05 03:55:13,280 - INFO - BGPaaS: ctest-TestBGPaasZone-97528824-49825258(93444fba-b808-427b-99bd-b14b6f5b90f9)
2026-03-05 03:55:13,281 - DEBUG - Requesting: http://10.0.0.65:8082/bgp-as-a-service/93444fba-b808-427b-99bd-b14b6f5b90f9
2026-03-05 03:55:13,291 - INFO - verify_in_api_server passed for BGPaaS obj 93444fba-b808-427b-99bd-b14b6f5b90f9
2026-03-05 03:55:13,292 - INFO - BGPaaS(93444fba-b808-427b-99bd-b14b6f5b90f9): verify_on_setup passed
2026-03-05 03:55:13,293 - INFO - We will configure BGP on the VM
2026-03-05 03:55:13,703 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:13,703 - INFO - Configuring BGP on ctest-TestBGPaasZone-97528824-83583579
2026-03-05 03:55:13,704 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 152.224.240.196;
protocol bgp bgp_1{
local as 65000;
neighbor 152.224.240.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.196;
}
protocol bfd {
neighbor 152.224.240.193 local 152.224.240.196 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-03-05 03:55:13,704 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 152.224.240.196;
protocol bgp bgp_1{
local as 65000;
neighbor 152.224.240.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.196;
}
protocol bfd {
neighbor 152.224.240.193 local 152.224.240.196 multihop on;
}
EOS
2026-03-05 03:55:19,619 - DEBUG - None
2026-03-05 03:55:19,619 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 152.224.240.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.196;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-03-05 03:55:19,619 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 152.224.240.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 152.224.240.196;
}
EOS
2026-03-05 03:55:20,252 - DEBUG - None
2026-03-05 03:55:20,252 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-03-05 03:55:20,252 - DEBUG - service bird restart
2026-03-05 03:55:22,138 - DEBUG - bird stop/waiting
bird start/running, process 1440
2026-03-05 03:55:22,138 - INFO - Attaching VMI 12b51fb1-594d-4c0d-883f-03b274c97ba2 to BGPaaS 93444fba-b808-427b-99bd-b14b6f5b90f9
2026-03-05 03:55:22,217 - INFO - Attaching the VMI 5ed9c941-d956-4503-9002-0869597fccd4 to the BGPaaS 93444fba-b808-427b-99bd-b14b6f5b90f9 object
2026-03-05 03:55:22,218 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 152.224.240.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-03-05 03:55:22,218 - DEBUG - sudo ip addr add 152.224.240.212 dev eth0
2026-03-05 03:55:22,897 - DEBUG - None
2026-03-05 03:55:22,897 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:22,898 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-05 03:55:22,914 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-05 03:55:22,915 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:22,931 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-05 03:55:22,938 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:22,938 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-05 03:55:22,948 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129']
2026-03-05 03:55:28,950 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-05 03:55:28,961 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129']
2026-03-05 03:55:34,962 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-05 03:55:34,976 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-05 03:55:34,976 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:34,991 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-05 03:55:34,996 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 152.224.240.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-03-05 03:55:34,997 - DEBUG - ping -s 56 -c 3 -W 1 152.224.240.212
2026-03-05 03:55:41,663 - DEBUG - PING 152.224.240.212 (152.224.240.212) 56(84) bytes of data.
64 bytes from 152.224.240.212: icmp_seq=1 ttl=64 time=10.2 ms
64 bytes from 152.224.240.212: icmp_seq=2 ttl=64 time=1.12 ms
64 bytes from 152.224.240.212: icmp_seq=3 ttl=64 time=1.15 ms
--- 152.224.240.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.124/4.173/10.238/4.288 ms
2026-03-05 03:55:41,663 - INFO - Ping to IP 152.224.240.212 from VM ctest-TestBGPaasZone-97528824-77265010 passed
2026-03-05 03:55:41,663 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:41,663 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-05 03:55:41,676 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-05 03:55:41,679 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:41,706 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-05 03:55:41,718 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:41,718 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-05 03:55:41,732 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-05 03:55:41,735 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-05 03:55:41,754 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-05 03:55:41,762 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 152.224.240.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-03-05 03:55:41,762 - DEBUG - ping -s 56 -c 3 -W 1 152.224.240.212
2026-03-05 03:55:44,295 - DEBUG - PING 152.224.240.212 (152.224.240.212) 56(84) bytes of data.
64 bytes from 152.224.240.212: icmp_seq=1 ttl=64 time=6.55 ms
64 bytes from 152.224.240.212: icmp_seq=2 ttl=64 time=1.62 ms
64 bytes from 152.224.240.212: icmp_seq=3 ttl=64 time=1.43 ms
--- 152.224.240.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.432/3.204/6.558/2.373 ms
2026-03-05 03:55:44,295 - INFO - Ping to IP 152.224.240.212 from VM ctest-TestBGPaasZone-97528824-77265010 passed
2026-03-05 03:55:44,295 - INFO - Detaching VMI 12b51fb1-594d-4c0d-883f-03b274c97ba2 from BGPaaS 93444fba-b808-427b-99bd-b14b6f5b90f9
2026-03-05 03:55:44,365 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-97528824-49825258(93444fba-b808-427b-99bd-b14b6f5b90f9)
2026-03-05 03:55:44,421 - DEBUG - Requesting: http://10.0.0.65:8082/bgp-as-a-service/93444fba-b808-427b-99bd-b14b6f5b90f9
2026-03-05 03:55:44,478 - DEBUG - Response Code: 404
2026-03-05 03:55:44,478 - DEBUG - BGPaaS: 93444fba-b808-427b-99bd-b14b6f5b90f9 deleted from api server
2026-03-05 03:55:44,478 - INFO - BGPaaS(93444fba-b808-427b-99bd-b14b6f5b90f9): verify_on_cleanup passed
2026-03-05 03:55:44,479 - INFO - Detaching VMI 424bde1c-9b26-422a-a62b-797d09a0b2cd from BGPaaS b05243ad-1cb3-46c4-9fca-40204e26a022
2026-03-05 03:55:44,554 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-97528824-09865208(b05243ad-1cb3-46c4-9fca-40204e26a022)
2026-03-05 03:55:44,645 - DEBUG - Requesting: http://10.0.0.65:8082/bgp-as-a-service/b05243ad-1cb3-46c4-9fca-40204e26a022
2026-03-05 03:55:44,651 - DEBUG - Response Code: 404
2026-03-05 03:55:44,651 - DEBUG - BGPaaS: b05243ad-1cb3-46c4-9fca-40204e26a022 deleted from api server
2026-03-05 03:55:44,651 - INFO - BGPaaS(b05243ad-1cb3-46c4-9fca-40204e26a022): verify_on_cleanup passed
2026-03-05 03:55:44,651 - INFO - Deleting Control node zone ctest-test-zone-50008904(a1de1292-ddbb-4228-b6ba-29b4b97ec699)
2026-03-05 03:55:44,797 - INFO - Deleting Control node zone ctest-test-zone-71882888(ea35be05-62e8-44ec-8020-1f4f2a55442e)
2026-03-05 03:55:44,934 - INFO - Deleting Control node zone ctest-test-zone-36795159(f54e2ba9-2b6b-4ace-9459-7beb6fefb200)
2026-03-05 03:55:45,075 - INFO - Deleting VM ctest-TestBGPaasZone-97528824-77265010
2026-03-05 03:55:45,156 - INFO - Deleting VM ctest-TestBGPaasZone-97528824-83583579
2026-03-05 03:55:45,231 - INFO - Deleting VM ctest-TestBGPaasZone-97528824-08161576
2026-03-05 03:55:45,317 - INFO - Deleting VN ctest-cnz_vn-06919703
2026-03-05 03:55:45,360 - DEBUG - VN d67232a0-bc7f-4592-9b42-6e1bf2a71d41 still in use: Unable to complete operation on network d67232a0-bc7f-4592-9b42-6e1bf2a71d41. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-6283a895-490a-42a5-878a-50633197c5aa']
2026-03-05 03:55:45,360 - WARNING - Deleting VN ctest-cnz_vn-06919703 failed..Will retry
2026-03-05 03:55:47,557 - DEBUG - Response for deleting network ()
2026-03-05 03:55:48,808 - DEBUG - Skipping xmpp flap check
2026-03-05 03:55:48,808 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:36]
2026-03-05 03:55:48,808 - INFO - --------------------------------------------------------------------------------
2026-03-05 03:55:49,539 - INFO - Deleted project: ctest-TestBGPaasZone-97528824, ID : e7fa82cf-ba20-4dd0-8c5b-56adda44461d