is in ACTIVE state now
2026-01-29 04:11:39,073 - INFO - VM name : ctest-TestBGPaasZone-35015850-18430632
2026-01-29 04:11:39,153 - DEBUG - VM ctest-TestBGPaasZone-35015850-18430632 ID is 9fd2e39d-5d52-46b1-8e08-6b8f6063aecd
2026-01-29 04:11:39,153 - DEBUG - VM ctest-TestBGPaasZone-35015850-18430632 launched on Node an-jenkins-deploy-platform-ansible-os-5115-2
2026-01-29 04:11:39,240 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/9fd2e39d-5d52-46b1-8e08-6b8f6063aecd
2026-01-29 04:11:39,254 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/63d95faa-1b25-402c-89a0-a08518a46a3f
2026-01-29 04:11:40,415 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.14 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.02 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.021/3.081/5.141/2.060 ms')
2026-01-29 04:11:40,415 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-35015850-18430632 passed
2026-01-29 04:11:40,488 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:11:40,488 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-35015850-18430632, IP 54.229.184.5, Port 22
2026-01-29 04:11:40,561 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-01-29 04:11:40,644 - DEBUG - VM ctest-TestBGPaasZone-35015850-18430632 is NOT ready for SSH connections, VM status: ACTIVE
2026-01-29 04:11:45,645 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:11:45,645 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-35015850-18430632, IP 54.229.184.5, Port 22
2026-01-29 04:11:45,813 - DEBUG - VM ctest-TestBGPaasZone-35015850-18430632 is ready for SSH connections
2026-01-29 04:11:45,946 - INFO - Created control node zone ctest-test-zone-26043393(f46f5274-283b-4d6f-a3b4-07d7999fe783)
2026-01-29 04:11:46,302 - INFO - Created control node zone ctest-test-zone-39245328(9076957f-b4c0-4d1a-9e72-01f407ee2132)
2026-01-29 04:11:46,662 - INFO - Created control node zone ctest-test-zone-31926377(510d5f1c-2b3d-4ae0-8aab-0c7b726df501)
2026-01-29 04:11:46,946 - INFO - Creating BGPaaS ctest-TestBGPaasZone-35015850-38494323
2026-01-29 04:11:47,022 - INFO - BGPaaS: ctest-TestBGPaasZone-35015850-38494323(892618dd-acd2-47d4-9122-1c48b06e6bbe)
2026-01-29 04:11:47,022 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/892618dd-acd2-47d4-9122-1c48b06e6bbe
2026-01-29 04:11:47,032 - INFO - verify_in_api_server passed for BGPaaS obj 892618dd-acd2-47d4-9122-1c48b06e6bbe
2026-01-29 04:11:47,032 - INFO - BGPaaS(892618dd-acd2-47d4-9122-1c48b06e6bbe): verify_on_setup passed
2026-01-29 04:11:47,032 - INFO - We will configure BGP on the VM
2026-01-29 04:11:47,454 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:11:47,454 - INFO - Configuring BGP on ctest-TestBGPaasZone-35015850-58469533
2026-01-29 04:11:47,454 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 54.229.184.3;
protocol bgp bgp_1{
local as 65000;
neighbor 54.229.184.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.3;
}
protocol bfd {
neighbor 54.229.184.1 local 54.229.184.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.128, gateway password: c0ntrail123
2026-01-29 04:11:47,454 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 54.229.184.3;
protocol bgp bgp_1{
local as 65000;
neighbor 54.229.184.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.3;
}
protocol bfd {
neighbor 54.229.184.1 local 54.229.184.3 multihop on;
}
EOS
2026-01-29 04:12:02,275 - DEBUG - None
2026-01-29 04:12:02,275 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 54.229.184.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.3;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.128, gateway password: c0ntrail123
2026-01-29 04:12:02,275 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 54.229.184.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.3;
}
EOS
2026-01-29 04:12:03,622 - DEBUG - None
2026-01-29 04:12:03,622 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.128, gateway password: c0ntrail123
2026-01-29 04:12:03,623 - DEBUG - service bird restart
2026-01-29 04:12:05,847 - DEBUG - bird stop/waiting
bird start/running, process 1435
2026-01-29 04:12:05,847 - INFO - Attaching VMI e5ab4125-7ea3-4fe4-a387-2f9632c7e8e8 to BGPaaS 892618dd-acd2-47d4-9122-1c48b06e6bbe
2026-01-29 04:12:05,934 - INFO - Attaching the VMI f17929fc-218c-40a6-a462-2b0f055742da to the BGPaaS 892618dd-acd2-47d4-9122-1c48b06e6bbe object
2026-01-29 04:12:05,934 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 54.229.184.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.128, gateway password: c0ntrail123
2026-01-29 04:12:05,934 - DEBUG - sudo ip addr add 54.229.184.20 dev eth0
2026-01-29 04:12:06,914 - DEBUG - None
2026-01-29 04:12:06,977 - INFO - Creating BGPaaS ctest-TestBGPaasZone-35015850-34830230
2026-01-29 04:12:07,054 - INFO - BGPaaS: ctest-TestBGPaasZone-35015850-34830230(a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8)
2026-01-29 04:12:07,054 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8
2026-01-29 04:12:07,063 - INFO - verify_in_api_server passed for BGPaaS obj a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8
2026-01-29 04:12:07,064 - INFO - BGPaaS(a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8): verify_on_setup passed
2026-01-29 04:12:07,064 - INFO - We will configure BGP on the VM
2026-01-29 04:12:07,530 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:07,530 - INFO - Configuring BGP on ctest-TestBGPaasZone-35015850-71348414
2026-01-29 04:12:07,530 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 54.229.184.4;
protocol bgp bgp_1{
local as 65000;
neighbor 54.229.184.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.4;
}
protocol bfd {
neighbor 54.229.184.1 local 54.229.184.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-01-29 04:12:07,530 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 54.229.184.4;
protocol bgp bgp_1{
local as 65000;
neighbor 54.229.184.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.4;
}
protocol bfd {
neighbor 54.229.184.1 local 54.229.184.4 multihop on;
}
EOS
2026-01-29 04:12:14,558 - DEBUG - None
2026-01-29 04:12:14,558 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 54.229.184.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.4;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-01-29 04:12:14,558 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 54.229.184.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 54.229.184.4;
}
EOS
2026-01-29 04:12:15,222 - DEBUG - None
2026-01-29 04:12:15,223 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-01-29 04:12:15,223 - DEBUG - service bird restart
2026-01-29 04:12:17,398 - DEBUG - bird stop/waiting
bird start/running, process 1446
2026-01-29 04:12:17,398 - INFO - Attaching VMI 460f139a-c739-40f3-87c9-64344f2532be to BGPaaS a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8
2026-01-29 04:12:17,482 - INFO - Attaching the VMI ef0d82d5-7b5f-4d8a-98b2-07caac291a9b to the BGPaaS a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8 object
2026-01-29 04:12:17,482 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 54.229.184.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-01-29 04:12:17,482 - DEBUG - sudo ip addr add 54.229.184.20 dev eth0
2026-01-29 04:12:18,349 - DEBUG - None
2026-01-29 04:12:18,349 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:18,349 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-01-29 04:12:18,363 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-01-29 04:12:18,364 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:18,379 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-01-29 04:12:18,385 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:18,385 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-01-29 04:12:18,397 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-01-29 04:12:24,398 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-01-29 04:12:24,411 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-01-29 04:12:30,412 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-01-29 04:12:30,424 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-01-29 04:12:30,425 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:30,439 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-01-29 04:12:30,446 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 54.229.184.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.128, gateway password: c0ntrail123
2026-01-29 04:12:30,447 - DEBUG - ping -s 56 -c 3 -W 1 54.229.184.20
2026-01-29 04:12:37,916 - DEBUG - PING 54.229.184.20 (54.229.184.20) 56(84) bytes of data.
64 bytes from 54.229.184.20: icmp_seq=1 ttl=64 time=8.85 ms
64 bytes from 54.229.184.20: icmp_seq=2 ttl=64 time=1.30 ms
64 bytes from 54.229.184.20: icmp_seq=3 ttl=64 time=1.36 ms
--- 54.229.184.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.301/3.839/8.857/3.548 ms
2026-01-29 04:12:37,916 - INFO - Ping to IP 54.229.184.20 from VM ctest-TestBGPaasZone-35015850-18430632 passed
2026-01-29 04:12:37,916 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:37,916 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-01-29 04:12:37,928 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-01-29 04:12:37,928 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:37,944 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-01-29 04:12:37,950 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:37,950 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-01-29 04:12:37,961 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-01-29 04:12:37,961 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-29 04:12:37,975 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-01-29 04:12:37,982 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 54.229.184.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.128, gateway password: c0ntrail123
2026-01-29 04:12:37,982 - DEBUG - ping -s 56 -c 3 -W 1 54.229.184.20
2026-01-29 04:12:40,592 - DEBUG - PING 54.229.184.20 (54.229.184.20) 56(84) bytes of data.
64 bytes from 54.229.184.20: icmp_seq=1 ttl=64 time=2.41 ms
64 bytes from 54.229.184.20: icmp_seq=2 ttl=64 time=1.07 ms
64 bytes from 54.229.184.20: icmp_seq=3 ttl=64 time=0.956 ms
--- 54.229.184.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.956/1.484/2.418/0.662 ms
2026-01-29 04:12:40,592 - INFO - Ping to IP 54.229.184.20 from VM ctest-TestBGPaasZone-35015850-18430632 passed
2026-01-29 04:12:40,592 - INFO - Detaching VMI 460f139a-c739-40f3-87c9-64344f2532be from BGPaaS a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8
2026-01-29 04:12:40,678 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-35015850-34830230(a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8)
2026-01-29 04:12:40,747 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8
2026-01-29 04:12:40,802 - DEBUG - Response Code: 404
2026-01-29 04:12:40,803 - DEBUG - BGPaaS: a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8 deleted from api server
2026-01-29 04:12:40,803 - INFO - BGPaaS(a08714e4-e3b1-4fb3-bc3e-19d5fa4b57f8): verify_on_cleanup passed
2026-01-29 04:12:40,803 - INFO - Detaching VMI e5ab4125-7ea3-4fe4-a387-2f9632c7e8e8 from BGPaaS 892618dd-acd2-47d4-9122-1c48b06e6bbe
2026-01-29 04:12:40,891 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-35015850-38494323(892618dd-acd2-47d4-9122-1c48b06e6bbe)
2026-01-29 04:12:40,960 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/892618dd-acd2-47d4-9122-1c48b06e6bbe
2026-01-29 04:12:40,967 - DEBUG - Response Code: 404
2026-01-29 04:12:40,967 - DEBUG - BGPaaS: 892618dd-acd2-47d4-9122-1c48b06e6bbe deleted from api server
2026-01-29 04:12:40,973 - INFO - BGPaaS(892618dd-acd2-47d4-9122-1c48b06e6bbe): verify_on_cleanup passed
2026-01-29 04:12:40,974 - INFO - Deleting Control node zone ctest-test-zone-31926377(510d5f1c-2b3d-4ae0-8aab-0c7b726df501)
2026-01-29 04:12:41,139 - INFO - Deleting Control node zone ctest-test-zone-39245328(9076957f-b4c0-4d1a-9e72-01f407ee2132)
2026-01-29 04:12:41,284 - INFO - Deleting Control node zone ctest-test-zone-26043393(f46f5274-283b-4d6f-a3b4-07d7999fe783)
2026-01-29 04:12:41,429 - INFO - Deleting VM ctest-TestBGPaasZone-35015850-18430632
2026-01-29 04:12:41,505 - INFO - Deleting VM ctest-TestBGPaasZone-35015850-71348414
2026-01-29 04:12:41,574 - INFO - Deleting VM ctest-TestBGPaasZone-35015850-58469533
2026-01-29 04:12:41,647 - INFO - Deleting VN ctest-cnz_vn-25989905
2026-01-29 04:12:41,701 - DEBUG - VN 576a2bf5-fe0f-4e08-9b32-3fa8fa850664 still in use: Unable to complete operation on network 576a2bf5-fe0f-4e08-9b32-3fa8fa850664. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-fb75aca3-5b60-4551-8a96-66488dd0eb3a']
2026-01-29 04:12:41,701 - WARNING - Deleting VN ctest-cnz_vn-25989905 failed..Will retry
2026-01-29 04:12:43,885 - DEBUG - Response for deleting network ()
2026-01-29 04:12:45,195 - DEBUG - Skipping xmpp flap check
2026-01-29 04:12:45,196 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:39]
2026-01-29 04:12:45,196 - INFO - --------------------------------------------------------------------------------
2026-01-29 04:12:45,979 - INFO - Deleted project: ctest-TestBGPaasZone-35015850, ID : 8d720a70-6bae-45f3-a000-f4a0227a4a04