is in ACTIVE state now
2026-06-19 15:49:03,659 - INFO - VM name : ctest-TestBGPaasZone-35962036-84562730
2026-06-19 15:49:03,750 - DEBUG - VM ctest-TestBGPaasZone-35962036-84562730 ID is 3eaa1479-b08b-475c-b63b-3533540a88c5
2026-06-19 15:49:03,751 - DEBUG - VM ctest-TestBGPaasZone-35962036-84562730 launched on Node an-jenkins-deploy-platform-ansible-os-5994-2
2026-06-19 15:49:03,846 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/3eaa1479-b08b-475c-b63b-3533540a88c5
2026-06-19 15:49:03,856 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/29cfdbb8-b2ee-4cd9-b2ee-30e6cabc06e2
2026-06-19 15:49:05,017 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.51 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.904 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.904/2.208/3.512/1.304 ms')
2026-06-19 15:49:05,018 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-35962036-84562730 passed
2026-06-19 15:49:05,087 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:05,087 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-35962036-84562730, IP 143.202.25.133, Port 22
2026-06-19 15:49:05,145 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-19 15:49:05,214 - DEBUG - VM ctest-TestBGPaasZone-35962036-84562730 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-19 15:49:10,215 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:10,215 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-35962036-84562730, IP 143.202.25.133, Port 22
2026-06-19 15:49:10,294 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-19 15:49:10,398 - DEBUG - VM ctest-TestBGPaasZone-35962036-84562730 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-19 15:49:15,399 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:15,399 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-35962036-84562730, IP 143.202.25.133, Port 22
2026-06-19 15:49:15,557 - DEBUG - VM ctest-TestBGPaasZone-35962036-84562730 is ready for SSH connections
2026-06-19 15:49:15,712 - INFO - Created control node zone ctest-test-zone-58215677(e5fd8c5c-7bca-4fd1-831a-da4a53f20e3c)
2026-06-19 15:49:16,056 - INFO - Created control node zone ctest-test-zone-03294920(b5aa3179-9a48-4163-a36e-bd2264d31a92)
2026-06-19 15:49:16,404 - INFO - Created control node zone ctest-test-zone-27448924(7b031f79-608c-4bb8-9ee2-4ee070459e6c)
2026-06-19 15:49:16,684 - INFO - Creating BGPaaS ctest-TestBGPaasZone-35962036-57142530
2026-06-19 15:49:16,756 - INFO - BGPaaS: ctest-TestBGPaasZone-35962036-57142530(c5f15aed-3f15-43bd-8179-a57b0219b09b)
2026-06-19 15:49:16,757 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/c5f15aed-3f15-43bd-8179-a57b0219b09b
2026-06-19 15:49:16,769 - INFO - verify_in_api_server passed for BGPaaS obj c5f15aed-3f15-43bd-8179-a57b0219b09b
2026-06-19 15:49:16,769 - INFO - BGPaaS(c5f15aed-3f15-43bd-8179-a57b0219b09b): verify_on_setup passed
2026-06-19 15:49:16,769 - INFO - We will configure BGP on the VM
2026-06-19 15:49:17,188 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:17,188 - INFO - Configuring BGP on ctest-TestBGPaasZone-35962036-86153201
2026-06-19 15:49:17,188 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 143.202.25.131;
protocol bgp bgp_1{
local as 65000;
neighbor 143.202.25.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.131;
}
protocol bfd {
neighbor 143.202.25.129 local 143.202.25.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-19 15:49:17,188 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 143.202.25.131;
protocol bgp bgp_1{
local as 65000;
neighbor 143.202.25.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.131;
}
protocol bfd {
neighbor 143.202.25.129 local 143.202.25.131 multihop on;
}
EOS
2026-06-19 15:49:22,418 - DEBUG - None
2026-06-19 15:49:22,418 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 143.202.25.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-19 15:49:22,418 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 143.202.25.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.131;
}
EOS
2026-06-19 15:49:22,677 - DEBUG - None
2026-06-19 15:49:22,677 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-19 15:49:22,677 - DEBUG - service bird restart
2026-06-19 15:49:23,471 - DEBUG - bird stop/waiting
bird start/running, process 1433
2026-06-19 15:49:23,471 - INFO - Attaching VMI 76682e6e-d056-436d-9c26-967a3d1879ec to BGPaaS c5f15aed-3f15-43bd-8179-a57b0219b09b
2026-06-19 15:49:23,548 - INFO - Attaching the VMI a24a204c-fef4-46c1-aee3-4a468d3891fa to the BGPaaS c5f15aed-3f15-43bd-8179-a57b0219b09b object
2026-06-19 15:49:23,548 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 143.202.25.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-19 15:49:23,549 - DEBUG - sudo ip addr add 143.202.25.148 dev eth0
2026-06-19 15:49:23,898 - DEBUG - None
2026-06-19 15:49:23,960 - INFO - Creating BGPaaS ctest-TestBGPaasZone-35962036-75522784
2026-06-19 15:49:24,032 - INFO - BGPaaS: ctest-TestBGPaasZone-35962036-75522784(ba41b95c-bf80-4169-b4fc-ec4d2420db61)
2026-06-19 15:49:24,032 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/ba41b95c-bf80-4169-b4fc-ec4d2420db61
2026-06-19 15:49:24,042 - INFO - verify_in_api_server passed for BGPaaS obj ba41b95c-bf80-4169-b4fc-ec4d2420db61
2026-06-19 15:49:24,042 - INFO - BGPaaS(ba41b95c-bf80-4169-b4fc-ec4d2420db61): verify_on_setup passed
2026-06-19 15:49:24,042 - INFO - We will configure BGP on the VM
2026-06-19 15:49:24,456 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:24,456 - INFO - Configuring BGP on ctest-TestBGPaasZone-35962036-75889603
2026-06-19 15:49:24,456 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 143.202.25.132;
protocol bgp bgp_1{
local as 65000;
neighbor 143.202.25.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.132;
}
protocol bfd {
neighbor 143.202.25.129 local 143.202.25.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-06-19 15:49:24,456 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 143.202.25.132;
protocol bgp bgp_1{
local as 65000;
neighbor 143.202.25.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.132;
}
protocol bfd {
neighbor 143.202.25.129 local 143.202.25.132 multihop on;
}
EOS
2026-06-19 15:49:29,411 - DEBUG - None
2026-06-19 15:49:29,411 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 143.202.25.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-06-19 15:49:29,411 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 143.202.25.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 143.202.25.132;
}
EOS
2026-06-19 15:49:29,678 - DEBUG - None
2026-06-19 15:49:29,678 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-06-19 15:49:29,678 - DEBUG - service bird restart
2026-06-19 15:49:30,453 - DEBUG - bird stop/waiting
bird start/running, process 1479
2026-06-19 15:49:30,453 - INFO - Attaching VMI 3e004b47-5d59-4d68-8a79-85abd3de6c50 to BGPaaS ba41b95c-bf80-4169-b4fc-ec4d2420db61
2026-06-19 15:49:30,532 - INFO - Attaching the VMI 7f4e4e99-26fa-4db1-aa34-e9305244e680 to the BGPaaS ba41b95c-bf80-4169-b4fc-ec4d2420db61 object
2026-06-19 15:49:30,532 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 143.202.25.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-06-19 15:49:30,532 - DEBUG - sudo ip addr add 143.202.25.148 dev eth0
2026-06-19 15:49:30,830 - DEBUG - None
2026-06-19 15:49:30,831 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:30,831 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-19 15:49:30,843 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14']
2026-06-19 15:49:36,844 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-19 15:49:36,861 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-19 15:49:36,861 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:36,877 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-06-19 15:49:36,885 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:36,885 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-19 15:49:36,901 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-19 15:49:36,901 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:36,918 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-06-19 15:49:42,937 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-06-19 15:49:42,942 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 143.202.25.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-19 15:49:42,942 - DEBUG - ping -s 56 -c 3 -W 1 143.202.25.148
2026-06-19 15:49:46,920 - DEBUG - PING 143.202.25.148 (143.202.25.148) 56(84) bytes of data.
64 bytes from 143.202.25.148: icmp_seq=1 ttl=64 time=3.95 ms
64 bytes from 143.202.25.148: icmp_seq=2 ttl=64 time=1.32 ms
64 bytes from 143.202.25.148: icmp_seq=3 ttl=64 time=0.809 ms
--- 143.202.25.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.809/2.029/3.951/1.376 ms
2026-06-19 15:49:46,920 - INFO - Ping to IP 143.202.25.148 from VM ctest-TestBGPaasZone-35962036-84562730 passed
2026-06-19 15:49:46,920 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:46,921 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-19 15:49:46,932 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-19 15:49:46,932 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:46,947 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-06-19 15:49:46,953 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:46,953 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-19 15:49:46,963 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-19 15:49:46,963 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 15:49:46,981 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-06-19 15:49:46,988 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 143.202.25.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-19 15:49:46,988 - DEBUG - ping -s 56 -c 3 -W 1 143.202.25.148
2026-06-19 15:49:49,247 - DEBUG - PING 143.202.25.148 (143.202.25.148) 56(84) bytes of data.
64 bytes from 143.202.25.148: icmp_seq=1 ttl=64 time=2.30 ms
64 bytes from 143.202.25.148: icmp_seq=2 ttl=64 time=1.00 ms
64 bytes from 143.202.25.148: icmp_seq=3 ttl=64 time=1.22 ms
--- 143.202.25.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.009/1.513/2.306/0.567 ms
2026-06-19 15:49:49,247 - INFO - Ping to IP 143.202.25.148 from VM ctest-TestBGPaasZone-35962036-84562730 passed
2026-06-19 15:49:49,247 - INFO - Detaching VMI 3e004b47-5d59-4d68-8a79-85abd3de6c50 from BGPaaS ba41b95c-bf80-4169-b4fc-ec4d2420db61
2026-06-19 15:49:49,326 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-35962036-75522784(ba41b95c-bf80-4169-b4fc-ec4d2420db61)
2026-06-19 15:49:49,387 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/ba41b95c-bf80-4169-b4fc-ec4d2420db61
2026-06-19 15:49:49,400 - DEBUG - Response Code: 404
2026-06-19 15:49:49,400 - DEBUG - BGPaaS: ba41b95c-bf80-4169-b4fc-ec4d2420db61 deleted from api server
2026-06-19 15:49:49,400 - INFO - BGPaaS(ba41b95c-bf80-4169-b4fc-ec4d2420db61): verify_on_cleanup passed
2026-06-19 15:49:49,400 - INFO - Detaching VMI 76682e6e-d056-436d-9c26-967a3d1879ec from BGPaaS c5f15aed-3f15-43bd-8179-a57b0219b09b
2026-06-19 15:49:49,500 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-35962036-57142530(c5f15aed-3f15-43bd-8179-a57b0219b09b)
2026-06-19 15:49:49,602 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/c5f15aed-3f15-43bd-8179-a57b0219b09b
2026-06-19 15:49:49,612 - DEBUG - Response Code: 404
2026-06-19 15:49:49,612 - DEBUG - BGPaaS: c5f15aed-3f15-43bd-8179-a57b0219b09b deleted from api server
2026-06-19 15:49:49,612 - INFO - BGPaaS(c5f15aed-3f15-43bd-8179-a57b0219b09b): verify_on_cleanup passed
2026-06-19 15:49:49,612 - INFO - Deleting Control node zone ctest-test-zone-27448924(7b031f79-608c-4bb8-9ee2-4ee070459e6c)
2026-06-19 15:49:49,765 - INFO - Deleting Control node zone ctest-test-zone-03294920(b5aa3179-9a48-4163-a36e-bd2264d31a92)
2026-06-19 15:49:49,909 - INFO - Deleting Control node zone ctest-test-zone-58215677(e5fd8c5c-7bca-4fd1-831a-da4a53f20e3c)
2026-06-19 15:49:50,059 - INFO - Deleting VM ctest-TestBGPaasZone-35962036-84562730
2026-06-19 15:49:50,128 - INFO - Deleting VM ctest-TestBGPaasZone-35962036-75889603
2026-06-19 15:49:50,214 - INFO - Deleting VM ctest-TestBGPaasZone-35962036-86153201
2026-06-19 15:49:50,293 - INFO - Deleting VN ctest-cnz_vn-58270681
2026-06-19 15:49:50,331 - DEBUG - VN 2462f11a-1004-46f5-b2d6-bfafc66b0338 still in use: Unable to complete operation on network 2462f11a-1004-46f5-b2d6-bfafc66b0338. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-48555e1c-e591-4d9e-bea9-f4bca7fcf7d6']
2026-06-19 15:49:50,331 - WARNING - Deleting VN ctest-cnz_vn-58270681 failed..Will retry
2026-06-19 15:49:52,397 - DEBUG - VN 2462f11a-1004-46f5-b2d6-bfafc66b0338 still in use: Unable to complete operation on network 2462f11a-1004-46f5-b2d6-bfafc66b0338. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d3da9e91-e0e0-4817-bf09-9acdadc78d3d']
2026-06-19 15:49:52,397 - WARNING - Deleting VN ctest-cnz_vn-58270681 failed..Will retry
2026-06-19 15:49:54,560 - DEBUG - Response for deleting network ()
2026-06-19 15:49:55,817 - DEBUG - Skipping xmpp flap check
2026-06-19 15:49:55,817 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:27]
2026-06-19 15:49:55,818 - INFO - --------------------------------------------------------------------------------
2026-06-19 15:49:56,666 - INFO - Deleted project: ctest-TestBGPaasZone-35962036, ID : ede262f2-d68c-4c6c-a102-ec4307610c8a