is in ACTIVE state now
2026-02-12 04:01:19,382 - INFO - VM name : ctest-TestBGPaasZone-32291665-92385917
2026-02-12 04:01:19,458 - DEBUG - VM ctest-TestBGPaasZone-32291665-92385917 ID is 0f99bbd1-cbe8-4ff5-a06b-b87506606f65
2026-02-12 04:01:19,458 - DEBUG - VM ctest-TestBGPaasZone-32291665-92385917 launched on Node an-jenkins-deploy-platform-ansible-os-5305-1
2026-02-12 04:01:19,541 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/0f99bbd1-cbe8-4ff5-a06b-b87506606f65
2026-02-12 04:01:19,553 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/41075ef0-7fbb-43f3-8d21-9e036db74d31
2026-02-12 04:01:20,725 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.31 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.01 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.012/3.159/3.307/0.147 ms')
2026-02-12 04:01:20,725 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-32291665-92385917 passed
2026-02-12 04:01:20,795 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:20,795 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-32291665-92385917, IP 46.142.158.5, Port 22
2026-02-12 04:01:20,865 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-02-12 04:01:20,952 - DEBUG - VM ctest-TestBGPaasZone-32291665-92385917 is NOT ready for SSH connections, VM status: ACTIVE
2026-02-12 04:01:25,952 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:25,952 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-32291665-92385917, IP 46.142.158.5, Port 22
2026-02-12 04:01:26,011 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-02-12 04:01:26,088 - DEBUG - VM ctest-TestBGPaasZone-32291665-92385917 is NOT ready for SSH connections, VM status: ACTIVE
2026-02-12 04:01:31,089 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:31,089 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-32291665-92385917, IP 46.142.158.5, Port 22
2026-02-12 04:01:31,157 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-02-12 04:01:31,236 - DEBUG - VM ctest-TestBGPaasZone-32291665-92385917 is NOT ready for SSH connections, VM status: ACTIVE
2026-02-12 04:01:36,237 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:36,237 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-32291665-92385917, IP 46.142.158.5, Port 22
2026-02-12 04:01:36,408 - DEBUG - VM ctest-TestBGPaasZone-32291665-92385917 is ready for SSH connections
2026-02-12 04:01:36,537 - INFO - Created control node zone ctest-test-zone-04914131(f69c2374-c46d-40eb-a142-e3ede06ad0fa)
2026-02-12 04:01:36,873 - INFO - Created control node zone ctest-test-zone-65695564(56383da9-a0c7-483a-a4da-8821c6fdecec)
2026-02-12 04:01:37,217 - INFO - Created control node zone ctest-test-zone-39264580(390735c6-b26c-4e7d-af1d-fa6bd37ff4de)
2026-02-12 04:01:37,497 - INFO - Creating BGPaaS ctest-TestBGPaasZone-32291665-52329805
2026-02-12 04:01:37,573 - INFO - BGPaaS: ctest-TestBGPaasZone-32291665-52329805(9a3aa326-091e-472f-97e8-ed099604174c)
2026-02-12 04:01:37,573 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/9a3aa326-091e-472f-97e8-ed099604174c
2026-02-12 04:01:37,584 - INFO - verify_in_api_server passed for BGPaaS obj 9a3aa326-091e-472f-97e8-ed099604174c
2026-02-12 04:01:37,584 - INFO - BGPaaS(9a3aa326-091e-472f-97e8-ed099604174c): verify_on_setup passed
2026-02-12 04:01:37,584 - INFO - We will configure BGP on the VM
2026-02-12 04:01:38,013 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:38,013 - INFO - Configuring BGP on ctest-TestBGPaasZone-32291665-57259194
2026-02-12 04:01:38,013 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.142.158.3;
protocol bgp bgp_1{
local as 65000;
neighbor 46.142.158.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.3;
}
protocol bfd {
neighbor 46.142.158.1 local 46.142.158.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-02-12 04:01:38,013 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.142.158.3;
protocol bgp bgp_1{
local as 65000;
neighbor 46.142.158.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.3;
}
protocol bfd {
neighbor 46.142.158.1 local 46.142.158.3 multihop on;
}
EOS
2026-02-12 04:01:44,098 - DEBUG - None
2026-02-12 04:01:44,098 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.142.158.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.3;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-02-12 04:01:44,098 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.142.158.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.3;
}
EOS
2026-02-12 04:01:44,648 - DEBUG - None
2026-02-12 04:01:44,648 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-02-12 04:01:44,648 - DEBUG - service bird restart
2026-02-12 04:01:46,406 - DEBUG - bird stop/waiting
bird start/running, process 1434
2026-02-12 04:01:46,407 - INFO - Attaching VMI 3df755c8-8289-486b-ba2f-f4701aff97f4 to BGPaaS 9a3aa326-091e-472f-97e8-ed099604174c
2026-02-12 04:01:46,485 - INFO - Attaching the VMI 3b1f5016-3bda-4569-9837-d4d12c0c5fd3 to the BGPaaS 9a3aa326-091e-472f-97e8-ed099604174c object
2026-02-12 04:01:46,485 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 46.142.158.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-02-12 04:01:46,486 - DEBUG - sudo ip addr add 46.142.158.20 dev eth0
2026-02-12 04:01:47,219 - DEBUG - None
2026-02-12 04:01:47,285 - INFO - Creating BGPaaS ctest-TestBGPaasZone-32291665-80757199
2026-02-12 04:01:47,361 - INFO - BGPaaS: ctest-TestBGPaasZone-32291665-80757199(4d49d163-cc58-4f13-b1ca-b17c07ea4d2b)
2026-02-12 04:01:47,361 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/4d49d163-cc58-4f13-b1ca-b17c07ea4d2b
2026-02-12 04:01:47,372 - INFO - verify_in_api_server passed for BGPaaS obj 4d49d163-cc58-4f13-b1ca-b17c07ea4d2b
2026-02-12 04:01:47,373 - INFO - BGPaaS(4d49d163-cc58-4f13-b1ca-b17c07ea4d2b): verify_on_setup passed
2026-02-12 04:01:47,373 - INFO - We will configure BGP on the VM
2026-02-12 04:01:47,785 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:47,785 - INFO - Configuring BGP on ctest-TestBGPaasZone-32291665-14733044
2026-02-12 04:01:47,785 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.142.158.4;
protocol bgp bgp_1{
local as 65000;
neighbor 46.142.158.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.4;
}
protocol bfd {
neighbor 46.142.158.1 local 46.142.158.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-02-12 04:01:47,785 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.142.158.4;
protocol bgp bgp_1{
local as 65000;
neighbor 46.142.158.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.4;
}
protocol bfd {
neighbor 46.142.158.1 local 46.142.158.4 multihop on;
}
EOS
2026-02-12 04:01:53,996 - DEBUG - None
2026-02-12 04:01:53,996 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.142.158.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.4;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-02-12 04:01:53,996 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.142.158.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.142.158.4;
}
EOS
2026-02-12 04:01:54,532 - DEBUG - None
2026-02-12 04:01:54,532 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-02-12 04:01:54,532 - DEBUG - service bird restart
2026-02-12 04:01:56,178 - DEBUG - bird stop/waiting
bird start/running, process 1441
2026-02-12 04:01:56,178 - INFO - Attaching VMI 3eccbdf4-0d3b-45ac-8e4e-173b10208344 to BGPaaS 4d49d163-cc58-4f13-b1ca-b17c07ea4d2b
2026-02-12 04:01:56,257 - INFO - Attaching the VMI 5a437f97-d57b-4b10-bebc-1936d8c3c40f to the BGPaaS 4d49d163-cc58-4f13-b1ca-b17c07ea4d2b object
2026-02-12 04:01:56,257 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 46.142.158.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-02-12 04:01:56,257 - DEBUG - sudo ip addr add 46.142.158.20 dev eth0
2026-02-12 04:01:56,876 - DEBUG - None
2026-02-12 04:01:56,876 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:56,876 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-12 04:01:56,888 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-02-12 04:01:56,888 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:56,907 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-12 04:01:56,914 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:01:56,914 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-12 04:01:56,927 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-02-12 04:02:02,927 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-12 04:02:02,947 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-02-12 04:02:02,953 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:02:02,974 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-12 04:02:02,980 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 46.142.158.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-02-12 04:02:02,980 - DEBUG - ping -s 56 -c 3 -W 1 46.142.158.20
2026-02-12 04:02:09,167 - DEBUG - PING 46.142.158.20 (46.142.158.20) 56(84) bytes of data.
64 bytes from 46.142.158.20: icmp_seq=1 ttl=64 time=8.10 ms
64 bytes from 46.142.158.20: icmp_seq=2 ttl=64 time=1.33 ms
64 bytes from 46.142.158.20: icmp_seq=3 ttl=64 time=1.83 ms
--- 46.142.158.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.330/3.755/8.104/3.082 ms
2026-02-12 04:02:09,167 - INFO - Ping to IP 46.142.158.20 from VM ctest-TestBGPaasZone-32291665-92385917 passed
2026-02-12 04:02:09,168 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:02:09,168 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-12 04:02:09,180 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-02-12 04:02:09,181 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:02:09,197 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-12 04:02:09,202 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:02:09,203 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-12 04:02:09,215 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-02-12 04:02:09,216 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-12 04:02:09,232 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-12 04:02:09,238 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 46.142.158.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-02-12 04:02:09,238 - DEBUG - ping -s 56 -c 3 -W 1 46.142.158.20
2026-02-12 04:02:11,713 - DEBUG - PING 46.142.158.20 (46.142.158.20) 56(84) bytes of data.
64 bytes from 46.142.158.20: icmp_seq=1 ttl=64 time=4.65 ms
64 bytes from 46.142.158.20: icmp_seq=2 ttl=64 time=0.999 ms
64 bytes from 46.142.158.20: icmp_seq=3 ttl=64 time=0.911 ms
--- 46.142.158.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.911/2.189/4.658/1.746 ms
2026-02-12 04:02:11,713 - INFO - Ping to IP 46.142.158.20 from VM ctest-TestBGPaasZone-32291665-92385917 passed
2026-02-12 04:02:11,714 - INFO - Detaching VMI 3eccbdf4-0d3b-45ac-8e4e-173b10208344 from BGPaaS 4d49d163-cc58-4f13-b1ca-b17c07ea4d2b
2026-02-12 04:02:11,801 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-32291665-80757199(4d49d163-cc58-4f13-b1ca-b17c07ea4d2b)
2026-02-12 04:02:11,879 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/4d49d163-cc58-4f13-b1ca-b17c07ea4d2b
2026-02-12 04:02:11,885 - DEBUG - Response Code: 404
2026-02-12 04:02:11,885 - DEBUG - BGPaaS: 4d49d163-cc58-4f13-b1ca-b17c07ea4d2b deleted from api server
2026-02-12 04:02:11,885 - INFO - BGPaaS(4d49d163-cc58-4f13-b1ca-b17c07ea4d2b): verify_on_cleanup passed
2026-02-12 04:02:11,885 - INFO - Detaching VMI 3df755c8-8289-486b-ba2f-f4701aff97f4 from BGPaaS 9a3aa326-091e-472f-97e8-ed099604174c
2026-02-12 04:02:11,993 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-32291665-52329805(9a3aa326-091e-472f-97e8-ed099604174c)
2026-02-12 04:02:12,085 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/9a3aa326-091e-472f-97e8-ed099604174c
2026-02-12 04:02:12,095 - DEBUG - Response Code: 404
2026-02-12 04:02:12,095 - DEBUG - BGPaaS: 9a3aa326-091e-472f-97e8-ed099604174c deleted from api server
2026-02-12 04:02:12,095 - INFO - BGPaaS(9a3aa326-091e-472f-97e8-ed099604174c): verify_on_cleanup passed
2026-02-12 04:02:12,095 - INFO - Deleting Control node zone ctest-test-zone-39264580(390735c6-b26c-4e7d-af1d-fa6bd37ff4de)
2026-02-12 04:02:12,241 - INFO - Deleting Control node zone ctest-test-zone-65695564(56383da9-a0c7-483a-a4da-8821c6fdecec)
2026-02-12 04:02:12,396 - INFO - Deleting Control node zone ctest-test-zone-04914131(f69c2374-c46d-40eb-a142-e3ede06ad0fa)
2026-02-12 04:02:12,544 - INFO - Deleting VM ctest-TestBGPaasZone-32291665-92385917
2026-02-12 04:02:12,614 - INFO - Deleting VM ctest-TestBGPaasZone-32291665-14733044
2026-02-12 04:02:12,683 - INFO - Deleting VM ctest-TestBGPaasZone-32291665-57259194
2026-02-12 04:02:12,750 - INFO - Deleting VN ctest-cnz_vn-56357571
2026-02-12 04:02:12,797 - DEBUG - VN 6920a723-fc6c-49d1-804d-8937fe77507a still in use: Unable to complete operation on network 6920a723-fc6c-49d1-804d-8937fe77507a. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-04fc1bee-0a47-4366-a55c-2c27418e1dc7']
2026-02-12 04:02:12,797 - WARNING - Deleting VN ctest-cnz_vn-56357571 failed..Will retry
2026-02-12 04:02:15,050 - DEBUG - Response for deleting network ()
2026-02-12 04:02:16,309 - DEBUG - Skipping xmpp flap check
2026-02-12 04:02:16,309 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:03]
2026-02-12 04:02:16,309 - INFO - --------------------------------------------------------------------------------
2026-02-12 04:02:17,069 - INFO - Deleted project: ctest-TestBGPaasZone-32291665, ID : a1c39593-bedf-4303-bc81-8c84d63b02de