is in ACTIVE state now
2026-03-26 04:05:55,048 - INFO - VM name : ctest-TestBGPaasZone-12471823-23835713
2026-03-26 04:05:55,141 - DEBUG - VM ctest-TestBGPaasZone-12471823-23835713 ID is 52b221fc-c38f-4c91-a0ad-1e3a68687961
2026-03-26 04:05:55,141 - DEBUG - VM ctest-TestBGPaasZone-12471823-23835713 launched on Node an-jenkins-deploy-platform-ansible-os-5545-1
2026-03-26 04:05:55,236 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/52b221fc-c38f-4c91-a0ad-1e3a68687961
2026-03-26 04:05:55,247 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/9b0467f3-1c9a-43b7-a01c-a94e928da0ae
2026-03-26 04:05:56,414 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=4.23 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.424 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.424/2.328/4.233/1.904 ms')
2026-03-26 04:05:56,415 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-TestBGPaasZone-12471823-23835713 passed
2026-03-26 04:05:56,489 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:05:56,489 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12471823-23835713, IP 124.102.53.133, Port 22
2026-03-26 04:05:56,559 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-26 04:05:56,649 - DEBUG - VM ctest-TestBGPaasZone-12471823-23835713 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-26 04:06:01,650 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:01,650 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-12471823-23835713, IP 124.102.53.133, Port 22
2026-03-26 04:06:01,831 - DEBUG - VM ctest-TestBGPaasZone-12471823-23835713 is ready for SSH connections
2026-03-26 04:06:01,975 - INFO - Created control node zone ctest-test-zone-81809471(2cbaa946-cec7-44a4-a320-ce0acb58d749)
2026-03-26 04:06:02,335 - INFO - Created control node zone ctest-test-zone-79969453(f7aa2a78-3fd6-4543-ba1f-a39db0b743d1)
2026-03-26 04:06:02,723 - INFO - Created control node zone ctest-test-zone-42115597(723f6b8e-1dc5-4694-affe-446c81bf509d)
2026-03-26 04:06:03,023 - INFO - Creating BGPaaS ctest-TestBGPaasZone-12471823-15687778
2026-03-26 04:06:03,115 - INFO - BGPaaS: ctest-TestBGPaasZone-12471823-15687778(dac72c20-01e9-4104-bc25-492c5997ef1e)
2026-03-26 04:06:03,115 - DEBUG - Requesting: http://10.0.0.240:8082/bgp-as-a-service/dac72c20-01e9-4104-bc25-492c5997ef1e
2026-03-26 04:06:03,127 - INFO - verify_in_api_server passed for BGPaaS obj dac72c20-01e9-4104-bc25-492c5997ef1e
2026-03-26 04:06:03,127 - INFO - BGPaaS(dac72c20-01e9-4104-bc25-492c5997ef1e): verify_on_setup passed
2026-03-26 04:06:03,127 - INFO - We will configure BGP on the VM
2026-03-26 04:06:03,587 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:03,588 - INFO - Configuring BGP on ctest-TestBGPaasZone-12471823-08306120
2026-03-26 04:06:03,588 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 124.102.53.131;
protocol bgp bgp_1{
local as 65000;
neighbor 124.102.53.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.131;
}
protocol bfd {
neighbor 124.102.53.129 local 124.102.53.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2026-03-26 04:06:03,588 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 124.102.53.131;
protocol bgp bgp_1{
local as 65000;
neighbor 124.102.53.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.131;
}
protocol bfd {
neighbor 124.102.53.129 local 124.102.53.131 multihop on;
}
EOS
2026-03-26 04:06:14,759 - DEBUG - None
2026-03-26 04:06:14,759 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 124.102.53.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.131;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2026-03-26 04:06:14,759 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 124.102.53.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.131;
}
EOS
2026-03-26 04:06:15,295 - DEBUG - None
2026-03-26 04:06:15,295 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2026-03-26 04:06:15,295 - DEBUG - service bird restart
2026-03-26 04:06:17,501 - DEBUG - bird stop/waiting
bird start/running, process 1445
2026-03-26 04:06:17,501 - INFO - Attaching VMI 99728302-728d-4ba6-815d-c3d4b7d0876a to BGPaaS dac72c20-01e9-4104-bc25-492c5997ef1e
2026-03-26 04:06:17,579 - INFO - Attaching the VMI c1439276-d214-42d7-88ed-3d94dcf49e1c to the BGPaaS dac72c20-01e9-4104-bc25-492c5997ef1e object
2026-03-26 04:06:17,579 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 124.102.53.148 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2026-03-26 04:06:17,579 - DEBUG - sudo ip addr add 124.102.53.148 dev eth0
2026-03-26 04:06:18,308 - DEBUG - None
2026-03-26 04:06:18,375 - INFO - Creating BGPaaS ctest-TestBGPaasZone-12471823-82291733
2026-03-26 04:06:18,455 - INFO - BGPaaS: ctest-TestBGPaasZone-12471823-82291733(8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d)
2026-03-26 04:06:18,455 - DEBUG - Requesting: http://10.0.0.240:8082/bgp-as-a-service/8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d
2026-03-26 04:06:18,469 - INFO - verify_in_api_server passed for BGPaaS obj 8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d
2026-03-26 04:06:18,470 - INFO - BGPaaS(8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d): verify_on_setup passed
2026-03-26 04:06:18,470 - INFO - We will configure BGP on the VM
2026-03-26 04:06:18,923 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:18,923 - INFO - Configuring BGP on ctest-TestBGPaasZone-12471823-99359018
2026-03-26 04:06:18,923 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 124.102.53.132;
protocol bgp bgp_1{
local as 65000;
neighbor 124.102.53.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.132;
}
protocol bfd {
neighbor 124.102.53.129 local 124.102.53.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-26 04:06:18,923 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 124.102.53.132;
protocol bgp bgp_1{
local as 65000;
neighbor 124.102.53.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.132;
}
protocol bfd {
neighbor 124.102.53.129 local 124.102.53.132 multihop on;
}
EOS
2026-03-26 04:06:26,473 - DEBUG - None
2026-03-26 04:06:26,473 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 124.102.53.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.132;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-26 04:06:26,473 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 124.102.53.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 124.102.53.132;
}
EOS
2026-03-26 04:06:26,973 - DEBUG - None
2026-03-26 04:06:26,973 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-26 04:06:26,973 - DEBUG - service bird restart
2026-03-26 04:06:28,603 - DEBUG - bird stop/waiting
bird start/running, process 1443
2026-03-26 04:06:28,603 - INFO - Attaching VMI 3f622498-332f-4b23-908a-ee9242b30118 to BGPaaS 8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d
2026-03-26 04:06:28,679 - INFO - Attaching the VMI 8a1b6c12-0009-4dc8-85da-a02bff562006 to the BGPaaS 8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d object
2026-03-26 04:06:28,679 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 124.102.53.148 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-26 04:06:28,680 - DEBUG - sudo ip addr add 124.102.53.148 dev eth0
2026-03-26 04:06:29,303 - DEBUG - None
2026-03-26 04:06:29,304 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:29,304 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-26 04:06:29,318 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-26 04:06:29,319 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:29,340 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-03-26 04:06:29,347 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:29,347 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-26 04:06:29,364 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2026-03-26 04:06:35,364 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-26 04:06:35,382 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2026-03-26 04:06:41,383 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-26 04:06:41,400 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-26 04:06:41,400 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:41,416 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-03-26 04:06:41,422 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 124.102.53.148, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2026-03-26 04:06:41,422 - DEBUG - ping -s 56 -c 3 -W 1 124.102.53.148
2026-03-26 04:06:48,736 - DEBUG - PING 124.102.53.148 (124.102.53.148) 56(84) bytes of data.
64 bytes from 124.102.53.148: icmp_seq=1 ttl=64 time=8.50 ms
64 bytes from 124.102.53.148: icmp_seq=2 ttl=64 time=1.74 ms
64 bytes from 124.102.53.148: icmp_seq=3 ttl=64 time=1.34 ms
--- 124.102.53.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2006ms
rtt min/avg/max/mdev = 1.341/3.861/8.500/3.284 ms
2026-03-26 04:06:48,736 - INFO - Ping to IP 124.102.53.148 from VM ctest-TestBGPaasZone-12471823-23835713 passed
2026-03-26 04:06:48,736 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:48,736 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-26 04:06:48,754 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-26 04:06:48,754 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:48,771 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-03-26 04:06:48,778 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:48,778 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-26 04:06:48,795 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-03-26 04:06:48,796 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-26 04:06:48,814 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-03-26 04:06:48,824 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 124.102.53.148, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2026-03-26 04:06:48,825 - DEBUG - ping -s 56 -c 3 -W 1 124.102.53.148
2026-03-26 04:06:51,342 - DEBUG - PING 124.102.53.148 (124.102.53.148) 56(84) bytes of data.
64 bytes from 124.102.53.148: icmp_seq=1 ttl=64 time=4.19 ms
64 bytes from 124.102.53.148: icmp_seq=2 ttl=64 time=1.49 ms
64 bytes from 124.102.53.148: icmp_seq=3 ttl=64 time=0.924 ms
--- 124.102.53.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.924/2.204/4.198/1.429 ms
2026-03-26 04:06:51,342 - INFO - Ping to IP 124.102.53.148 from VM ctest-TestBGPaasZone-12471823-23835713 passed
2026-03-26 04:06:51,343 - INFO - Detaching VMI 3f622498-332f-4b23-908a-ee9242b30118 from BGPaaS 8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d
2026-03-26 04:06:51,431 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-12471823-82291733(8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d)
2026-03-26 04:06:51,496 - DEBUG - Requesting: http://10.0.0.240:8082/bgp-as-a-service/8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d
2026-03-26 04:06:51,509 - DEBUG - Response Code: 404
2026-03-26 04:06:51,509 - DEBUG - BGPaaS: 8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d deleted from api server
2026-03-26 04:06:51,509 - INFO - BGPaaS(8574b0cd-58dc-41ff-b45f-8b82bbb5dc4d): verify_on_cleanup passed
2026-03-26 04:06:51,509 - INFO - Detaching VMI 99728302-728d-4ba6-815d-c3d4b7d0876a from BGPaaS dac72c20-01e9-4104-bc25-492c5997ef1e
2026-03-26 04:06:51,622 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-12471823-15687778(dac72c20-01e9-4104-bc25-492c5997ef1e)
2026-03-26 04:06:51,706 - DEBUG - Requesting: http://10.0.0.240:8082/bgp-as-a-service/dac72c20-01e9-4104-bc25-492c5997ef1e
2026-03-26 04:06:51,727 - DEBUG - Response Code: 404
2026-03-26 04:06:51,727 - DEBUG - BGPaaS: dac72c20-01e9-4104-bc25-492c5997ef1e deleted from api server
2026-03-26 04:06:51,727 - INFO - BGPaaS(dac72c20-01e9-4104-bc25-492c5997ef1e): verify_on_cleanup passed
2026-03-26 04:06:51,727 - INFO - Deleting Control node zone ctest-test-zone-42115597(723f6b8e-1dc5-4694-affe-446c81bf509d)
2026-03-26 04:06:51,882 - INFO - Deleting Control node zone ctest-test-zone-79969453(f7aa2a78-3fd6-4543-ba1f-a39db0b743d1)
2026-03-26 04:06:52,032 - INFO - Deleting Control node zone ctest-test-zone-81809471(2cbaa946-cec7-44a4-a320-ce0acb58d749)
2026-03-26 04:06:52,177 - INFO - Deleting VM ctest-TestBGPaasZone-12471823-23835713
2026-03-26 04:06:52,256 - INFO - Deleting VM ctest-TestBGPaasZone-12471823-99359018
2026-03-26 04:06:52,331 - INFO - Deleting VM ctest-TestBGPaasZone-12471823-08306120
2026-03-26 04:06:52,405 - INFO - Deleting VN ctest-cnz_vn-41282124
2026-03-26 04:06:52,453 - DEBUG - VN 4aea6788-6fca-4ff5-b4a2-f52dca503ec4 still in use: Unable to complete operation on network 4aea6788-6fca-4ff5-b4a2-f52dca503ec4. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-113d4003-db7f-4b95-9d68-f81b13e22125']
2026-03-26 04:06:52,453 - WARNING - Deleting VN ctest-cnz_vn-41282124 failed..Will retry
2026-03-26 04:06:54,652 - DEBUG - Response for deleting network ()
2026-03-26 04:06:55,940 - DEBUG - Skipping xmpp flap check
2026-03-26 04:06:55,940 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:20]
2026-03-26 04:06:55,940 - INFO - --------------------------------------------------------------------------------
2026-03-26 04:06:56,753 - INFO - Deleted project: ctest-TestBGPaasZone-12471823, ID : e1399bf2-ad07-4adf-9180-accf11228730