is in ACTIVE state now
2025-11-13 04:00:14,891 - INFO - VM name : ctest-TestBGPaasZone-31857541-47000224
2025-11-13 04:00:14,986 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 ID is 0aad2ac3-2e50-4a84-b8b2-1d73db02201a
2025-11-13 04:00:14,987 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 launched on Node an-jenkins-deploy-platform-ansible-os-4712-1
2025-11-13 04:00:15,085 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/0aad2ac3-2e50-4a84-b8b2-1d73db02201a
2025-11-13 04:00:15,095 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/da1c2848-14e9-4634-9a3d-a015b381c0f0
2025-11-13 04:00:16,258 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.78 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.22 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.220/2.498/3.777/1.278 ms')
2025-11-13 04:00:16,259 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-31857541-47000224 passed
2025-11-13 04:00:16,329 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:00:16,329 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-47000224, IP 170.240.88.197, Port 22
2025-11-13 04:00:16,393 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-11-13 04:00:16,473 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 is NOT ready for SSH connections, VM status: ACTIVE
2025-11-13 04:00:21,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:00:21,475 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-47000224, IP 170.240.88.197, Port 22
2025-11-13 04:00:21,654 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 is ready for SSH connections
2025-11-13 04:00:21,791 - INFO - Created control node zone ctest-test-zone-36642010(e8e24bbe-ca20-4f80-a545-1f3d9b65d2a6)
2025-11-13 04:00:22,139 - INFO - Created control node zone ctest-test-zone-48483464(4596ff33-4de6-4342-b616-772f2d3dde83)
2025-11-13 04:00:22,495 - INFO - Created control node zone ctest-test-zone-05123442(5ffe7f84-4af0-4f7b-a723-991624bf7a4a)
2025-11-13 04:00:22,787 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31857541-89080620
2025-11-13 04:00:22,859 - INFO - BGPaaS: ctest-TestBGPaasZone-31857541-89080620(08dfa57e-44cf-4533-9564-634d0a07a553)
2025-11-13 04:00:22,860 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/08dfa57e-44cf-4533-9564-634d0a07a553
2025-11-13 04:00:22,871 - INFO - verify_in_api_server passed for BGPaaS obj 08dfa57e-44cf-4533-9564-634d0a07a553
2025-11-13 04:00:22,871 - INFO - BGPaaS(08dfa57e-44cf-4533-9564-634d0a07a553): verify_on_setup passed
2025-11-13 04:00:22,871 - INFO - We will configure BGP on the VM
2025-11-13 04:00:23,295 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:00:23,295 - INFO - Configuring BGP on ctest-TestBGPaasZone-31857541-69643466
2025-11-13 04:00:23,296 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.240.88.195;
protocol bgp bgp_1{
local as 65000;
neighbor 170.240.88.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.195;
}
protocol bfd {
neighbor 170.240.88.193 local 170.240.88.195 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-11-13 04:00:23,296 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.240.88.195;
protocol bgp bgp_1{
local as 65000;
neighbor 170.240.88.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.195;
}
protocol bfd {
neighbor 170.240.88.193 local 170.240.88.195 multihop on;
}
EOS
2025-11-13 04:00:37,894 - DEBUG - None
2025-11-13 04:00:37,894 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.240.88.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.195;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-11-13 04:00:37,895 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.240.88.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.195;
}
EOS
2025-11-13 04:00:38,919 - DEBUG - None
2025-11-13 04:00:38,919 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-11-13 04:00:38,919 - DEBUG - service bird restart
2025-11-13 04:00:41,052 - DEBUG - bird stop/waiting
bird start/running, process 1434
2025-11-13 04:00:41,052 - INFO - Attaching VMI d41c27a0-ea54-4de7-8f59-0fbd93815ade to BGPaaS 08dfa57e-44cf-4533-9564-634d0a07a553
2025-11-13 04:00:41,123 - INFO - Attaching the VMI 1cb765cd-7963-4aa2-bd24-dc394af01a4c to the BGPaaS 08dfa57e-44cf-4533-9564-634d0a07a553 object
2025-11-13 04:00:41,124 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 170.240.88.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-11-13 04:00:41,124 - DEBUG - sudo ip addr add 170.240.88.212 dev eth0
2025-11-13 04:00:41,958 - DEBUG - None
2025-11-13 04:00:42,023 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31857541-60598794
2025-11-13 04:00:42,095 - INFO - BGPaaS: ctest-TestBGPaasZone-31857541-60598794(85219ed2-e7c5-42d4-829f-4a29590cd83f)
2025-11-13 04:00:42,096 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/85219ed2-e7c5-42d4-829f-4a29590cd83f
2025-11-13 04:00:42,105 - INFO - verify_in_api_server passed for BGPaaS obj 85219ed2-e7c5-42d4-829f-4a29590cd83f
2025-11-13 04:00:42,105 - INFO - BGPaaS(85219ed2-e7c5-42d4-829f-4a29590cd83f): verify_on_setup passed
2025-11-13 04:00:42,105 - INFO - We will configure BGP on the VM
2025-11-13 04:00:42,515 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:00:42,516 - INFO - Configuring BGP on ctest-TestBGPaasZone-31857541-86524154
2025-11-13 04:00:42,516 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.240.88.196;
protocol bgp bgp_1{
local as 65000;
neighbor 170.240.88.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.196;
}
protocol bfd {
neighbor 170.240.88.193 local 170.240.88.196 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-11-13 04:00:42,516 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.240.88.196;
protocol bgp bgp_1{
local as 65000;
neighbor 170.240.88.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.196;
}
protocol bfd {
neighbor 170.240.88.193 local 170.240.88.196 multihop on;
}
EOS
2025-11-13 04:00:47,784 - DEBUG - None
2025-11-13 04:00:47,784 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.240.88.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.196;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-11-13 04:00:47,784 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.240.88.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.240.88.196;
}
EOS
2025-11-13 04:00:48,300 - DEBUG - None
2025-11-13 04:00:48,300 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-11-13 04:00:48,300 - DEBUG - service bird restart
2025-11-13 04:00:49,913 - DEBUG - bird stop/waiting
bird start/running, process 1441
2025-11-13 04:00:49,913 - INFO - Attaching VMI 248b71e4-1f8c-4ee7-8d55-ba1b1267f06e to BGPaaS 85219ed2-e7c5-42d4-829f-4a29590cd83f
2025-11-13 04:00:49,988 - INFO - Attaching the VMI 783034a5-007f-4206-8168-98ff349c839d to the BGPaaS 85219ed2-e7c5-42d4-829f-4a29590cd83f object
2025-11-13 04:00:49,988 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 170.240.88.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-11-13 04:00:49,988 - DEBUG - sudo ip addr add 170.240.88.212 dev eth0
2025-11-13 04:00:50,611 - DEBUG - None
2025-11-13 04:00:50,611 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:00:50,628 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-11-13 04:00:50,629 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:00:50,629 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-11-13 04:00:50,651 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-11-13 04:00:50,657 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:00:50,672 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-11-13 04:00:56,687 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-11-13 04:01:02,702 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-11-13 04:01:02,703 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:01:02,703 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-11-13 04:01:02,721 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-11-13 04:01:02,729 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.240.88.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-11-13 04:01:02,729 - DEBUG - ping -s 56 -c 3 -W 1 170.240.88.212
2025-11-13 04:01:09,957 - DEBUG - PING 170.240.88.212 (170.240.88.212) 56(84) bytes of data.
64 bytes from 170.240.88.212: icmp_seq=1 ttl=64 time=7.94 ms
64 bytes from 170.240.88.212: icmp_seq=2 ttl=64 time=0.926 ms
64 bytes from 170.240.88.212: icmp_seq=3 ttl=64 time=1.04 ms
--- 170.240.88.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.926/3.306/7.944/3.280 ms
2025-11-13 04:01:09,957 - INFO - Ping to IP 170.240.88.212 from VM ctest-TestBGPaasZone-31857541-47000224 passed
2025-11-13 04:01:09,957 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:01:09,973 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-11-13 04:01:09,973 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:01:09,973 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-11-13 04:01:09,990 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-11-13 04:01:09,996 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:01:10,013 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-11-13 04:01:10,013 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-13 04:01:10,013 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-11-13 04:01:10,031 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-11-13 04:01:10,038 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.240.88.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-11-13 04:01:10,038 - DEBUG - ping -s 56 -c 3 -W 1 170.240.88.212
2025-11-13 04:01:12,614 - DEBUG - PING 170.240.88.212 (170.240.88.212) 56(84) bytes of data.
64 bytes from 170.240.88.212: icmp_seq=1 ttl=64 time=3.46 ms
64 bytes from 170.240.88.212: icmp_seq=2 ttl=64 time=0.995 ms
64 bytes from 170.240.88.212: icmp_seq=3 ttl=64 time=1.23 ms
--- 170.240.88.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 0.995/1.899/3.469/1.115 ms
2025-11-13 04:01:12,614 - INFO - Ping to IP 170.240.88.212 from VM ctest-TestBGPaasZone-31857541-47000224 passed
2025-11-13 04:01:12,614 - INFO - Detaching VMI 248b71e4-1f8c-4ee7-8d55-ba1b1267f06e from BGPaaS 85219ed2-e7c5-42d4-829f-4a29590cd83f
2025-11-13 04:01:12,695 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31857541-60598794(85219ed2-e7c5-42d4-829f-4a29590cd83f)
2025-11-13 04:01:12,758 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/85219ed2-e7c5-42d4-829f-4a29590cd83f
2025-11-13 04:01:12,767 - DEBUG - Response Code: 404
2025-11-13 04:01:12,768 - DEBUG - BGPaaS: 85219ed2-e7c5-42d4-829f-4a29590cd83f deleted from api server
2025-11-13 04:01:12,768 - INFO - BGPaaS(85219ed2-e7c5-42d4-829f-4a29590cd83f): verify_on_cleanup passed
2025-11-13 04:01:12,768 - INFO - Detaching VMI d41c27a0-ea54-4de7-8f59-0fbd93815ade from BGPaaS 08dfa57e-44cf-4533-9564-634d0a07a553
2025-11-13 04:01:12,879 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31857541-89080620(08dfa57e-44cf-4533-9564-634d0a07a553)
2025-11-13 04:01:12,978 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/08dfa57e-44cf-4533-9564-634d0a07a553
2025-11-13 04:01:12,992 - DEBUG - Response Code: 404
2025-11-13 04:01:12,992 - DEBUG - BGPaaS: 08dfa57e-44cf-4533-9564-634d0a07a553 deleted from api server
2025-11-13 04:01:12,992 - INFO - BGPaaS(08dfa57e-44cf-4533-9564-634d0a07a553): verify_on_cleanup passed
2025-11-13 04:01:12,993 - INFO - Deleting Control node zone ctest-test-zone-05123442(5ffe7f84-4af0-4f7b-a723-991624bf7a4a)
2025-11-13 04:01:13,153 - INFO - Deleting Control node zone ctest-test-zone-48483464(4596ff33-4de6-4342-b616-772f2d3dde83)
2025-11-13 04:01:13,310 - INFO - Deleting Control node zone ctest-test-zone-36642010(e8e24bbe-ca20-4f80-a545-1f3d9b65d2a6)
2025-11-13 04:01:13,460 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-47000224
2025-11-13 04:01:13,591 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-86524154
2025-11-13 04:01:13,677 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-69643466
2025-11-13 04:01:13,752 - INFO - Deleting VN ctest-cnz_vn-06131606
2025-11-13 04:01:13,880 - DEBUG - VN 24e1447c-e1e3-451d-98de-e09332f28e1d still in use: Unable to complete operation on network 24e1447c-e1e3-451d-98de-e09332f28e1d. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f581412d-a4a6-4818-ac72-830b52f5ec58']
2025-11-13 04:01:13,880 - WARNING - Deleting VN ctest-cnz_vn-06131606 failed..Will retry
2025-11-13 04:01:16,079 - DEBUG - Response for deleting network ()
2025-11-13 04:01:17,363 - DEBUG - Skipping xmpp flap check
2025-11-13 04:01:17,364 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:30]
2025-11-13 04:01:17,364 - INFO - --------------------------------------------------------------------------------
2025-11-13 04:01:18,221 - INFO - Deleted project: ctest-TestBGPaasZone-31857541, ID : 3423b299-3442-4440-b16b-c6038f01b29d