is in ACTIVE state now
2025-07-31 05:23:46,785 - INFO - VM name : ctest-TestBGPaasZone-36971420-90821897
2025-07-31 05:23:46,954 - DEBUG - VM ctest-TestBGPaasZone-36971420-90821897 ID is 3791e9bb-ad54-4a0f-acbd-5e240195727b
2025-07-31 05:23:46,954 - DEBUG - VM ctest-TestBGPaasZone-36971420-90821897 launched on Node an-jenkins-deploy-platform-ansible-os-3732-2
2025-07-31 05:23:47,121 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/3791e9bb-ad54-4a0f-acbd-5e240195727b
2025-07-31 05:23:47,139 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/e2e919c3-714f-4fa3-9dc8-4c4d6ec42d2a
2025-07-31 05:23:48,432 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.85 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.30 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.297/3.075/4.853/1.778 ms')
2025-07-31 05:23:48,432 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-36971420-90821897 passed
2025-07-31 05:23:48,568 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:23:48,568 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-36971420-90821897, IP 139.163.64.133, Port 22
2025-07-31 05:23:48,637 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-31 05:23:48,827 - DEBUG - VM ctest-TestBGPaasZone-36971420-90821897 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-31 05:23:53,828 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:23:53,829 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-36971420-90821897, IP 139.163.64.133, Port 22
2025-07-31 05:23:53,902 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-31 05:23:54,035 - DEBUG - VM ctest-TestBGPaasZone-36971420-90821897 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-31 05:23:59,035 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:23:59,036 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-36971420-90821897, IP 139.163.64.133, Port 22
2025-07-31 05:23:59,210 - DEBUG - VM ctest-TestBGPaasZone-36971420-90821897 is ready for SSH connections
2025-07-31 05:23:59,357 - INFO - Created control node zone ctest-test-zone-71549894(2fedc98f-d2f2-48d2-8d37-36cd630d47a6)
2025-07-31 05:23:59,757 - INFO - Created control node zone ctest-test-zone-96617986(faa183af-e7ac-44fc-a7f0-f7128ecd7ee8)
2025-07-31 05:24:00,137 - INFO - Created control node zone ctest-test-zone-44219473(91c9fb06-cee4-4a12-bb65-ac7c49994e5d)
2025-07-31 05:24:00,421 - INFO - Creating BGPaaS ctest-TestBGPaasZone-36971420-85181682
2025-07-31 05:24:00,505 - INFO - BGPaaS: ctest-TestBGPaasZone-36971420-85181682(e8753fb6-3f2e-4a19-bcd2-c1766bee6c10)
2025-07-31 05:24:00,505 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/e8753fb6-3f2e-4a19-bcd2-c1766bee6c10
2025-07-31 05:24:00,516 - INFO - verify_in_api_server passed for BGPaaS obj e8753fb6-3f2e-4a19-bcd2-c1766bee6c10
2025-07-31 05:24:00,517 - INFO - BGPaaS(e8753fb6-3f2e-4a19-bcd2-c1766bee6c10): verify_on_setup passed
2025-07-31 05:24:00,517 - INFO - We will configure BGP on the VM
2025-07-31 05:24:01,001 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:01,001 - INFO - Configuring BGP on ctest-TestBGPaasZone-36971420-45754765
2025-07-31 05:24:01,001 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 139.163.64.131;
protocol bgp bgp_1{
local as 65000;
neighbor 139.163.64.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.131;
}
protocol bfd {
neighbor 139.163.64.129 local 139.163.64.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-31 05:24:01,001 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 139.163.64.131;
protocol bgp bgp_1{
local as 65000;
neighbor 139.163.64.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.131;
}
protocol bfd {
neighbor 139.163.64.129 local 139.163.64.131 multihop on;
}
EOS
2025-07-31 05:24:16,219 - DEBUG - None
2025-07-31 05:24:16,219 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 139.163.64.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-31 05:24:16,219 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 139.163.64.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.131;
}
EOS
2025-07-31 05:24:16,909 - DEBUG - None
2025-07-31 05:24:16,910 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-31 05:24:16,910 - DEBUG - service bird restart
2025-07-31 05:24:19,149 - DEBUG - bird stop/waiting
bird start/running, process 1443
2025-07-31 05:24:19,149 - INFO - Attaching VMI 8eb215e1-174b-4186-b369-d7e911688709 to BGPaaS e8753fb6-3f2e-4a19-bcd2-c1766bee6c10
2025-07-31 05:24:19,245 - INFO - Attaching the VMI 563f36a3-86ce-4594-9f3b-43deb392ee23 to the BGPaaS e8753fb6-3f2e-4a19-bcd2-c1766bee6c10 object
2025-07-31 05:24:19,245 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 139.163.64.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-31 05:24:19,246 - DEBUG - sudo ip addr add 139.163.64.148 dev eth0
2025-07-31 05:24:20,126 - DEBUG - None
2025-07-31 05:24:20,197 - INFO - Creating BGPaaS ctest-TestBGPaasZone-36971420-23033417
2025-07-31 05:24:20,297 - INFO - BGPaaS: ctest-TestBGPaasZone-36971420-23033417(c62acf16-f276-4f60-8647-c41281707273)
2025-07-31 05:24:20,297 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/c62acf16-f276-4f60-8647-c41281707273
2025-07-31 05:24:20,313 - INFO - verify_in_api_server passed for BGPaaS obj c62acf16-f276-4f60-8647-c41281707273
2025-07-31 05:24:20,313 - INFO - BGPaaS(c62acf16-f276-4f60-8647-c41281707273): verify_on_setup passed
2025-07-31 05:24:20,313 - INFO - We will configure BGP on the VM
2025-07-31 05:24:20,770 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:20,770 - INFO - Configuring BGP on ctest-TestBGPaasZone-36971420-01873253
2025-07-31 05:24:20,770 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 139.163.64.132;
protocol bgp bgp_1{
local as 65000;
neighbor 139.163.64.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.132;
}
protocol bfd {
neighbor 139.163.64.129 local 139.163.64.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-07-31 05:24:20,771 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 139.163.64.132;
protocol bgp bgp_1{
local as 65000;
neighbor 139.163.64.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.132;
}
protocol bfd {
neighbor 139.163.64.129 local 139.163.64.132 multihop on;
}
EOS
2025-07-31 05:24:29,710 - DEBUG - None
2025-07-31 05:24:29,711 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 139.163.64.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-07-31 05:24:29,711 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 139.163.64.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 139.163.64.132;
}
EOS
2025-07-31 05:24:30,241 - DEBUG - None
2025-07-31 05:24:30,242 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-07-31 05:24:30,242 - DEBUG - service bird restart
2025-07-31 05:24:31,910 - DEBUG - bird stop/waiting
bird start/running, process 1433
2025-07-31 05:24:31,910 - INFO - Attaching VMI b7dd8300-05da-4587-9ea2-6f5d6485c7b2 to BGPaaS c62acf16-f276-4f60-8647-c41281707273
2025-07-31 05:24:32,005 - INFO - Attaching the VMI 2dafbfd5-144c-4329-a785-c3f20c6af316 to the BGPaaS c62acf16-f276-4f60-8647-c41281707273 object
2025-07-31 05:24:32,006 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 139.163.64.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-07-31 05:24:32,006 - DEBUG - sudo ip addr add 139.163.64.148 dev eth0
2025-07-31 05:24:32,750 - DEBUG - None
2025-07-31 05:24:32,750 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:32,751 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:32,779 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-07-31 05:24:32,780 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:32,780 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:32,806 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-07-31 05:24:32,820 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:32,820 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:32,853 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-07-31 05:24:38,856 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:38,891 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-07-31 05:24:38,891 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:38,892 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:38,927 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-07-31 05:24:38,943 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 139.163.64.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-31 05:24:38,943 - DEBUG - ping -s 56 -c 3 -W 1 139.163.64.148
2025-07-31 05:24:50,081 - DEBUG - PING 139.163.64.148 (139.163.64.148) 56(84) bytes of data.
64 bytes from 139.163.64.148: icmp_seq=1 ttl=64 time=10.2 ms
64 bytes from 139.163.64.148: icmp_seq=2 ttl=64 time=1.58 ms
64 bytes from 139.163.64.148: icmp_seq=3 ttl=64 time=1.56 ms
--- 139.163.64.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2006ms
rtt min/avg/max/mdev = 1.564/4.463/10.244/4.088 ms
2025-07-31 05:24:50,081 - INFO - Ping to IP 139.163.64.148 from VM ctest-TestBGPaasZone-36971420-90821897 passed
2025-07-31 05:24:50,082 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:50,082 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:50,120 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-07-31 05:24:50,121 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:50,121 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:50,157 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-07-31 05:24:50,170 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:50,170 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:50,213 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-07-31 05:24:50,214 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-31 05:24:50,214 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-07-31 05:24:50,256 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-07-31 05:24:50,269 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 139.163.64.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-31 05:24:50,269 - DEBUG - ping -s 56 -c 3 -W 1 139.163.64.148
2025-07-31 05:24:52,898 - DEBUG - PING 139.163.64.148 (139.163.64.148) 56(84) bytes of data.
64 bytes from 139.163.64.148: icmp_seq=1 ttl=64 time=2.92 ms
64 bytes from 139.163.64.148: icmp_seq=2 ttl=64 time=1.39 ms
64 bytes from 139.163.64.148: icmp_seq=3 ttl=64 time=1.96 ms
--- 139.163.64.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.394/2.096/2.928/0.635 ms
2025-07-31 05:24:52,899 - INFO - Ping to IP 139.163.64.148 from VM ctest-TestBGPaasZone-36971420-90821897 passed
2025-07-31 05:24:52,899 - INFO - Detaching VMI b7dd8300-05da-4587-9ea2-6f5d6485c7b2 from BGPaaS c62acf16-f276-4f60-8647-c41281707273
2025-07-31 05:24:52,989 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-36971420-23033417(c62acf16-f276-4f60-8647-c41281707273)
2025-07-31 05:24:53,093 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/c62acf16-f276-4f60-8647-c41281707273
2025-07-31 05:24:53,156 - DEBUG - Response Code: 404
2025-07-31 05:24:53,157 - DEBUG - BGPaaS: c62acf16-f276-4f60-8647-c41281707273 deleted from api server
2025-07-31 05:24:53,157 - INFO - BGPaaS(c62acf16-f276-4f60-8647-c41281707273): verify_on_cleanup passed
2025-07-31 05:24:53,157 - INFO - Detaching VMI 8eb215e1-174b-4186-b369-d7e911688709 from BGPaaS e8753fb6-3f2e-4a19-bcd2-c1766bee6c10
2025-07-31 05:24:53,245 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-36971420-85181682(e8753fb6-3f2e-4a19-bcd2-c1766bee6c10)
2025-07-31 05:24:53,317 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/e8753fb6-3f2e-4a19-bcd2-c1766bee6c10
2025-07-31 05:24:53,325 - DEBUG - Response Code: 404
2025-07-31 05:24:53,326 - DEBUG - BGPaaS: e8753fb6-3f2e-4a19-bcd2-c1766bee6c10 deleted from api server
2025-07-31 05:24:53,326 - INFO - BGPaaS(e8753fb6-3f2e-4a19-bcd2-c1766bee6c10): verify_on_cleanup passed
2025-07-31 05:24:53,326 - INFO - Deleting Control node zone ctest-test-zone-44219473(91c9fb06-cee4-4a12-bb65-ac7c49994e5d)
2025-07-31 05:24:53,479 - INFO - Deleting Control node zone ctest-test-zone-96617986(faa183af-e7ac-44fc-a7f0-f7128ecd7ee8)
2025-07-31 05:24:53,645 - INFO - Deleting Control node zone ctest-test-zone-71549894(2fedc98f-d2f2-48d2-8d37-36cd630d47a6)
2025-07-31 05:24:53,823 - INFO - Deleting VM ctest-TestBGPaasZone-36971420-90821897
2025-07-31 05:24:53,902 - INFO - Deleting VM ctest-TestBGPaasZone-36971420-01873253
2025-07-31 05:24:53,988 - INFO - Deleting VM ctest-TestBGPaasZone-36971420-45754765
2025-07-31 05:24:54,086 - INFO - Deleting VN ctest-cnz_vn-86647366
2025-07-31 05:24:54,163 - DEBUG - VN fe060de7-6fd7-4e24-943a-c3ac99adb121 still in use: Unable to complete operation on network fe060de7-6fd7-4e24-943a-c3ac99adb121. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-0acfafb1-20b8-4fe5-bf16-578f8f56247f']
2025-07-31 05:24:54,163 - WARNING - Deleting VN ctest-cnz_vn-86647366 failed..Will retry
2025-07-31 05:24:56,498 - DEBUG - Response for deleting network ()
2025-07-31 05:24:57,874 - DEBUG - Skipping xmpp flap check
2025-07-31 05:24:57,875 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:46]
2025-07-31 05:24:57,876 - INFO - --------------------------------------------------------------------------------
2025-07-31 05:24:58,736 - INFO - Deleted project: ctest-TestBGPaasZone-36971420, ID : 50621b90-4738-4057-8dab-55b3459caa8d