is in ACTIVE state now
2025-10-16 04:06:03,177 - INFO - VM name : ctest-TestBGPaasZone-99397402-88212769
2025-10-16 04:06:03,275 - DEBUG - VM ctest-TestBGPaasZone-99397402-88212769 ID is e0c90fc1-ecc4-4e6b-8846-9330a1d7bb33
2025-10-16 04:06:03,275 - DEBUG - VM ctest-TestBGPaasZone-99397402-88212769 launched on Node an-jenkins-deploy-platform-ansible-os-4339-2
2025-10-16 04:06:03,364 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e0c90fc1-ecc4-4e6b-8846-9330a1d7bb33
2025-10-16 04:06:03,380 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/97a366d1-95e9-4d9a-810a-5a8a167deae5
2025-10-16 04:06:04,556 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.75 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.415 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.415/2.082/3.750/1.667 ms')
2025-10-16 04:06:04,557 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-99397402-88212769 passed
2025-10-16 04:06:04,627 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:04,627 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-99397402-88212769, IP 212.17.63.133, Port 22
2025-10-16 04:06:04,695 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-16 04:06:04,784 - DEBUG - VM ctest-TestBGPaasZone-99397402-88212769 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-16 04:06:09,784 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:09,784 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-99397402-88212769, IP 212.17.63.133, Port 22
2025-10-16 04:06:09,955 - DEBUG - VM ctest-TestBGPaasZone-99397402-88212769 is ready for SSH connections
2025-10-16 04:06:10,090 - INFO - Created control node zone ctest-test-zone-84908179(8e20fc67-ae98-47a8-bf33-d64a51668dea)
2025-10-16 04:06:10,438 - INFO - Created control node zone ctest-test-zone-57490680(451a4911-eb2c-41ac-8596-b6e51d55fd86)
2025-10-16 04:06:10,782 - INFO - Created control node zone ctest-test-zone-80396982(ee565850-c9f0-429b-9f33-5ca24d3135e6)
2025-10-16 04:06:11,058 - INFO - Creating BGPaaS ctest-TestBGPaasZone-99397402-44352388
2025-10-16 04:06:11,134 - INFO - BGPaaS: ctest-TestBGPaasZone-99397402-44352388(35000a51-5432-4886-80d9-23b2fac978e7)
2025-10-16 04:06:11,135 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/35000a51-5432-4886-80d9-23b2fac978e7
2025-10-16 04:06:11,146 - INFO - verify_in_api_server passed for BGPaaS obj 35000a51-5432-4886-80d9-23b2fac978e7
2025-10-16 04:06:11,146 - INFO - BGPaaS(35000a51-5432-4886-80d9-23b2fac978e7): verify_on_setup passed
2025-10-16 04:06:11,146 - INFO - We will configure BGP on the VM
2025-10-16 04:06:11,570 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:11,570 - INFO - Configuring BGP on ctest-TestBGPaasZone-99397402-82391166
2025-10-16 04:06:11,570 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 212.17.63.131;
protocol bgp bgp_1{
local as 65000;
neighbor 212.17.63.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.131;
}
protocol bfd {
neighbor 212.17.63.129 local 212.17.63.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-16 04:06:11,571 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 212.17.63.131;
protocol bgp bgp_1{
local as 65000;
neighbor 212.17.63.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.131;
}
protocol bfd {
neighbor 212.17.63.129 local 212.17.63.131 multihop on;
}
EOS
2025-10-16 04:06:26,113 - DEBUG - None
2025-10-16 04:06:26,113 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 212.17.63.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-16 04:06:26,113 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 212.17.63.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.131;
}
EOS
2025-10-16 04:06:27,272 - DEBUG - None
2025-10-16 04:06:27,272 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-16 04:06:27,272 - DEBUG - service bird restart
2025-10-16 04:06:30,392 - DEBUG - bird stop/waiting
bird start/running, process 1442
2025-10-16 04:06:30,392 - INFO - Attaching VMI 95281bf7-8b24-4cac-a403-be3493cbf35d to BGPaaS 35000a51-5432-4886-80d9-23b2fac978e7
2025-10-16 04:06:30,462 - INFO - Attaching the VMI 7ffc69ae-4eaa-4256-be04-7945e21e5d14 to the BGPaaS 35000a51-5432-4886-80d9-23b2fac978e7 object
2025-10-16 04:06:30,462 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 212.17.63.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-16 04:06:30,463 - DEBUG - sudo ip addr add 212.17.63.148 dev eth0
2025-10-16 04:06:31,245 - DEBUG - None
2025-10-16 04:06:31,306 - INFO - Creating BGPaaS ctest-TestBGPaasZone-99397402-72102918
2025-10-16 04:06:31,378 - INFO - BGPaaS: ctest-TestBGPaasZone-99397402-72102918(7ab28adc-1bb6-40a3-b063-9132c9c54499)
2025-10-16 04:06:31,379 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/7ab28adc-1bb6-40a3-b063-9132c9c54499
2025-10-16 04:06:31,389 - INFO - verify_in_api_server passed for BGPaaS obj 7ab28adc-1bb6-40a3-b063-9132c9c54499
2025-10-16 04:06:31,389 - INFO - BGPaaS(7ab28adc-1bb6-40a3-b063-9132c9c54499): verify_on_setup passed
2025-10-16 04:06:31,389 - INFO - We will configure BGP on the VM
2025-10-16 04:06:31,798 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:31,798 - INFO - Configuring BGP on ctest-TestBGPaasZone-99397402-95114387
2025-10-16 04:06:31,799 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 212.17.63.132;
protocol bgp bgp_1{
local as 65000;
neighbor 212.17.63.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.132;
}
protocol bfd {
neighbor 212.17.63.129 local 212.17.63.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-16 04:06:31,799 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 212.17.63.132;
protocol bgp bgp_1{
local as 65000;
neighbor 212.17.63.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.132;
}
protocol bfd {
neighbor 212.17.63.129 local 212.17.63.132 multihop on;
}
EOS
2025-10-16 04:06:37,174 - DEBUG - None
2025-10-16 04:06:37,174 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 212.17.63.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-16 04:06:37,174 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 212.17.63.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 212.17.63.132;
}
EOS
2025-10-16 04:06:37,649 - DEBUG - None
2025-10-16 04:06:37,649 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-16 04:06:37,649 - DEBUG - service bird restart
2025-10-16 04:06:39,251 - DEBUG - bird stop/waiting
bird start/running, process 1443
2025-10-16 04:06:39,251 - INFO - Attaching VMI b0f4c73f-1514-48be-a034-73d6b3ee504a to BGPaaS 7ab28adc-1bb6-40a3-b063-9132c9c54499
2025-10-16 04:06:39,338 - INFO - Attaching the VMI eba0cd38-4444-403f-9d0d-8960cbeb8509 to the BGPaaS 7ab28adc-1bb6-40a3-b063-9132c9c54499 object
2025-10-16 04:06:39,338 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 212.17.63.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-16 04:06:39,339 - DEBUG - sudo ip addr add 212.17.63.148 dev eth0
2025-10-16 04:06:39,969 - DEBUG - None
2025-10-16 04:06:39,969 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:39,994 - INFO - BGPaaS session seen in control-node 10.20.0.5
2025-10-16 04:06:39,995 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:39,995 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-16 04:06:40,010 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-16 04:06:40,017 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:40,034 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.5']
2025-10-16 04:06:46,051 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.5']
2025-10-16 04:06:52,067 - INFO - BGPaaS session seen in control-node 10.20.0.5
2025-10-16 04:06:52,067 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:52,068 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-16 04:06:52,083 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-16 04:06:52,088 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 212.17.63.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-16 04:06:52,089 - DEBUG - ping -s 56 -c 3 -W 1 212.17.63.148
2025-10-16 04:06:59,092 - DEBUG - PING 212.17.63.148 (212.17.63.148) 56(84) bytes of data.
64 bytes from 212.17.63.148: icmp_seq=1 ttl=64 time=7.93 ms
64 bytes from 212.17.63.148: icmp_seq=2 ttl=64 time=0.966 ms
64 bytes from 212.17.63.148: icmp_seq=3 ttl=64 time=1.05 ms
--- 212.17.63.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.966/3.320/7.938/3.265 ms
2025-10-16 04:06:59,092 - INFO - Ping to IP 212.17.63.148 from VM ctest-TestBGPaasZone-99397402-88212769 passed
2025-10-16 04:06:59,092 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:59,112 - INFO - BGPaaS session seen in control-node 10.20.0.5
2025-10-16 04:06:59,112 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:59,112 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-16 04:06:59,126 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-16 04:06:59,132 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:59,146 - INFO - BGPaaS session seen in control-node 10.20.0.5
2025-10-16 04:06:59,147 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 04:06:59,147 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-16 04:06:59,161 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-16 04:06:59,166 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 212.17.63.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-16 04:06:59,166 - DEBUG - ping -s 56 -c 3 -W 1 212.17.63.148
2025-10-16 04:07:01,714 - DEBUG - PING 212.17.63.148 (212.17.63.148) 56(84) bytes of data.
64 bytes from 212.17.63.148: icmp_seq=1 ttl=64 time=3.24 ms
64 bytes from 212.17.63.148: icmp_seq=2 ttl=64 time=0.979 ms
64 bytes from 212.17.63.148: icmp_seq=3 ttl=64 time=0.933 ms
--- 212.17.63.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.933/1.719/3.245/1.079 ms
2025-10-16 04:07:01,714 - INFO - Ping to IP 212.17.63.148 from VM ctest-TestBGPaasZone-99397402-88212769 passed
2025-10-16 04:07:01,714 - INFO - Detaching VMI b0f4c73f-1514-48be-a034-73d6b3ee504a from BGPaaS 7ab28adc-1bb6-40a3-b063-9132c9c54499
2025-10-16 04:07:01,796 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-99397402-72102918(7ab28adc-1bb6-40a3-b063-9132c9c54499)
2025-10-16 04:07:01,892 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/7ab28adc-1bb6-40a3-b063-9132c9c54499
2025-10-16 04:07:01,900 - DEBUG - Response Code: 404
2025-10-16 04:07:01,900 - DEBUG - BGPaaS: 7ab28adc-1bb6-40a3-b063-9132c9c54499 deleted from api server
2025-10-16 04:07:01,900 - INFO - BGPaaS(7ab28adc-1bb6-40a3-b063-9132c9c54499): verify_on_cleanup passed
2025-10-16 04:07:01,900 - INFO - Detaching VMI 95281bf7-8b24-4cac-a403-be3493cbf35d from BGPaaS 35000a51-5432-4886-80d9-23b2fac978e7
2025-10-16 04:07:01,998 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-99397402-44352388(35000a51-5432-4886-80d9-23b2fac978e7)
2025-10-16 04:07:02,072 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/35000a51-5432-4886-80d9-23b2fac978e7
2025-10-16 04:07:02,081 - DEBUG - Response Code: 404
2025-10-16 04:07:02,081 - DEBUG - BGPaaS: 35000a51-5432-4886-80d9-23b2fac978e7 deleted from api server
2025-10-16 04:07:02,081 - INFO - BGPaaS(35000a51-5432-4886-80d9-23b2fac978e7): verify_on_cleanup passed
2025-10-16 04:07:02,081 - INFO - Deleting Control node zone ctest-test-zone-80396982(ee565850-c9f0-429b-9f33-5ca24d3135e6)
2025-10-16 04:07:02,236 - INFO - Deleting Control node zone ctest-test-zone-57490680(451a4911-eb2c-41ac-8596-b6e51d55fd86)
2025-10-16 04:07:02,375 - INFO - Deleting Control node zone ctest-test-zone-84908179(8e20fc67-ae98-47a8-bf33-d64a51668dea)
2025-10-16 04:07:02,517 - INFO - Deleting VM ctest-TestBGPaasZone-99397402-88212769
2025-10-16 04:07:02,600 - INFO - Deleting VM ctest-TestBGPaasZone-99397402-95114387
2025-10-16 04:07:02,677 - INFO - Deleting VM ctest-TestBGPaasZone-99397402-82391166
2025-10-16 04:07:02,753 - INFO - Deleting VN ctest-cnz_vn-53479535
2025-10-16 04:07:02,808 - DEBUG - VN d4bba38a-4def-4e30-9d05-890b2713e3a3 still in use: Unable to complete operation on network d4bba38a-4def-4e30-9d05-890b2713e3a3. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d71d907c-059d-44f4-962f-db9edc32f9c5']
2025-10-16 04:07:02,808 - WARNING - Deleting VN ctest-cnz_vn-53479535 failed..Will retry
2025-10-16 04:07:05,033 - DEBUG - Response for deleting network ()
2025-10-16 04:07:06,297 - DEBUG - Skipping xmpp flap check
2025-10-16 04:07:06,297 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:39]
2025-10-16 04:07:06,297 - INFO - --------------------------------------------------------------------------------
2025-10-16 04:07:07,043 - INFO - Deleted project: ctest-TestBGPaasZone-99397402, ID : e8939480-4ea2-41ff-8985-25db14b18e4e