is in ACTIVE state now
2025-09-08 04:05:30,404 - INFO - VM name : ctest-TestBGPaasZone-09888966-10635263
2025-09-08 04:05:30,489 - DEBUG - VM ctest-TestBGPaasZone-09888966-10635263 ID is 20023342-6ba5-49ff-8cba-a49136a4e628
2025-09-08 04:05:30,489 - DEBUG - VM ctest-TestBGPaasZone-09888966-10635263 launched on Node an-jenkins-deploy-platform-ansible-os-4041-2
2025-09-08 04:05:30,572 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/20023342-6ba5-49ff-8cba-a49136a4e628
2025-09-08 04:05:30,583 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/4d26fe32-8793-472c-b71a-64622add30c0
2025-09-08 04:05:31,750 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.78 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.692 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.692/1.738/2.784/1.046 ms')
2025-09-08 04:05:31,750 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-09888966-10635263 passed
2025-09-08 04:05:31,830 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:05:31,830 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-09888966-10635263, IP 30.66.226.133, Port 22
2025-09-08 04:05:31,896 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-09-08 04:05:31,991 - DEBUG - VM ctest-TestBGPaasZone-09888966-10635263 is NOT ready for SSH connections, VM status: ACTIVE
2025-09-08 04:05:36,992 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:05:36,993 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-09888966-10635263, IP 30.66.226.133, Port 22
2025-09-08 04:05:37,164 - DEBUG - VM ctest-TestBGPaasZone-09888966-10635263 is ready for SSH connections
2025-09-08 04:05:37,303 - INFO - Created control node zone ctest-test-zone-28491956(a007d68d-6d12-4e6c-9b4b-c020d99e8139)
2025-09-08 04:05:37,667 - INFO - Created control node zone ctest-test-zone-68468304(dc2d9a67-cad9-4a23-8b35-9b32cae2f8f3)
2025-09-08 04:05:38,039 - INFO - Created control node zone ctest-test-zone-39341923(da168367-094b-4c40-a2ed-13fd774939fc)
2025-09-08 04:05:38,319 - INFO - Creating BGPaaS ctest-TestBGPaasZone-09888966-27686654
2025-09-08 04:05:38,399 - INFO - BGPaaS: ctest-TestBGPaasZone-09888966-27686654(4bbb7e6b-a52e-461c-917f-adde2ea74316)
2025-09-08 04:05:38,399 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/4bbb7e6b-a52e-461c-917f-adde2ea74316
2025-09-08 04:05:38,410 - INFO - verify_in_api_server passed for BGPaaS obj 4bbb7e6b-a52e-461c-917f-adde2ea74316
2025-09-08 04:05:38,410 - INFO - BGPaaS(4bbb7e6b-a52e-461c-917f-adde2ea74316): verify_on_setup passed
2025-09-08 04:05:38,410 - INFO - We will configure BGP on the VM
2025-09-08 04:05:38,835 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:05:38,835 - INFO - Configuring BGP on ctest-TestBGPaasZone-09888966-06023918
2025-09-08 04:05:38,835 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 30.66.226.131;
protocol bgp bgp_1{
local as 65000;
neighbor 30.66.226.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.131;
}
protocol bfd {
neighbor 30.66.226.129 local 30.66.226.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-09-08 04:05:38,835 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 30.66.226.131;
protocol bgp bgp_1{
local as 65000;
neighbor 30.66.226.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.131;
}
protocol bfd {
neighbor 30.66.226.129 local 30.66.226.131 multihop on;
}
EOS
2025-09-08 04:05:47,715 - DEBUG - None
2025-09-08 04:05:47,715 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 30.66.226.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-09-08 04:05:47,715 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 30.66.226.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.131;
}
EOS
2025-09-08 04:05:48,256 - DEBUG - None
2025-09-08 04:05:48,257 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-09-08 04:05:48,257 - DEBUG - service bird restart
2025-09-08 04:05:49,988 - DEBUG - bird stop/waiting
bird start/running, process 1435
2025-09-08 04:05:49,988 - INFO - Attaching VMI 17a08cfb-a40e-4fc7-933f-77b527ba4de3 to BGPaaS 4bbb7e6b-a52e-461c-917f-adde2ea74316
2025-09-08 04:05:50,067 - INFO - Attaching the VMI a4fc3b35-5400-408b-9ccf-36502c34fb37 to the BGPaaS 4bbb7e6b-a52e-461c-917f-adde2ea74316 object
2025-09-08 04:05:50,067 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 30.66.226.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-09-08 04:05:50,067 - DEBUG - sudo ip addr add 30.66.226.148 dev eth0
2025-09-08 04:05:50,753 - DEBUG - None
2025-09-08 04:05:50,819 - INFO - Creating BGPaaS ctest-TestBGPaasZone-09888966-70089931
2025-09-08 04:05:50,903 - INFO - BGPaaS: ctest-TestBGPaasZone-09888966-70089931(d0801a13-7a31-4afc-83d6-41f727ee6515)
2025-09-08 04:05:50,903 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/d0801a13-7a31-4afc-83d6-41f727ee6515
2025-09-08 04:05:50,916 - INFO - verify_in_api_server passed for BGPaaS obj d0801a13-7a31-4afc-83d6-41f727ee6515
2025-09-08 04:05:50,917 - INFO - BGPaaS(d0801a13-7a31-4afc-83d6-41f727ee6515): verify_on_setup passed
2025-09-08 04:05:50,918 - INFO - We will configure BGP on the VM
2025-09-08 04:05:51,383 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:05:51,383 - INFO - Configuring BGP on ctest-TestBGPaasZone-09888966-67954655
2025-09-08 04:05:51,383 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 30.66.226.132;
protocol bgp bgp_1{
local as 65000;
neighbor 30.66.226.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.132;
}
protocol bfd {
neighbor 30.66.226.129 local 30.66.226.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-09-08 04:05:51,383 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 30.66.226.132;
protocol bgp bgp_1{
local as 65000;
neighbor 30.66.226.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.132;
}
protocol bfd {
neighbor 30.66.226.129 local 30.66.226.132 multihop on;
}
EOS
2025-09-08 04:05:57,037 - DEBUG - None
2025-09-08 04:05:57,037 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 30.66.226.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-09-08 04:05:57,037 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 30.66.226.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 30.66.226.132;
}
EOS
2025-09-08 04:05:57,631 - DEBUG - None
2025-09-08 04:05:57,631 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-09-08 04:05:57,631 - DEBUG - service bird restart
2025-09-08 04:05:59,260 - DEBUG - bird stop/waiting
bird start/running, process 1435
2025-09-08 04:05:59,260 - INFO - Attaching VMI d4dbb820-cee9-4be8-a168-46e382466be8 to BGPaaS d0801a13-7a31-4afc-83d6-41f727ee6515
2025-09-08 04:05:59,339 - INFO - Attaching the VMI 3a4df5f2-f5f4-4967-8585-f6c9c6bdfe91 to the BGPaaS d0801a13-7a31-4afc-83d6-41f727ee6515 object
2025-09-08 04:05:59,339 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 30.66.226.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-09-08 04:05:59,339 - DEBUG - sudo ip addr add 30.66.226.148 dev eth0
2025-09-08 04:05:59,981 - DEBUG - None
2025-09-08 04:05:59,981 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:00,006 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-08 04:06:00,007 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:00,007 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-08 04:06:00,027 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-09-08 04:06:00,039 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:00,053 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-09-08 04:06:06,069 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-09-08 04:06:12,085 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-08 04:06:12,085 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:12,086 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-08 04:06:12,109 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-09-08 04:06:12,119 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 30.66.226.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-09-08 04:06:12,119 - DEBUG - ping -s 56 -c 3 -W 1 30.66.226.148
2025-09-08 04:06:19,092 - DEBUG - PING 30.66.226.148 (30.66.226.148) 56(84) bytes of data.
64 bytes from 30.66.226.148: icmp_seq=1 ttl=64 time=17.2 ms
64 bytes from 30.66.226.148: icmp_seq=2 ttl=64 time=2.37 ms
64 bytes from 30.66.226.148: icmp_seq=3 ttl=64 time=2.45 ms
--- 30.66.226.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2006ms
rtt min/avg/max/mdev = 2.378/7.346/17.212/6.976 ms
2025-09-08 04:06:19,092 - INFO - Ping to IP 30.66.226.148 from VM ctest-TestBGPaasZone-09888966-10635263 passed
2025-09-08 04:06:19,092 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:19,112 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-08 04:06:19,113 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:19,113 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-08 04:06:19,133 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-09-08 04:06:19,144 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:19,158 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-08 04:06:19,158 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-08 04:06:19,158 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-08 04:06:19,174 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-09-08 04:06:19,184 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 30.66.226.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-09-08 04:06:19,184 - DEBUG - ping -s 56 -c 3 -W 1 30.66.226.148
2025-09-08 04:06:21,752 - DEBUG - PING 30.66.226.148 (30.66.226.148) 56(84) bytes of data.
64 bytes from 30.66.226.148: icmp_seq=1 ttl=64 time=5.11 ms
64 bytes from 30.66.226.148: icmp_seq=2 ttl=64 time=2.74 ms
64 bytes from 30.66.226.148: icmp_seq=3 ttl=64 time=2.72 ms
--- 30.66.226.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 2.723/3.528/5.117/1.124 ms
2025-09-08 04:06:21,752 - INFO - Ping to IP 30.66.226.148 from VM ctest-TestBGPaasZone-09888966-10635263 passed
2025-09-08 04:06:21,752 - INFO - Detaching VMI d4dbb820-cee9-4be8-a168-46e382466be8 from BGPaaS d0801a13-7a31-4afc-83d6-41f727ee6515
2025-09-08 04:06:21,847 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-09888966-70089931(d0801a13-7a31-4afc-83d6-41f727ee6515)
2025-09-08 04:06:21,913 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/d0801a13-7a31-4afc-83d6-41f727ee6515
2025-09-08 04:06:21,949 - DEBUG - Response Code: 404
2025-09-08 04:06:21,949 - DEBUG - BGPaaS: d0801a13-7a31-4afc-83d6-41f727ee6515 deleted from api server
2025-09-08 04:06:21,949 - INFO - BGPaaS(d0801a13-7a31-4afc-83d6-41f727ee6515): verify_on_cleanup passed
2025-09-08 04:06:21,949 - INFO - Detaching VMI 17a08cfb-a40e-4fc7-933f-77b527ba4de3 from BGPaaS 4bbb7e6b-a52e-461c-917f-adde2ea74316
2025-09-08 04:06:22,095 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-09888966-27686654(4bbb7e6b-a52e-461c-917f-adde2ea74316)
2025-09-08 04:06:22,203 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/4bbb7e6b-a52e-461c-917f-adde2ea74316
2025-09-08 04:06:22,210 - DEBUG - Response Code: 404
2025-09-08 04:06:22,210 - DEBUG - BGPaaS: 4bbb7e6b-a52e-461c-917f-adde2ea74316 deleted from api server
2025-09-08 04:06:22,210 - INFO - BGPaaS(4bbb7e6b-a52e-461c-917f-adde2ea74316): verify_on_cleanup passed
2025-09-08 04:06:22,210 - INFO - Deleting Control node zone ctest-test-zone-39341923(da168367-094b-4c40-a2ed-13fd774939fc)
2025-09-08 04:06:22,387 - INFO - Deleting Control node zone ctest-test-zone-68468304(dc2d9a67-cad9-4a23-8b35-9b32cae2f8f3)
2025-09-08 04:06:22,547 - INFO - Deleting Control node zone ctest-test-zone-28491956(a007d68d-6d12-4e6c-9b4b-c020d99e8139)
2025-09-08 04:06:22,714 - INFO - Deleting VM ctest-TestBGPaasZone-09888966-10635263
2025-09-08 04:06:22,804 - INFO - Deleting VM ctest-TestBGPaasZone-09888966-67954655
2025-09-08 04:06:22,892 - INFO - Deleting VM ctest-TestBGPaasZone-09888966-06023918
2025-09-08 04:06:23,008 - INFO - Deleting VN ctest-cnz_vn-06436362
2025-09-08 04:06:23,091 - DEBUG - VN e88ac8a9-0dfe-4d48-b57d-e31f02db8e7e still in use: Unable to complete operation on network e88ac8a9-0dfe-4d48-b57d-e31f02db8e7e. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-89576fa7-719a-4af0-8c3e-d01c39c97136']
2025-09-08 04:06:23,091 - WARNING - Deleting VN ctest-cnz_vn-06436362 failed..Will retry
2025-09-08 04:06:25,281 - DEBUG - Response for deleting network ()
2025-09-08 04:06:26,681 - DEBUG - Skipping xmpp flap check
2025-09-08 04:06:26,681 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:02]
2025-09-08 04:06:26,681 - INFO - --------------------------------------------------------------------------------
2025-09-08 04:06:27,506 - INFO - Deleted project: ctest-TestBGPaasZone-09888966, ID : 37df7307-cc06-427e-aea2-76410ade40b4