is in ACTIVE state now
2025-08-07 04:09:14,151 - INFO - VM name : ctest-TestBGPaasZone-99782441-12532078
2025-08-07 04:09:14,251 - DEBUG - VM ctest-TestBGPaasZone-99782441-12532078 ID is e2ebc296-a712-4ef8-baa8-46be4d764ff8
2025-08-07 04:09:14,251 - DEBUG - VM ctest-TestBGPaasZone-99782441-12532078 launched on Node an-jenkins-deploy-platform-ansible-os-3767-1
2025-08-07 04:09:14,336 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/e2ebc296-a712-4ef8-baa8-46be4d764ff8
2025-08-07 04:09:14,349 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/2809be9d-1879-43d4-8651-d57600cb211d
2025-08-07 04:09:15,572 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.87 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.56 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.562/2.713/3.865/1.151 ms')
2025-08-07 04:09:15,572 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-99782441-12532078 passed
2025-08-07 04:09:15,694 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:09:15,694 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-99782441-12532078, IP 66.185.240.69, Port 22
2025-08-07 04:09:15,873 - DEBUG - VM ctest-TestBGPaasZone-99782441-12532078 is ready for SSH connections
2025-08-07 04:09:16,034 - INFO - Created control node zone ctest-test-zone-84364296(f8c7c558-49ca-4022-8ed4-387de9a0bb3f)
2025-08-07 04:09:16,418 - INFO - Created control node zone ctest-test-zone-51051216(9552e599-ed1c-4c74-b1fc-1a24f812a041)
2025-08-07 04:09:16,802 - INFO - Created control node zone ctest-test-zone-07622738(c5ff5c4e-c9c6-4ec1-a3bd-f2e1ed13ce9d)
2025-08-07 04:09:17,110 - INFO - Creating BGPaaS ctest-TestBGPaasZone-99782441-61580272
2025-08-07 04:09:17,202 - INFO - BGPaaS: ctest-TestBGPaasZone-99782441-61580272(0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598)
2025-08-07 04:09:17,202 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598
2025-08-07 04:09:17,231 - INFO - verify_in_api_server passed for BGPaaS obj 0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598
2025-08-07 04:09:17,231 - INFO - BGPaaS(0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598): verify_on_setup passed
2025-08-07 04:09:17,231 - INFO - We will configure BGP on the VM
2025-08-07 04:09:17,702 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:09:17,702 - INFO - Configuring BGP on ctest-TestBGPaasZone-99782441-81662866
2025-08-07 04:09:17,702 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 66.185.240.67;
protocol bgp bgp_1{
local as 65000;
neighbor 66.185.240.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.67;
}
protocol bfd {
neighbor 66.185.240.65 local 66.185.240.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 04:09:17,702 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 66.185.240.67;
protocol bgp bgp_1{
local as 65000;
neighbor 66.185.240.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.67;
}
protocol bfd {
neighbor 66.185.240.65 local 66.185.240.67 multihop on;
}
EOS
2025-08-07 04:09:40,669 - DEBUG - None
2025-08-07 04:09:40,669 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 66.185.240.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 04:09:40,669 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 66.185.240.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.67;
}
EOS
2025-08-07 04:09:41,866 - DEBUG - None
2025-08-07 04:09:41,866 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 04:09:41,866 - DEBUG - service bird restart
2025-08-07 04:09:45,716 - DEBUG - bird stop/waiting
bird start/running, process 1430
2025-08-07 04:09:45,717 - INFO - Attaching VMI dee9c55e-2b3f-4cdd-8758-ef76440934de to BGPaaS 0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598
2025-08-07 04:09:45,807 - INFO - Attaching the VMI 4f8eb767-2713-48cd-9396-a435467873fe to the BGPaaS 0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598 object
2025-08-07 04:09:45,807 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 66.185.240.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 04:09:45,808 - DEBUG - sudo ip addr add 66.185.240.84 dev eth0
2025-08-07 04:09:47,730 - DEBUG - None
2025-08-07 04:09:47,802 - INFO - Creating BGPaaS ctest-TestBGPaasZone-99782441-13225644
2025-08-07 04:09:47,906 - INFO - BGPaaS: ctest-TestBGPaasZone-99782441-13225644(cb33e7ee-e83a-43bd-8003-b4847bcef91b)
2025-08-07 04:09:47,906 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/cb33e7ee-e83a-43bd-8003-b4847bcef91b
2025-08-07 04:09:47,918 - INFO - verify_in_api_server passed for BGPaaS obj cb33e7ee-e83a-43bd-8003-b4847bcef91b
2025-08-07 04:09:47,918 - INFO - BGPaaS(cb33e7ee-e83a-43bd-8003-b4847bcef91b): verify_on_setup passed
2025-08-07 04:09:47,918 - INFO - We will configure BGP on the VM
2025-08-07 04:09:48,378 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:09:48,378 - INFO - Configuring BGP on ctest-TestBGPaasZone-99782441-79637793
2025-08-07 04:09:48,378 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 66.185.240.68;
protocol bgp bgp_1{
local as 65000;
neighbor 66.185.240.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.68;
}
protocol bfd {
neighbor 66.185.240.65 local 66.185.240.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 04:09:48,379 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 66.185.240.68;
protocol bgp bgp_1{
local as 65000;
neighbor 66.185.240.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.68;
}
protocol bfd {
neighbor 66.185.240.65 local 66.185.240.68 multihop on;
}
EOS
2025-08-07 04:09:53,998 - DEBUG - None
2025-08-07 04:09:53,998 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 66.185.240.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 04:09:53,998 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 66.185.240.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 66.185.240.68;
}
EOS
2025-08-07 04:09:54,515 - DEBUG - None
2025-08-07 04:09:54,515 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 04:09:54,516 - DEBUG - service bird restart
2025-08-07 04:09:56,300 - DEBUG - bird stop/waiting
bird start/running, process 1443
2025-08-07 04:09:56,300 - INFO - Attaching VMI 02be4b9a-f907-4b38-8c9b-3a6e4746ea5b to BGPaaS cb33e7ee-e83a-43bd-8003-b4847bcef91b
2025-08-07 04:09:56,386 - INFO - Attaching the VMI c3162010-ec4a-4363-9954-bc204b18dd48 to the BGPaaS cb33e7ee-e83a-43bd-8003-b4847bcef91b object
2025-08-07 04:09:56,387 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 66.185.240.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 04:09:56,387 - DEBUG - sudo ip addr add 66.185.240.84 dev eth0
2025-08-07 04:09:57,076 - DEBUG - None
2025-08-07 04:09:57,077 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:09:57,096 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-08-07 04:09:57,096 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:09:57,119 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-07 04:09:57,126 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:09:57,147 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17']
2025-08-07 04:10:03,171 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17']
2025-08-07 04:10:09,190 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-08-07 04:10:09,191 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:10:09,214 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-07 04:10:09,221 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 66.185.240.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 04:10:09,222 - DEBUG - ping -s 56 -c 3 -W 1 66.185.240.84
2025-08-07 04:10:16,748 - DEBUG - PING 66.185.240.84 (66.185.240.84) 56(84) bytes of data.
64 bytes from 66.185.240.84: icmp_seq=1 ttl=64 time=9.29 ms
64 bytes from 66.185.240.84: icmp_seq=2 ttl=64 time=1.49 ms
64 bytes from 66.185.240.84: icmp_seq=3 ttl=64 time=1.66 ms
--- 66.185.240.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.494/4.150/9.298/3.641 ms
2025-08-07 04:10:16,748 - INFO - Ping to IP 66.185.240.84 from VM ctest-TestBGPaasZone-99782441-12532078 passed
2025-08-07 04:10:16,748 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:10:16,765 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-08-07 04:10:16,765 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:10:16,788 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-07 04:10:16,798 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:10:16,814 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-08-07 04:10:16,814 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 04:10:16,836 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-07 04:10:16,844 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 66.185.240.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 04:10:16,844 - DEBUG - ping -s 56 -c 3 -W 1 66.185.240.84
2025-08-07 04:10:19,468 - DEBUG - PING 66.185.240.84 (66.185.240.84) 56(84) bytes of data.
64 bytes from 66.185.240.84: icmp_seq=1 ttl=64 time=4.87 ms
64 bytes from 66.185.240.84: icmp_seq=2 ttl=64 time=1.20 ms
64 bytes from 66.185.240.84: icmp_seq=3 ttl=64 time=1.30 ms
--- 66.185.240.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.207/2.461/4.874/1.707 ms
2025-08-07 04:10:19,468 - INFO - Ping to IP 66.185.240.84 from VM ctest-TestBGPaasZone-99782441-12532078 passed
2025-08-07 04:10:19,468 - INFO - Detaching VMI 02be4b9a-f907-4b38-8c9b-3a6e4746ea5b from BGPaaS cb33e7ee-e83a-43bd-8003-b4847bcef91b
2025-08-07 04:10:19,566 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-99782441-13225644(cb33e7ee-e83a-43bd-8003-b4847bcef91b)
2025-08-07 04:10:19,630 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/cb33e7ee-e83a-43bd-8003-b4847bcef91b
2025-08-07 04:10:19,669 - DEBUG - Response Code: 404
2025-08-07 04:10:19,669 - DEBUG - BGPaaS: cb33e7ee-e83a-43bd-8003-b4847bcef91b deleted from api server
2025-08-07 04:10:19,669 - INFO - BGPaaS(cb33e7ee-e83a-43bd-8003-b4847bcef91b): verify_on_cleanup passed
2025-08-07 04:10:19,669 - INFO - Detaching VMI dee9c55e-2b3f-4cdd-8758-ef76440934de from BGPaaS 0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598
2025-08-07 04:10:19,758 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-99782441-61580272(0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598)
2025-08-07 04:10:19,820 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598
2025-08-07 04:10:19,832 - DEBUG - Response Code: 404
2025-08-07 04:10:19,832 - DEBUG - BGPaaS: 0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598 deleted from api server
2025-08-07 04:10:19,832 - INFO - BGPaaS(0fb4c88a-9b9f-47c5-8bf7-53c2dc7c2598): verify_on_cleanup passed
2025-08-07 04:10:19,834 - INFO - Deleting Control node zone ctest-test-zone-07622738(c5ff5c4e-c9c6-4ec1-a3bd-f2e1ed13ce9d)
2025-08-07 04:10:20,004 - INFO - Deleting Control node zone ctest-test-zone-51051216(9552e599-ed1c-4c74-b1fc-1a24f812a041)
2025-08-07 04:10:20,178 - INFO - Deleting Control node zone ctest-test-zone-84364296(f8c7c558-49ca-4022-8ed4-387de9a0bb3f)
2025-08-07 04:10:20,432 - INFO - Deleting VM ctest-TestBGPaasZone-99782441-12532078
2025-08-07 04:10:20,569 - INFO - Deleting VM ctest-TestBGPaasZone-99782441-79637793
2025-08-07 04:10:20,645 - INFO - Deleting VM ctest-TestBGPaasZone-99782441-81662866
2025-08-07 04:10:20,739 - INFO - Deleting VN ctest-cnz_vn-33164834
2025-08-07 04:10:20,796 - DEBUG - VN 8c97057f-6b11-4bbf-8d57-6390b54fc6f8 still in use: Unable to complete operation on network 8c97057f-6b11-4bbf-8d57-6390b54fc6f8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9f2c1d29-728f-4022-b796-bf8902c9786d']
2025-08-07 04:10:20,797 - WARNING - Deleting VN ctest-cnz_vn-33164834 failed..Will retry
2025-08-07 04:10:23,153 - DEBUG - Response for deleting network ()
2025-08-07 04:10:24,441 - DEBUG - Skipping xmpp flap check
2025-08-07 04:10:24,442 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:04:07]
2025-08-07 04:10:24,442 - INFO - --------------------------------------------------------------------------------
2025-08-07 04:10:25,541 - INFO - Deleted project: ctest-TestBGPaasZone-99782441, ID : 395f12ee-8761-47e4-8a29-86b163f7a5ba