2026-04-30 03:40:11,228 - INFO - Domain Default found not creating 2026-04-30 03:40:11,424 - INFO - Project ctest-TestSVCV2Mirror-77154089 not found, creating it 2026-04-30 03:40:12,052 - INFO - Created Project:ctest-TestSVCV2Mirror-77154089, ID : 52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:13,546 - INFO - ================================================================================ 2026-04-30 03:40:13,546 - INFO - STARTING TEST : test_svc_v2_mirroring 2026-04-30 03:40:13,546 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2026-04-30 03:40:14,822 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.241': {'10.20.0.193': '0', '10.20.0.18': '0'}} with 2026-04-30 03:40:14,822 - INFO - Initial checks done. Running the testcase now 2026-04-30 03:40:14,822 - INFO - 2026-04-30 03:40:15,510 - DEBUG - Response for create_network : {'network': {'id': '109cb310-6572-4136-97c3-1b5f65a387a3', 'name': 'ctest-left-09762702', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-left-09762702'], 'port_security_enabled': True, 'description': ''}} 2026-04-30 03:40:15,769 - DEBUG - Response for create_subnet : {'subnet': {'id': '5744e4ae-27e7-45c9-a460-2a7862a4e205', 'name': '', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'network_id': '109cb310-6572-4136-97c3-1b5f65a387a3', 'ip_version': 4, 'cidr': '206.68.43.64/26', 'allocation_pools': [{'start': '206.68.43.66', 'end': '206.68.43.126'}], 'gateway_ip': '206.68.43.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.68.43.66', 'tags': [], 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd'}} 2026-04-30 03:40:15,796 - INFO - Created VN ctest-left-09762702 2026-04-30 03:40:15,810 - DEBUG - VN ctest-left-09762702 UUID is 109cb310-6572-4136-97c3-1b5f65a387a3 2026-04-30 03:40:15,884 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:16,188 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:16,219 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:16,237 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:16,341 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/109cb310-6572-4136-97c3-1b5f65a387a3 2026-04-30 03:40:16,353 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/109cb310-6572-4136-97c3-1b5f65a387a3 2026-04-30 03:40:16,362 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/70a86df0-8491-4260-a096-ce51931a015e 2026-04-30 03:40:16,369 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/70a86df0-8491-4260-a096-ce51931a015e 2026-04-30 03:40:16,377 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/aa18f86a-729f-4b55-8024-334cefc4ff52 2026-04-30 03:40:16,384 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-30 03:40:16,384 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/109cb310-6572-4136-97c3-1b5f65a387a3 2026-04-30 03:40:16,393 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/70a86df0-8491-4260-a096-ce51931a015e 2026-04-30 03:40:16,410 - INFO - Verified VN network id 17 for VN 109cb310-6572-4136-97c3-1b5f65a387a3 2026-04-30 03:40:16,410 - INFO - Verifications in API Server for VN ctest-left-09762702 passed 2026-04-30 03:40:16,410 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/109cb310-6572-4136-97c3-1b5f65a387a3 2026-04-30 03:40:16,420 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/70a86df0-8491-4260-a096-ce51931a015e 2026-04-30 03:40:16,427 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/70a86df0-8491-4260-a096-ce51931a015e 2026-04-30 03:40:16,437 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/aa18f86a-729f-4b55-8024-334cefc4ff52 2026-04-30 03:40:16,449 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1197028483976544566', 'uuid-lslong': '10935614416726755235'}, 'enable': 'true', 'created': '2026-04-30T03:40:15', 'last-modified': '2026-04-30T03:40:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.737491'} 2026-04-30 03:40:16,454 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-30 03:40:16,462 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1197028483976544566', 'uuid-lslong': '10935614416726755235'}, 'enable': 'true', 'created': '2026-04-30T03:40:15', 'last-modified': '2026-04-30T03:40:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.747415'} 2026-04-30 03:40:16,470 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-30 03:40:16,475 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1197028483976544566', 'uuid-lslong': '10935614416726755235'}, 'enable': 'true', 'created': '2026-04-30T03:40:15', 'last-modified': '2026-04-30T03:40:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.748080'} 2026-04-30 03:40:16,480 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-30 03:40:16,480 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-09762702 passed 2026-04-30 03:40:16,481 - DEBUG - ====Verifying policy data for ctest-left-09762702 in API_Server ====== 2026-04-30 03:40:16,481 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:16,486 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:16,499 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:16,587 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/109cb310-6572-4136-97c3-1b5f65a387a3 2026-04-30 03:40:16,598 - DEBUG - =>VN ctest-left-09762702 has no policy to be verified 2026-04-30 03:40:16,598 - DEBUG - Verifying the vn in opserver 2026-04-30 03:40:16,598 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702 virtual network link through opserver 10.0.0.73 2026-04-30 03:40:16,598 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-04-30 03:40:16,891 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-04-30 03:40:16,962 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702?flat'} 2026-04-30 03:40:16,962 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702 virtual network link through opserver 10.0.0.141 2026-04-30 03:40:16,962 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-04-30 03:40:17,260 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-04-30 03:40:17,322 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702?flat'} 2026-04-30 03:40:17,322 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702 virtual network link through opserver 10.0.0.33 2026-04-30 03:40:17,322 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-04-30 03:40:17,617 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-04-30 03:40:17,680 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702?flat'} 2026-04-30 03:40:17,680 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702 is found in opserver 2026-04-30 03:40:17,702 - DEBUG - Do not have enough data to verify VN in agent 2026-04-30 03:40:17,714 - DEBUG - VRF ids for VN ctest-left-09762702: {} 2026-04-30 03:40:18,014 - DEBUG - Response for create_network : {'network': {'id': '267bb1d0-cfa9-4b53-8712-96e09a5e1d2d', 'name': 'ctest-right-37600569', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-right-37600569'], 'port_security_enabled': True, 'description': ''}} 2026-04-30 03:40:18,287 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ed7becb1-27be-4cb7-976d-03f7b5354b02', 'name': '', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'network_id': '267bb1d0-cfa9-4b53-8712-96e09a5e1d2d', 'ip_version': 4, 'cidr': '3.146.253.128/26', 'allocation_pools': [{'start': '3.146.253.130', 'end': '3.146.253.190'}], 'gateway_ip': '3.146.253.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3.146.253.130', 'tags': [], 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd'}} 2026-04-30 03:40:18,310 - INFO - Created VN ctest-right-37600569 2026-04-30 03:40:18,323 - DEBUG - VN ctest-right-37600569 UUID is 267bb1d0-cfa9-4b53-8712-96e09a5e1d2d 2026-04-30 03:40:18,403 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:18,410 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:18,428 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:18,520 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/267bb1d0-cfa9-4b53-8712-96e09a5e1d2d 2026-04-30 03:40:18,534 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/267bb1d0-cfa9-4b53-8712-96e09a5e1d2d 2026-04-30 03:40:18,544 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/31a89529-1ce4-4a92-bbdd-eab7bda0d86d 2026-04-30 03:40:18,553 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/31a89529-1ce4-4a92-bbdd-eab7bda0d86d 2026-04-30 03:40:18,560 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/8c9e0d3e-7b59-41b2-9fef-33972a50ac6d 2026-04-30 03:40:18,567 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-30 03:40:18,567 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/267bb1d0-cfa9-4b53-8712-96e09a5e1d2d 2026-04-30 03:40:18,576 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/31a89529-1ce4-4a92-bbdd-eab7bda0d86d 2026-04-30 03:40:18,596 - INFO - Verified VN network id 18 for VN 267bb1d0-cfa9-4b53-8712-96e09a5e1d2d 2026-04-30 03:40:18,596 - INFO - Verifications in API Server for VN ctest-right-37600569 passed 2026-04-30 03:40:18,596 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/267bb1d0-cfa9-4b53-8712-96e09a5e1d2d 2026-04-30 03:40:18,606 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/31a89529-1ce4-4a92-bbdd-eab7bda0d86d 2026-04-30 03:40:18,614 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/31a89529-1ce4-4a92-bbdd-eab7bda0d86d 2026-04-30 03:40:18,623 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/8c9e0d3e-7b59-41b2-9fef-33972a50ac6d 2026-04-30 03:40:18,637 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2773005505971964755', 'uuid-lslong': '9733007636107762989'}, 'enable': 'true', 'created': '2026-04-30T03:40:17', 'last-modified': '2026-04-30T03:40:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419452'} 2026-04-30 03:40:18,642 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-30 03:40:18,648 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2773005505971964755', 'uuid-lslong': '9733007636107762989'}, 'enable': 'true', 'created': '2026-04-30T03:40:17', 'last-modified': '2026-04-30T03:40:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432032'} 2026-04-30 03:40:18,655 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-30 03:40:18,660 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2773005505971964755', 'uuid-lslong': '9733007636107762989'}, 'enable': 'true', 'created': '2026-04-30T03:40:17', 'last-modified': '2026-04-30T03:40:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443054'} 2026-04-30 03:40:18,667 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-30 03:40:18,667 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-37600569 passed 2026-04-30 03:40:18,667 - DEBUG - ====Verifying policy data for ctest-right-37600569 in API_Server ====== 2026-04-30 03:40:18,668 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:18,674 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:18,684 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:18,775 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/267bb1d0-cfa9-4b53-8712-96e09a5e1d2d 2026-04-30 03:40:18,787 - DEBUG - =>VN ctest-right-37600569 has no policy to be verified 2026-04-30 03:40:18,787 - DEBUG - Verifying the vn in opserver 2026-04-30 03:40:18,787 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569 virtual network link through opserver 10.0.0.73 2026-04-30 03:40:18,787 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-04-30 03:40:18,849 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569?flat'} 2026-04-30 03:40:18,849 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569 virtual network link through opserver 10.0.0.141 2026-04-30 03:40:18,849 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-04-30 03:40:18,914 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569?flat'} 2026-04-30 03:40:18,914 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569 virtual network link through opserver 10.0.0.33 2026-04-30 03:40:18,915 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-04-30 03:40:18,980 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569?flat'} 2026-04-30 03:40:18,980 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569 is found in opserver 2026-04-30 03:40:19,001 - DEBUG - Do not have enough data to verify VN in agent 2026-04-30 03:40:19,013 - DEBUG - VRF ids for VN ctest-right-37600569: {} 2026-04-30 03:40:19,293 - DEBUG - Response for create_network : {'network': {'id': '1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6', 'name': 'ctest-mgmt_vn-63435703', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-mgmt_vn-63435703'], 'port_security_enabled': True, 'description': ''}} 2026-04-30 03:40:19,523 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd10e0d2b-659f-4a63-81a1-6afd988722f2', 'name': '', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'network_id': '1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6', 'ip_version': 4, 'cidr': '109.6.102.0/26', 'allocation_pools': [{'start': '109.6.102.2', 'end': '109.6.102.62'}], 'gateway_ip': '109.6.102.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '109.6.102.2', 'tags': [], 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd'}} 2026-04-30 03:40:19,545 - INFO - Created VN ctest-mgmt_vn-63435703 2026-04-30 03:40:19,558 - DEBUG - VN ctest-mgmt_vn-63435703 UUID is 1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6 2026-04-30 03:40:19,630 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:19,636 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:19,648 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:19,743 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6 2026-04-30 03:40:19,755 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6 2026-04-30 03:40:19,764 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/efa9f652-2d95-457a-9913-4b04b082f38b 2026-04-30 03:40:19,772 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/efa9f652-2d95-457a-9913-4b04b082f38b 2026-04-30 03:40:19,780 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/e013f4ce-034d-43e7-99b4-1aa5cbbc7797 2026-04-30 03:40:19,789 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-30 03:40:19,789 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6 2026-04-30 03:40:19,801 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/efa9f652-2d95-457a-9913-4b04b082f38b 2026-04-30 03:40:19,818 - INFO - Verified VN network id 19 for VN 1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6 2026-04-30 03:40:19,819 - INFO - Verifications in API Server for VN ctest-mgmt_vn-63435703 passed 2026-04-30 03:40:19,819 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6 2026-04-30 03:40:19,829 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/efa9f652-2d95-457a-9913-4b04b082f38b 2026-04-30 03:40:19,837 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/efa9f652-2d95-457a-9913-4b04b082f38b 2026-04-30 03:40:19,845 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/e013f4ce-034d-43e7-99b4-1aa5cbbc7797 2026-04-30 03:40:19,858 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2165169249487638481', 'uuid-lslong': '13106292952647956950'}, 'enable': 'true', 'created': '2026-04-30T03:40:19', 'last-modified': '2026-04-30T03:40:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393697'} 2026-04-30 03:40:19,864 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-30 03:40:19,870 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2165169249487638481', 'uuid-lslong': '13106292952647956950'}, 'enable': 'true', 'created': '2026-04-30T03:40:19', 'last-modified': '2026-04-30T03:40:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410104'} 2026-04-30 03:40:19,876 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-30 03:40:19,882 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2165169249487638481', 'uuid-lslong': '13106292952647956950'}, 'enable': 'true', 'created': '2026-04-30T03:40:19', 'last-modified': '2026-04-30T03:40:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423814'} 2026-04-30 03:40:19,887 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-30 03:40:19,888 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-63435703 passed 2026-04-30 03:40:19,888 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-63435703 in API_Server ====== 2026-04-30 03:40:19,888 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:19,894 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:19,905 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:20,007 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/1e0c39f5-fa4f-4fd1-b5e2-e80014c979d6 2026-04-30 03:40:20,022 - DEBUG - =>VN ctest-mgmt_vn-63435703 has no policy to be verified 2026-04-30 03:40:20,022 - DEBUG - Verifying the vn in opserver 2026-04-30 03:40:20,022 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703 virtual network link through opserver 10.0.0.73 2026-04-30 03:40:20,022 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-04-30 03:40:20,093 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703?flat'} 2026-04-30 03:40:20,093 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703 virtual network link through opserver 10.0.0.141 2026-04-30 03:40:20,093 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-04-30 03:40:20,161 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703?flat'} 2026-04-30 03:40:20,161 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703 virtual network link through opserver 10.0.0.33 2026-04-30 03:40:20,161 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-04-30 03:40:20,236 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703?flat'} 2026-04-30 03:40:20,236 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-mgmt_vn-63435703 is found in opserver 2026-04-30 03:40:20,261 - DEBUG - Do not have enough data to verify VN in agent 2026-04-30 03:40:20,272 - DEBUG - VRF ids for VN ctest-mgmt_vn-63435703: {} 2026-04-30 03:40:20,563 - DEBUG - Response for create_network : {'network': {'id': '348a1be7-6081-4805-bc09-0121c69c13f7', 'name': 'ctest-trans_left_vn-70741100', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-trans_left_vn-70741100'], 'port_security_enabled': True, 'description': ''}} 2026-04-30 03:40:20,807 - DEBUG - Response for create_subnet : {'subnet': {'id': '0d64d0d8-45e0-4c85-a8fa-aea90f70d137', 'name': '', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'network_id': '348a1be7-6081-4805-bc09-0121c69c13f7', 'ip_version': 4, 'cidr': '22.102.20.192/26', 'allocation_pools': [{'start': '22.102.20.194', 'end': '22.102.20.254'}], 'gateway_ip': '22.102.20.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22.102.20.194', 'tags': [], 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd'}} 2026-04-30 03:40:20,833 - INFO - Created VN ctest-trans_left_vn-70741100 2026-04-30 03:40:20,849 - DEBUG - VN ctest-trans_left_vn-70741100 UUID is 348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:20,930 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:20,937 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:20,949 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:21,042 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:21,053 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:21,062 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:40:21,069 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:40:21,088 - DEBUG - Route Targets: [] 2026-04-30 03:40:21,088 - DEBUG - RT names not yet present for VN ctest-trans_left_vn-70741100 2026-04-30 03:40:26,088 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:26,095 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:26,106 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:26,196 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:26,208 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:26,217 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:40:26,229 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:40:26,238 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/05abc318-e3a2-493d-b9b1-900e774d5cd2 2026-04-30 03:40:26,246 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-30 03:40:26,246 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:26,256 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:40:26,271 - INFO - Verified VN network id 20 for VN 348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:26,271 - INFO - Verifications in API Server for VN ctest-trans_left_vn-70741100 passed 2026-04-30 03:40:26,271 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:26,280 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:40:26,287 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:40:26,294 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/05abc318-e3a2-493d-b9b1-900e774d5cd2 2026-04-30 03:40:26,305 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3785869117328803845', 'uuid-lslong': '13549362198498513911'}, 'enable': 'true', 'created': '2026-04-30T03:40:20', 'last-modified': '2026-04-30T03:40:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.551012'} 2026-04-30 03:40:26,310 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-30 03:40:26,316 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3785869117328803845', 'uuid-lslong': '13549362198498513911'}, 'enable': 'true', 'created': '2026-04-30T03:40:20', 'last-modified': '2026-04-30T03:40:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.560803'} 2026-04-30 03:40:26,324 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-30 03:40:26,329 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3785869117328803845', 'uuid-lslong': '13549362198498513911'}, 'enable': 'true', 'created': '2026-04-30T03:40:20', 'last-modified': '2026-04-30T03:40:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.580321'} 2026-04-30 03:40:26,335 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-30 03:40:26,335 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-70741100 passed 2026-04-30 03:40:26,335 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-70741100 in API_Server ====== 2026-04-30 03:40:26,335 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:26,341 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:26,353 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:26,444 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/348a1be7-6081-4805-bc09-0121c69c13f7 2026-04-30 03:40:26,454 - DEBUG - =>VN ctest-trans_left_vn-70741100 has no policy to be verified 2026-04-30 03:40:26,454 - DEBUG - Verifying the vn in opserver 2026-04-30 03:40:26,454 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 virtual network link through opserver 10.0.0.73 2026-04-30 03:40:26,454 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-04-30 03:40:26,467 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100?flat'} 2026-04-30 03:40:26,467 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 virtual network link through opserver 10.0.0.141 2026-04-30 03:40:26,467 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-04-30 03:40:26,482 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100?flat'} 2026-04-30 03:40:26,482 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 virtual network link through opserver 10.0.0.33 2026-04-30 03:40:26,482 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-04-30 03:40:26,495 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100?flat'} 2026-04-30 03:40:26,495 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is found in opserver 2026-04-30 03:40:26,516 - DEBUG - Do not have enough data to verify VN in agent 2026-04-30 03:40:26,526 - DEBUG - VRF ids for VN ctest-trans_left_vn-70741100: {} 2026-04-30 03:40:26,793 - DEBUG - Response for create_network : {'network': {'id': '2de12b9b-e2ba-40a8-be53-e48c0bb7cf15', 'name': 'ctest-trans_right_vn-91883403', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-trans_right_vn-91883403'], 'port_security_enabled': True, 'description': ''}} 2026-04-30 03:40:27,067 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f4b3bda7-a09e-458f-af21-f865dbc97eca', 'name': '', 'tenant_id': '52eadd7b0d73401d99aed3aa6bd651dd', 'network_id': '2de12b9b-e2ba-40a8-be53-e48c0bb7cf15', 'ip_version': 4, 'cidr': '47.58.20.192/26', 'allocation_pools': [{'start': '47.58.20.194', 'end': '47.58.20.254'}], 'gateway_ip': '47.58.20.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '47.58.20.194', 'tags': [], 'project_id': '52eadd7b0d73401d99aed3aa6bd651dd'}} 2026-04-30 03:40:27,088 - INFO - Created VN ctest-trans_right_vn-91883403 2026-04-30 03:40:27,101 - DEBUG - VN ctest-trans_right_vn-91883403 UUID is 2de12b9b-e2ba-40a8-be53-e48c0bb7cf15 2026-04-30 03:40:27,177 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:27,184 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:27,194 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:27,284 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/2de12b9b-e2ba-40a8-be53-e48c0bb7cf15 2026-04-30 03:40:27,295 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/2de12b9b-e2ba-40a8-be53-e48c0bb7cf15 2026-04-30 03:40:27,304 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/807470e9-5035-452b-a3a0-eab2410b04c6 2026-04-30 03:40:27,313 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/807470e9-5035-452b-a3a0-eab2410b04c6 2026-04-30 03:40:27,320 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/457a325b-4d1f-49aa-9643-e28d57ea9f9c 2026-04-30 03:40:27,327 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-30 03:40:27,327 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/2de12b9b-e2ba-40a8-be53-e48c0bb7cf15 2026-04-30 03:40:27,335 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/807470e9-5035-452b-a3a0-eab2410b04c6 2026-04-30 03:40:27,350 - INFO - Verified VN network id 21 for VN 2de12b9b-e2ba-40a8-be53-e48c0bb7cf15 2026-04-30 03:40:27,350 - INFO - Verifications in API Server for VN ctest-trans_right_vn-91883403 passed 2026-04-30 03:40:27,350 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/2de12b9b-e2ba-40a8-be53-e48c0bb7cf15 2026-04-30 03:40:27,359 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/807470e9-5035-452b-a3a0-eab2410b04c6 2026-04-30 03:40:27,367 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/807470e9-5035-452b-a3a0-eab2410b04c6 2026-04-30 03:40:27,377 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/457a325b-4d1f-49aa-9643-e28d57ea9f9c 2026-04-30 03:40:27,389 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3305971549990437032', 'uuid-lslong': '13714556580416442133'}, 'enable': 'true', 'created': '2026-04-30T03:40:26', 'last-modified': '2026-04-30T03:40:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372921'} 2026-04-30 03:40:27,394 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-30 03:40:27,402 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3305971549990437032', 'uuid-lslong': '13714556580416442133'}, 'enable': 'true', 'created': '2026-04-30T03:40:26', 'last-modified': '2026-04-30T03:40:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.394008'} 2026-04-30 03:40:27,410 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-30 03:40:27,414 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-77154089', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3305971549990437032', 'uuid-lslong': '13714556580416442133'}, 'enable': 'true', 'created': '2026-04-30T03:40:26', 'last-modified': '2026-04-30T03:40:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408307'} 2026-04-30 03:40:27,421 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-30 03:40:27,421 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-91883403 passed 2026-04-30 03:40:27,421 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-91883403 in API_Server ====== 2026-04-30 03:40:27,421 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:40:27,427 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:40:27,438 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:40:27,536 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/2de12b9b-e2ba-40a8-be53-e48c0bb7cf15 2026-04-30 03:40:27,548 - DEBUG - =>VN ctest-trans_right_vn-91883403 has no policy to be verified 2026-04-30 03:40:27,548 - DEBUG - Verifying the vn in opserver 2026-04-30 03:40:27,548 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403 virtual network link through opserver 10.0.0.73 2026-04-30 03:40:27,548 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-04-30 03:40:27,562 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403?flat'} 2026-04-30 03:40:27,562 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403 virtual network link through opserver 10.0.0.141 2026-04-30 03:40:27,562 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-04-30 03:40:27,581 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403?flat'} 2026-04-30 03:40:27,581 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403 virtual network link through opserver 10.0.0.33 2026-04-30 03:40:27,581 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-04-30 03:40:27,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403?flat'} 2026-04-30 03:40:27,595 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_right_vn-91883403 is found in opserver 2026-04-30 03:40:27,618 - DEBUG - Do not have enough data to verify VN in agent 2026-04-30 03:40:27,629 - DEBUG - VRF ids for VN ctest-trans_right_vn-91883403: {} 2026-04-30 03:40:27,761 - DEBUG - Services list from nova: [, , , ] 2026-04-30 03:40:28,979 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5725-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5725-2) 2026-04-30 03:40:30,340 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5725-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5725-1) 2026-04-30 03:40:30,340 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-96036826'] 2026-04-30 03:40:30,659 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-96036826'] created succesfully 2026-04-30 03:40:32,097 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5725-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5725-2) 2026-04-30 03:40:32,097 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:40:32,401 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:40:32,436 - DEBUG - Response Code: 404 2026-04-30 03:40:34,437 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:40:34,448 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/ba5c6e00-ab9e-41d0-a39e-23668a389483 2026-04-30 03:40:34,530 - INFO - Waiting for VM ctest-pt_svm0-96592685 to be up.. 2026-04-30 03:40:34,618 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-04-30 03:40:39,721 - DEBUG - VM is in ACTIVE state now 2026-04-30 03:40:39,721 - INFO - VM name : ctest-pt_svm0-96592685 2026-04-30 03:40:39,829 - DEBUG - VM ctest-pt_svm0-96592685 ID is 25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:40:39,859 - DEBUG - VM ctest-pt_svm0-96592685 launched on Node an-jenkins-deploy-platform-ansible-os-5725-2 2026-04-30 03:40:39,949 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:40:39,958 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/ba5c6e00-ab9e-41d0-a39e-23668a389483 2026-04-30 03:40:43,142 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2026-04-30 03:40:43,142 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:40:43,159 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:40:47,239 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-04-30 03:40:47,239 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:40:47,254 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:40:51,329 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-04-30 03:40:51,329 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:40:51,346 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:40:55,428 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-04-30 03:40:55,428 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:40:55,447 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:40:59,522 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-04-30 03:40:59,522 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:40:59,536 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:41:03,622 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-04-30 03:41:03,622 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:41:03,639 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:41:07,718 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-04-30 03:41:07,718 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:41:07,735 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:41:11,848 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms') 2026-04-30 03:41:11,848 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:41:11,863 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:41:15,940 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-04-30 03:41:15,940 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:41:15,956 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:41:20,035 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-04-30 03:41:20,035 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:41:20,054 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:41:24,127 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-04-30 03:41:24,127 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 failed! 2026-04-30 03:41:24,142 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is 22.102.20.193 and allocation pool is NOT set 2026-04-30 03:41:26,220 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=64 time=8.42 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=64 time=0.759 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.759/4.589/8.419/3.830 ms') 2026-04-30 03:41:26,220 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 passed 2026-04-30 03:41:26,287 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:26,287 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96592685, IP 22.102.20.195, Port 22 2026-04-30 03:41:26,356 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-30 03:41:26,443 - DEBUG - VM ctest-pt_svm0-96592685 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-30 03:41:31,443 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:31,444 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96592685, IP 22.102.20.195, Port 22 2026-04-30 03:41:31,512 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-30 03:41:31,608 - DEBUG - VM ctest-pt_svm0-96592685 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-30 03:41:36,609 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:36,609 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96592685, IP 22.102.20.195, Port 22 2026-04-30 03:41:36,687 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-30 03:41:36,799 - DEBUG - VM ctest-pt_svm0-96592685 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-30 03:41:41,799 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:41,799 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96592685, IP 22.102.20.195, Port 22 2026-04-30 03:41:41,868 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-30 03:41:41,953 - DEBUG - VM ctest-pt_svm0-96592685 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-30 03:41:46,954 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:46,954 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96592685, IP 22.102.20.195, Port 22 2026-04-30 03:41:47,020 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-30 03:41:47,109 - DEBUG - VM ctest-pt_svm0-96592685 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-30 03:41:52,110 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:52,110 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-96592685, IP 22.102.20.195, Port 22 2026-04-30 03:41:52,279 - DEBUG - VM ctest-pt_svm0-96592685 is ready for SSH connections 2026-04-30 03:41:52,286 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-si-44813136'] 2026-04-30 03:41:52,794 - INFO - Waiting for VM ctest-left_vm-20575195 to be up.. 2026-04-30 03:41:52,913 - DEBUG - VM is in ACTIVE state now 2026-04-30 03:41:52,914 - INFO - VM name : ctest-left_vm-20575195 2026-04-30 03:41:53,012 - DEBUG - VM ctest-left_vm-20575195 ID is 28db9ce5-628e-44ca-a790-8c989c86813e 2026-04-30 03:41:53,012 - DEBUG - VM ctest-left_vm-20575195 launched on Node an-jenkins-deploy-platform-ansible-os-5725-2 2026-04-30 03:41:53,168 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/28db9ce5-628e-44ca-a790-8c989c86813e 2026-04-30 03:41:53,179 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/0d364934-b418-480c-b52a-a3ee2afc7764 2026-04-30 03:41:54,370 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.16 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=3.84 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.835/3.999/4.164/0.164 ms') 2026-04-30 03:41:54,370 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-left_vm-20575195 passed 2026-04-30 03:41:54,444 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:54,444 - DEBUG - Waiting to SSH to VM ctest-left_vm-20575195, IP 206.68.43.67, Port 22 2026-04-30 03:41:54,617 - DEBUG - VM ctest-left_vm-20575195 is ready for SSH connections 2026-04-30 03:41:54,617 - INFO - Waiting for VM ctest-right_vm-11042012 to be up.. 2026-04-30 03:41:54,731 - DEBUG - VM is in ACTIVE state now 2026-04-30 03:41:54,731 - INFO - VM name : ctest-right_vm-11042012 2026-04-30 03:41:54,822 - DEBUG - VM ctest-right_vm-11042012 ID is af5ffff3-1634-41e1-a51a-6ad2364e5380 2026-04-30 03:41:54,823 - DEBUG - VM ctest-right_vm-11042012 launched on Node an-jenkins-deploy-platform-ansible-os-5725-1 2026-04-30 03:41:54,915 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/af5ffff3-1634-41e1-a51a-6ad2364e5380 2026-04-30 03:41:54,925 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/9581bf3d-a4f3-432a-b081-c5cd17eca9a6 2026-04-30 03:41:56,100 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.62 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=1.40 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.404/2.514/3.624/1.110 ms') 2026-04-30 03:41:56,100 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-right_vm-11042012 passed 2026-04-30 03:41:56,172 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:41:56,172 - DEBUG - Waiting to SSH to VM ctest-right_vm-11042012, IP 3.146.253.131, Port 22 2026-04-30 03:41:56,349 - DEBUG - VM ctest-right_vm-11042012 is ready for SSH connections 2026-04-30 03:41:56,356 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-si-44813136, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-04-30 03:41:56,690 - INFO - Attaching policy ctest-policy-59950678 to vn ctest-left-09762702 2026-04-30 03:41:57,056 - INFO - Attaching policy ctest-policy-59950678 to vn ctest-right-37600569 2026-04-30 03:41:57,393 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-96036826'] created succesfully 2026-04-30 03:41:57,585 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-si-44813136'] created succesfully 2026-04-30 03:41:57,585 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:41:57,591 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:41:57,608 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:41:57,708 - DEBUG - Requesting: http://10.0.0.73:8082/service-instance/c0b37844-c582-47f3-a103-7b7a68841a8f 2026-04-30 03:41:57,718 - DEBUG - SI 'ctest-si-44813136' has service template ref to ctest-service_template_1-96036826 2026-04-30 03:41:57,718 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:41:57,723 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:41:57,733 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:41:57,821 - DEBUG - Requesting: http://10.0.0.73:8082/service-instance/c0b37844-c582-47f3-a103-7b7a68841a8f 2026-04-30 03:41:57,828 - DEBUG - Requesting: http://10.0.0.73:8082/port-tuple/e9e6cc00-693a-485e-8926-4c8ea2119be5 2026-04-30 03:41:57,835 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-machine-interface/ba5c6e00-ab9e-41d0-a39e-23668a389483 2026-04-30 03:41:58,067 - DEBUG - VM is in ACTIVE state now 2026-04-30 03:41:58,299 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:41:58,307 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/ba5c6e00-ab9e-41d0-a39e-23668a389483 2026-04-30 03:41:58,317 - DEBUG - Requesting: http://10.0.0.33:8082/instance-ip/1036e7e4-5485-42ad-9332-5ccb9fca6c0a 2026-04-30 03:41:58,325 - DEBUG - Requesting: http://10.0.0.33:8082/instance-ip/dfd42fc2-b9d1-4e8a-a9c5-d60773209eaa 2026-04-30 03:41:58,333 - DEBUG - Requesting: http://10.0.0.33:8082/instance-ip/f72e3bd8-ab27-47a1-a16c-841293a33972 2026-04-30 03:41:58,519 - DEBUG - VM is in ACTIVE state now 2026-04-30 03:41:58,519 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:41:58,528 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/ba5c6e00-ab9e-41d0-a39e-23668a389483 2026-04-30 03:41:59,707 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=64 time=3.53 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=64 time=0.722 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.722/2.123/3.525/1.401 ms') 2026-04-30 03:41:59,707 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-96592685 passed 2026-04-30 03:41:59,747 - DEBUG - VM ctest-pt_svm0-96592685 Tap interface: {'index': '6', 'name': 'tapba5c6e00-ab', 'uuid': 'ba5c6e00-ab9e-41d0-a39e-23668a389483', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100:ctest-trans_left_vn-70741100', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '46', 'l2_label': '48', 'vxlan_id': '20', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'vm_uuid': '25b402ea-edde-4a0d-a37b-a5c9af11677e', 'vm_name': 'ctest-pt_svm0-96592685', 'ip_addr': '22.102.20.195', 'mac_addr': '02:ba:5c:6e:00:ab', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ba5c6e00-ab9e-41d0-a39e-23668a389483', 'sg_uuid_list': ['72e1d800-cc4c-4e7a-af11-b4739f05db6b'], 'static_route_list': None, 'vm_project_uuid': '52eadd7b-0d73-401d-99ae-d3aa6bd651dd', 'admin_state': 'Enabled', 'flow_key_idx': '58', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-30 03:41:59,747 - DEBUG - Agent 10.0.0.241 vrf name: default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100:ctest-trans_left_vn-70741100 2026-04-30 03:41:59,754 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100:ctest-trans_left_vn-70741100', 'ucindex': '5', 'mcindex': '5', 'l2index': '5', 'source': 'Config; ', 'uc6index': '5', 'vn': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'table_label': '-1', 'vxlan_id': '20', 'evpnindex': '5', 'brindex': '5', 'mplsindex': '0', 'RD': '10.20.0.201:5', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-04-30 03:41:59,841 - DEBUG - VM ctest-pt_svm0-96592685 : Tap interface tapba5c6e00-ab is set to Active 2026-04-30 03:41:59,841 - DEBUG - Tap interface tapba5c6e00-ab detail : {'index': '6', 'name': 'tapba5c6e00-ab', 'uuid': 'ba5c6e00-ab9e-41d0-a39e-23668a389483', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100:ctest-trans_left_vn-70741100', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '46', 'l2_label': '48', 'vxlan_id': '20', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100', 'vm_uuid': '25b402ea-edde-4a0d-a37b-a5c9af11677e', 'vm_name': 'ctest-pt_svm0-96592685', 'ip_addr': '22.102.20.195', 'mac_addr': '02:ba:5c:6e:00:ab', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-77154089:ba5c6e00-ab9e-41d0-a39e-23668a389483', 'sg_uuid_list': ['72e1d800-cc4c-4e7a-af11-b4739f05db6b'], 'static_route_list': None, 'vm_project_uuid': '52eadd7b-0d73-401d-99ae-d3aa6bd651dd', 'admin_state': 'Enabled', 'flow_key_idx': '58', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-30 03:41:59,955 - DEBUG - Starting Layer 2 verification in Agent 2026-04-30 03:41:59,966 - DEBUG - Layer 2 path is seen for VM MAC 02:ba:5c:6e:00:ab in agent 10.0.0.241 2026-04-30 03:41:59,966 - DEBUG - Active layer 2 route in agent is present for VMI tapba5c6e00-ab 2026-04-30 03:41:59,966 - DEBUG - L2 label(48) matches bw route table and interface table 2026-04-30 03:41:59,978 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is found in Agent of node 10.0.0.241 2026-04-30 03:42:00,115 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 is consistent in agent 10.0.0.241 2026-04-30 03:42:00,115 - DEBUG - Route for VM IP ['22.102.20.195'] is consistent in agent 10.0.0.241 2026-04-30 03:42:00,115 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-trans_left_vn-70741100 verification for VM ctest-pt_svm0-96592685 in Agent 10.0.0.241 passed 2026-04-30 03:42:00,232 - DEBUG - Starting all layer 2 verification in agent 10.0.0.241 2026-04-30 03:42:00,244 - DEBUG - Route for VM MAC 02:ba:5c:6e:00:ab is consistent in agent 10.0.0.241 2026-04-30 03:42:00,245 - INFO - VM ctest-pt_svm0-96592685 verifications in Compute nodes passed 2026-04-30 03:42:00,245 - DEBUG - The SVMs in the SI are : [] 2026-04-30 03:42:00,245 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:42:00,255 - DEBUG - Service VM for SI 'ctest-si-44813136' is launched 2026-04-30 03:42:00,255 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:42:00,261 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:42:00,274 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:42:00,367 - DEBUG - Requesting: http://10.0.0.73:8082/service-instance/c0b37844-c582-47f3-a103-7b7a68841a8f 2026-04-30 03:42:00,376 - DEBUG - SI ctest-si-44813136 has Port Tuple: ['ctest-port_tuple-52793638'] 2026-04-30 03:42:00,443 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702 2026-04-30 03:42:00,550 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569 2026-04-30 03:42:00,550 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:42:00,550 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:42:00,550 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.146.253.131, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2026-04-30 03:42:00,551 - DEBUG - ping -s 56 -c 3 -W 1 3.146.253.131 2026-04-30 03:42:53,338 - DEBUG - PING 3.146.253.131 (3.146.253.131) 56(84) bytes of data. 64 bytes from 3.146.253.131: icmp_req=1 ttl=63 time=10.2 ms 64 bytes from 3.146.253.131: icmp_req=2 ttl=63 time=1.47 ms 64 bytes from 3.146.253.131: icmp_req=3 ttl=63 time=2.14 ms --- 3.146.253.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.470/4.618/10.244/3.987 ms 2026-04-30 03:42:53,338 - INFO - Ping to IP 3.146.253.131 from VM ctest-left_vm-20575195 passed 2026-04-30 03:42:53,349 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-si-44813136, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-left-09762702, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-right-37600569, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-77154089:ctest-si-44813136, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-04-30 03:42:53,425 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-30 03:42:53,425 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:42:53,431 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:42:53,443 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:42:53,543 - DEBUG - Requesting: http://10.0.0.73:8082/service-instance/c0b37844-c582-47f3-a103-7b7a68841a8f 2026-04-30 03:42:53,551 - DEBUG - Requesting: http://10.0.0.73:8082/port-tuple/e9e6cc00-693a-485e-8926-4c8ea2119be5 2026-04-30 03:42:53,558 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-machine-interface/ba5c6e00-ab9e-41d0-a39e-23668a389483 2026-04-30 03:42:53,775 - DEBUG - Executing command: rm -f /tmp/mirror-tapba5c6e00-ab_ctest-random-92093401.pcap 2026-04-30 03:43:03,924 - INFO - Starting tcpdump to capture the mirrored packets. 2026-04-30 03:43:03,924 - DEBUG - Executing command: sudo tcpdump -ni tapba5c6e00-ab -U udp port 8099 -w /tmp/mirror-tapba5c6e00-ab_ctest-random-92093401.pcap 2026-04-30 03:43:13,950 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.146.253.131, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2026-04-30 03:43:13,951 - DEBUG - ping -s 56 -c 3 -W 1 3.146.253.131 2026-04-30 03:43:16,490 - DEBUG - PING 3.146.253.131 (3.146.253.131) 56(84) bytes of data. 64 bytes from 3.146.253.131: icmp_req=1 ttl=63 time=3.02 ms 64 bytes from 3.146.253.131: icmp_req=2 ttl=63 time=1.73 ms 64 bytes from 3.146.253.131: icmp_req=3 ttl=63 time=1.72 ms --- 3.146.253.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.725/2.163/3.026/0.611 ms 2026-04-30 03:43:16,491 - INFO - Ping to IP 3.146.253.131 from VM ctest-left_vm-20575195 passed 2026-04-30 03:43:16,491 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:43:16,500 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:43:16,516 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:43:16,639 - DEBUG - Requesting: http://10.0.0.73:8082/service-instance/c0b37844-c582-47f3-a103-7b7a68841a8f 2026-04-30 03:43:16,649 - DEBUG - Requesting: http://10.0.0.73:8082/port-tuple/e9e6cc00-693a-485e-8926-4c8ea2119be5 2026-04-30 03:43:16,658 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-machine-interface/ba5c6e00-ab9e-41d0-a39e-23668a389483 2026-04-30 03:43:16,780 - DEBUG - Waiting for the tcpdump write to complete. 2026-04-30 03:43:18,782 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tapba5c6e00-ab_ctest-random-92093401.pcap| awk '{print $2}') 2026-04-30 03:43:18,785 - DEBUG - Executing command: sync 2026-04-30 03:43:21,820 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapba5c6e00-ab_ctest-random-92093401.pcap | wc -l 2026-04-30 03:43:21,838 - DEBUG - STDOUT: 12 2026-04-30 03:43:21,838 - DEBUG - STDERR: reading from file /tmp/mirror-tapba5c6e00-ab_ctest-random-92093401.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-04-30 03:43:21,838 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapba5c6e00-ab_ctest-random-92093401.pcap 2026-04-30 03:43:21,883 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-96592685' 2026-04-30 03:43:21,883 - INFO - Dettaching policy ctest-policy-59950678 from vn ctest-right-37600569 2026-04-30 03:43:22,045 - INFO - Dettaching policy ctest-policy-59950678 from vn ctest-left-09762702 2026-04-30 03:43:22,345 - INFO - Deleted policy ctest-policy-59950678 2026-04-30 03:43:22,346 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-si-44813136'] 2026-04-30 03:43:22,457 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-77154089', 'ctest-si-44813136'] 2026-04-30 03:43:22,457 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:43:22,466 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:43:22,523 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:43:22,626 - DEBUG - Service instance ctest-si-44813136 removed from api server 2026-04-30 03:43:22,626 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-machine/25b402ea-edde-4a0d-a37b-a5c9af11677e 2026-04-30 03:43:22,645 - DEBUG - All Service VMs unlinked from SI ctest-si-44813136 2026-04-30 03:43:22,651 - DEBUG - 0 svc intances found in all projects. They are [] 2026-04-30 03:43:22,651 - DEBUG - 0 svc intances found in current project. They are [] 2026-04-30 03:43:22,698 - DEBUG - 0 svc intances found in all projects. They are [] 2026-04-30 03:43:22,698 - DEBUG - 0 svc intances found in current project. They are [] 2026-04-30 03:43:22,698 - INFO - Deleting VM ctest-pt_svm0-96592685 2026-04-30 03:43:22,793 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-96036826'] 2026-04-30 03:43:22,886 - INFO - Service template: ['default-domain', 'ctest-service_template_1-96036826'] deleted successfully. 2026-04-30 03:43:22,886 - INFO - Deleting VM ctest-right_vm-11042012 2026-04-30 03:43:22,957 - INFO - Deleting VM ctest-left_vm-20575195 2026-04-30 03:43:23,028 - INFO - Deleting VN ctest-trans_right_vn-91883403 2026-04-30 03:43:23,185 - DEBUG - Response for deleting network () 2026-04-30 03:43:23,185 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/807470e9-5035-452b-a3a0-eab2410b04c6 2026-04-30 03:43:23,190 - DEBUG - Response Code: 404 2026-04-30 03:43:23,191 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:43:23,199 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:43:23,259 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:43:23,360 - INFO - Validated that VN ctest-trans_right_vn-91883403 is not found in API Server 2026-04-30 03:43:23,376 - DEBUG - VN ctest-trans_right_vn-91883403 is not present in Agent 10.0.0.19 2026-04-30 03:43:23,389 - DEBUG - VN ctest-trans_right_vn-91883403 is not present in Agent 10.0.0.241 2026-04-30 03:43:23,389 - INFO - Validated that VN ctest-trans_right_vn-91883403 is not in any agent 2026-04-30 03:43:23,427 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-91883403 info 2026-04-30 03:43:23,427 - INFO - Deleting VN ctest-trans_left_vn-70741100 2026-04-30 03:43:23,481 - DEBUG - VN 348a1be7-6081-4805-bc09-0121c69c13f7 still in use: Unable to complete operation on network 348a1be7-6081-4805-bc09-0121c69c13f7. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f1e8fc24-77e1-401b-a3a0-9675c0c13a35'] 2026-04-30 03:43:23,481 - WARNING - Deleting VN ctest-trans_left_vn-70741100 failed..Will retry 2026-04-30 03:43:25,642 - DEBUG - Response for deleting network () 2026-04-30 03:43:25,642 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/0614cd8e-3cde-456d-82ac-cb5e3c9e1517 2026-04-30 03:43:25,652 - DEBUG - Response Code: 404 2026-04-30 03:43:25,652 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:43:25,658 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:43:25,685 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:43:25,785 - INFO - Validated that VN ctest-trans_left_vn-70741100 is not found in API Server 2026-04-30 03:43:25,797 - DEBUG - VN ctest-trans_left_vn-70741100 is not present in Agent 10.0.0.19 2026-04-30 03:43:25,809 - DEBUG - VN ctest-trans_left_vn-70741100 is not present in Agent 10.0.0.241 2026-04-30 03:43:25,809 - INFO - Validated that VN ctest-trans_left_vn-70741100 is not in any agent 2026-04-30 03:43:25,842 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-70741100 info 2026-04-30 03:43:25,842 - INFO - Deleting VN ctest-mgmt_vn-63435703 2026-04-30 03:43:26,002 - DEBUG - Response for deleting network () 2026-04-30 03:43:26,002 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/efa9f652-2d95-457a-9913-4b04b082f38b 2026-04-30 03:43:26,009 - DEBUG - Response Code: 404 2026-04-30 03:43:26,010 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:43:26,018 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:43:26,075 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:43:26,170 - INFO - Validated that VN ctest-mgmt_vn-63435703 is not found in API Server 2026-04-30 03:43:26,180 - DEBUG - VN ctest-mgmt_vn-63435703 is not present in Agent 10.0.0.19 2026-04-30 03:43:26,194 - DEBUG - VN ctest-mgmt_vn-63435703 is not present in Agent 10.0.0.241 2026-04-30 03:43:26,194 - INFO - Validated that VN ctest-mgmt_vn-63435703 is not in any agent 2026-04-30 03:43:26,237 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-63435703 info 2026-04-30 03:43:26,237 - INFO - Deleting VN ctest-right-37600569 2026-04-30 03:43:26,463 - DEBUG - Response for deleting network () 2026-04-30 03:43:26,463 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/31a89529-1ce4-4a92-bbdd-eab7bda0d86d 2026-04-30 03:43:26,471 - DEBUG - Response Code: 404 2026-04-30 03:43:26,471 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:43:26,481 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:43:26,493 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:43:26,600 - INFO - Validated that VN ctest-right-37600569 is not found in API Server 2026-04-30 03:43:26,611 - DEBUG - VN ctest-right-37600569 is not present in Agent 10.0.0.19 2026-04-30 03:43:26,623 - DEBUG - VN ctest-right-37600569 is not present in Agent 10.0.0.241 2026-04-30 03:43:26,623 - INFO - Validated that VN ctest-right-37600569 is not in any agent 2026-04-30 03:43:26,654 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-37600569 info 2026-04-30 03:43:26,655 - INFO - Deleting VN ctest-left-09762702 2026-04-30 03:43:26,814 - DEBUG - Response for deleting network () 2026-04-30 03:43:26,814 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/70a86df0-8491-4260-a096-ce51931a015e 2026-04-30 03:43:26,819 - DEBUG - Response Code: 404 2026-04-30 03:43:26,819 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-04-30 03:43:26,824 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb 2026-04-30 03:43:26,842 - DEBUG - Requesting: http://10.0.0.73:8082/project/52eadd7b-0d73-401d-99ae-d3aa6bd651dd 2026-04-30 03:43:26,928 - INFO - Validated that VN ctest-left-09762702 is not found in API Server 2026-04-30 03:43:26,938 - DEBUG - VN ctest-left-09762702 is not present in Agent 10.0.0.19 2026-04-30 03:43:26,950 - DEBUG - VN ctest-left-09762702 is not present in Agent 10.0.0.241 2026-04-30 03:43:26,950 - INFO - Validated that VN ctest-left-09762702 is not in any agent 2026-04-30 03:43:26,981 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-09762702 info 2026-04-30 03:43:28,283 - DEBUG - No XMPP flaps were noticed during the test 2026-04-30 03:43:28,283 - INFO - 2026-04-30 03:43:28,283 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:03:15] 2026-04-30 03:43:28,283 - INFO - -------------------------------------------------------------------------------- 2026-04-30 03:43:29,061 - INFO - Deleted project: ctest-TestSVCV2Mirror-77154089, ID : 52eadd7b-0d73-401d-99ae-d3aa6bd651dd