2025-07-31 04:26:44,270 - INFO - Domain Default found not creating 2025-07-31 04:26:44,513 - INFO - Project ctest-TestSVCV2Mirror-41139644 not found, creating it 2025-07-31 04:26:45,182 - INFO - Created Project:ctest-TestSVCV2Mirror-41139644, ID : 255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:47,162 - INFO - ================================================================================ 2025-07-31 04:26:47,162 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-07-31 04:26:47,162 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-07-31 04:26:48,533 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 04:26:48,533 - INFO - Initial checks done. Running the testcase now 2025-07-31 04:26:48,533 - INFO - 2025-07-31 04:26:49,599 - DEBUG - Response for create_network : {'network': {'id': '1b4706fe-6b2b-4558-88f6-e4c1dfe80271', 'name': 'ctest-left-30470874', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'project_id': '255806e513d042a0973b3779182ca9fa', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-41139644', 'ctest-left-30470874'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:26:49,966 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd5e9b0e5-ef34-41f5-9268-e8e8c84bab56', 'name': '', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'network_id': '1b4706fe-6b2b-4558-88f6-e4c1dfe80271', 'ip_version': 4, 'cidr': '45.188.39.192/26', 'allocation_pools': [{'start': '45.188.39.194', 'end': '45.188.39.254'}], 'gateway_ip': '45.188.39.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '45.188.39.194', 'tags': [], 'project_id': '255806e513d042a0973b3779182ca9fa'}} 2025-07-31 04:26:49,988 - INFO - Created VN ctest-left-30470874 2025-07-31 04:26:50,001 - DEBUG - VN ctest-left-30470874 UUID is 1b4706fe-6b2b-4558-88f6-e4c1dfe80271 2025-07-31 04:26:50,082 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:50,375 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:50,414 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:50,436 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:50,577 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1b4706fe-6b2b-4558-88f6-e4c1dfe80271 2025-07-31 04:26:50,593 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1b4706fe-6b2b-4558-88f6-e4c1dfe80271 2025-07-31 04:26:50,605 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/227cd466-d644-4acc-8d1e-5c95e3f1d580 2025-07-31 04:26:50,616 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/227cd466-d644-4acc-8d1e-5c95e3f1d580 2025-07-31 04:26:50,626 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/1cdd6a53-0f43-40b6-aadd-b7df269d6404 2025-07-31 04:26:50,638 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 04:26:50,638 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1b4706fe-6b2b-4558-88f6-e4c1dfe80271 2025-07-31 04:26:50,655 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/227cd466-d644-4acc-8d1e-5c95e3f1d580 2025-07-31 04:26:50,676 - INFO - Verified VN network id 11 for VN 1b4706fe-6b2b-4558-88f6-e4c1dfe80271 2025-07-31 04:26:50,676 - INFO - Verifications in API Server for VN ctest-left-30470874 passed 2025-07-31 04:26:50,677 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1b4706fe-6b2b-4558-88f6-e4c1dfe80271 2025-07-31 04:26:50,697 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/227cd466-d644-4acc-8d1e-5c95e3f1d580 2025-07-31 04:26:50,713 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/227cd466-d644-4acc-8d1e-5c95e3f1d580 2025-07-31 04:26:50,729 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/1cdd6a53-0f43-40b6-aadd-b7df269d6404 2025-07-31 04:26:50,756 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1965547452159968600', 'uuid-lslong': '9869327154765365873'}, 'enable': 'true', 'created': '2025-07-31T04:26:49', 'last-modified': '2025-07-31T04:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.873399'} 2025-07-31 04:26:50,770 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 04:26:50,780 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1965547452159968600', 'uuid-lslong': '9869327154765365873'}, 'enable': 'true', 'created': '2025-07-31T04:26:49', 'last-modified': '2025-07-31T04:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.899865'} 2025-07-31 04:26:50,790 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 04:26:50,798 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1965547452159968600', 'uuid-lslong': '9869327154765365873'}, 'enable': 'true', 'created': '2025-07-31T04:26:49', 'last-modified': '2025-07-31T04:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.915726'} 2025-07-31 04:26:50,808 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 04:26:50,808 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-30470874 passed 2025-07-31 04:26:50,809 - DEBUG - ====Verifying policy data for ctest-left-30470874 in API_Server ====== 2025-07-31 04:26:50,809 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:50,818 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:50,836 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:50,977 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1b4706fe-6b2b-4558-88f6-e4c1dfe80271 2025-07-31 04:26:50,995 - DEBUG - =>VN ctest-left-30470874 has no policy to be verified 2025-07-31 04:26:50,995 - DEBUG - Verifying the vn in opserver 2025-07-31 04:26:50,995 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874 virtual network link through opserver 10.0.0.41 2025-07-31 04:26:50,995 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 04:26:51,328 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 04:26:51,447 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874?flat'} 2025-07-31 04:26:51,447 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874 virtual network link through opserver 10.0.0.38 2025-07-31 04:26:51,448 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 04:26:51,862 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 04:26:51,943 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874?flat'} 2025-07-31 04:26:51,944 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874 virtual network link through opserver 10.0.0.61 2025-07-31 04:26:51,944 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 04:26:52,256 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 04:26:52,312 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874?flat'} 2025-07-31 04:26:52,313 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-41139644:ctest-left-30470874 is found in opserver 2025-07-31 04:26:52,351 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 04:26:52,367 - DEBUG - VRF ids for VN ctest-left-30470874: {} 2025-07-31 04:26:52,647 - DEBUG - Response for create_network : {'network': {'id': '21026fb2-463a-49df-b2fb-a3914f682098', 'name': 'ctest-right-01368630', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'project_id': '255806e513d042a0973b3779182ca9fa', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-41139644', 'ctest-right-01368630'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:26:52,847 - DEBUG - Response for create_subnet : {'subnet': {'id': '86cd7ff3-12c6-460c-a4a3-64adbbc03eb9', 'name': '', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'network_id': '21026fb2-463a-49df-b2fb-a3914f682098', 'ip_version': 4, 'cidr': '15.26.156.192/26', 'allocation_pools': [{'start': '15.26.156.194', 'end': '15.26.156.254'}], 'gateway_ip': '15.26.156.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '15.26.156.194', 'tags': [], 'project_id': '255806e513d042a0973b3779182ca9fa'}} 2025-07-31 04:26:52,871 - INFO - Created VN ctest-right-01368630 2025-07-31 04:26:52,886 - DEBUG - VN ctest-right-01368630 UUID is 21026fb2-463a-49df-b2fb-a3914f682098 2025-07-31 04:26:52,967 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:52,975 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:52,992 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:53,118 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/21026fb2-463a-49df-b2fb-a3914f682098 2025-07-31 04:26:53,141 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/21026fb2-463a-49df-b2fb-a3914f682098 2025-07-31 04:26:53,159 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3b3f4413-a8ce-4fda-884d-9cd1fef32e0b 2025-07-31 04:26:53,176 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3b3f4413-a8ce-4fda-884d-9cd1fef32e0b 2025-07-31 04:26:53,192 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5b81dcd9-8050-48a2-9f5d-6257f1f3bf55 2025-07-31 04:26:53,206 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 04:26:53,206 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/21026fb2-463a-49df-b2fb-a3914f682098 2025-07-31 04:26:53,229 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3b3f4413-a8ce-4fda-884d-9cd1fef32e0b 2025-07-31 04:26:53,258 - INFO - Verified VN network id 12 for VN 21026fb2-463a-49df-b2fb-a3914f682098 2025-07-31 04:26:53,258 - INFO - Verifications in API Server for VN ctest-right-01368630 passed 2025-07-31 04:26:53,258 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/21026fb2-463a-49df-b2fb-a3914f682098 2025-07-31 04:26:53,290 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3b3f4413-a8ce-4fda-884d-9cd1fef32e0b 2025-07-31 04:26:53,305 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3b3f4413-a8ce-4fda-884d-9cd1fef32e0b 2025-07-31 04:26:53,320 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5b81dcd9-8050-48a2-9f5d-6257f1f3bf55 2025-07-31 04:26:53,347 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2378586364678130143', 'uuid-lslong': '12897081802403356824'}, 'enable': 'true', 'created': '2025-07-31T04:26:52', 'last-modified': '2025-07-31T04:26:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.540120'} 2025-07-31 04:26:53,366 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 04:26:53,391 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2378586364678130143', 'uuid-lslong': '12897081802403356824'}, 'enable': 'true', 'created': '2025-07-31T04:26:52', 'last-modified': '2025-07-31T04:26:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.584755'} 2025-07-31 04:26:53,406 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 04:26:53,418 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2378586364678130143', 'uuid-lslong': '12897081802403356824'}, 'enable': 'true', 'created': '2025-07-31T04:26:52', 'last-modified': '2025-07-31T04:26:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.613203'} 2025-07-31 04:26:53,427 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 04:26:53,428 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-01368630 passed 2025-07-31 04:26:53,428 - DEBUG - ====Verifying policy data for ctest-right-01368630 in API_Server ====== 2025-07-31 04:26:53,428 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:53,440 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:53,469 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:53,599 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/21026fb2-463a-49df-b2fb-a3914f682098 2025-07-31 04:26:53,613 - DEBUG - =>VN ctest-right-01368630 has no policy to be verified 2025-07-31 04:26:53,613 - DEBUG - Verifying the vn in opserver 2025-07-31 04:26:53,613 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630 virtual network link through opserver 10.0.0.41 2025-07-31 04:26:53,614 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 04:26:53,690 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630?flat'} 2025-07-31 04:26:53,690 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630 virtual network link through opserver 10.0.0.38 2025-07-31 04:26:53,690 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 04:26:53,810 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630?flat'} 2025-07-31 04:26:53,810 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630 virtual network link through opserver 10.0.0.61 2025-07-31 04:26:53,810 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 04:26:53,973 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630?flat'} 2025-07-31 04:26:53,973 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-41139644:ctest-right-01368630 is found in opserver 2025-07-31 04:26:54,034 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 04:26:54,062 - DEBUG - VRF ids for VN ctest-right-01368630: {} 2025-07-31 04:26:54,391 - DEBUG - Response for create_network : {'network': {'id': 'bd03b14e-6c4b-4d63-852d-f731be9b2fbd', 'name': 'ctest-mgmt_vn-05186985', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'project_id': '255806e513d042a0973b3779182ca9fa', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-41139644', 'ctest-mgmt_vn-05186985'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:26:54,631 - DEBUG - Response for create_subnet : {'subnet': {'id': '38866fd4-4f64-45cd-b344-976fc7835a71', 'name': '', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'network_id': 'bd03b14e-6c4b-4d63-852d-f731be9b2fbd', 'ip_version': 4, 'cidr': '94.166.222.128/26', 'allocation_pools': [{'start': '94.166.222.130', 'end': '94.166.222.190'}], 'gateway_ip': '94.166.222.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '94.166.222.130', 'tags': [], 'project_id': '255806e513d042a0973b3779182ca9fa'}} 2025-07-31 04:26:54,658 - INFO - Created VN ctest-mgmt_vn-05186985 2025-07-31 04:26:54,672 - DEBUG - VN ctest-mgmt_vn-05186985 UUID is bd03b14e-6c4b-4d63-852d-f731be9b2fbd 2025-07-31 04:26:54,763 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:54,774 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:54,802 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:54,929 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bd03b14e-6c4b-4d63-852d-f731be9b2fbd 2025-07-31 04:26:54,948 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bd03b14e-6c4b-4d63-852d-f731be9b2fbd 2025-07-31 04:26:54,964 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/236930b7-2048-4b74-b903-5654b4840396 2025-07-31 04:26:54,978 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/236930b7-2048-4b74-b903-5654b4840396 2025-07-31 04:26:54,990 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3bb20b29-04e8-4ece-af5c-357651e57942 2025-07-31 04:26:55,002 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 04:26:55,002 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bd03b14e-6c4b-4d63-852d-f731be9b2fbd 2025-07-31 04:26:55,018 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/236930b7-2048-4b74-b903-5654b4840396 2025-07-31 04:26:55,043 - INFO - Verified VN network id 13 for VN bd03b14e-6c4b-4d63-852d-f731be9b2fbd 2025-07-31 04:26:55,043 - INFO - Verifications in API Server for VN ctest-mgmt_vn-05186985 passed 2025-07-31 04:26:55,044 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bd03b14e-6c4b-4d63-852d-f731be9b2fbd 2025-07-31 04:26:55,062 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/236930b7-2048-4b74-b903-5654b4840396 2025-07-31 04:26:55,074 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/236930b7-2048-4b74-b903-5654b4840396 2025-07-31 04:26:55,088 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3bb20b29-04e8-4ece-af5c-357651e57942 2025-07-31 04:26:55,113 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13619924648480951651', 'uuid-lslong': '9596598174019694525'}, 'enable': 'true', 'created': '2025-07-31T04:26:54', 'last-modified': '2025-07-31T04:26:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.556766'} 2025-07-31 04:26:55,122 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 04:26:55,130 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13619924648480951651', 'uuid-lslong': '9596598174019694525'}, 'enable': 'true', 'created': '2025-07-31T04:26:54', 'last-modified': '2025-07-31T04:26:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.572172'} 2025-07-31 04:26:55,139 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 04:26:55,149 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13619924648480951651', 'uuid-lslong': '9596598174019694525'}, 'enable': 'true', 'created': '2025-07-31T04:26:54', 'last-modified': '2025-07-31T04:26:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.584329'} 2025-07-31 04:26:55,158 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 04:26:55,158 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-05186985 passed 2025-07-31 04:26:55,158 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-05186985 in API_Server ====== 2025-07-31 04:26:55,158 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:55,166 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:55,181 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:55,309 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bd03b14e-6c4b-4d63-852d-f731be9b2fbd 2025-07-31 04:26:55,320 - DEBUG - =>VN ctest-mgmt_vn-05186985 has no policy to be verified 2025-07-31 04:26:55,320 - DEBUG - Verifying the vn in opserver 2025-07-31 04:26:55,320 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985 virtual network link through opserver 10.0.0.41 2025-07-31 04:26:55,320 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 04:26:55,397 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985?flat'} 2025-07-31 04:26:55,397 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985 virtual network link through opserver 10.0.0.38 2025-07-31 04:26:55,397 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 04:26:55,471 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985?flat'} 2025-07-31 04:26:55,472 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985 virtual network link through opserver 10.0.0.61 2025-07-31 04:26:55,472 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 04:26:55,584 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985?flat'} 2025-07-31 04:26:55,585 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-41139644:ctest-mgmt_vn-05186985 is found in opserver 2025-07-31 04:26:55,638 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 04:26:55,664 - DEBUG - VRF ids for VN ctest-mgmt_vn-05186985: {} 2025-07-31 04:26:55,972 - DEBUG - Response for create_network : {'network': {'id': '83cdb3cf-9b83-4f59-bd48-fe8162841ddc', 'name': 'ctest-trans_left_vn-01626215', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'project_id': '255806e513d042a0973b3779182ca9fa', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-41139644', 'ctest-trans_left_vn-01626215'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:26:56,189 - DEBUG - Response for create_subnet : {'subnet': {'id': '68bb70c3-6ba3-4cec-b982-6e74effd055f', 'name': '', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'network_id': '83cdb3cf-9b83-4f59-bd48-fe8162841ddc', 'ip_version': 4, 'cidr': '150.87.47.192/26', 'allocation_pools': [{'start': '150.87.47.194', 'end': '150.87.47.254'}], 'gateway_ip': '150.87.47.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '150.87.47.194', 'tags': [], 'project_id': '255806e513d042a0973b3779182ca9fa'}} 2025-07-31 04:26:56,212 - INFO - Created VN ctest-trans_left_vn-01626215 2025-07-31 04:26:56,227 - DEBUG - VN ctest-trans_left_vn-01626215 UUID is 83cdb3cf-9b83-4f59-bd48-fe8162841ddc 2025-07-31 04:26:56,326 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:56,333 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:56,346 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:56,463 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83cdb3cf-9b83-4f59-bd48-fe8162841ddc 2025-07-31 04:26:56,489 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83cdb3cf-9b83-4f59-bd48-fe8162841ddc 2025-07-31 04:26:56,500 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3f0191db-6e64-4b2c-a6ba-2c47f5049cb5 2025-07-31 04:26:56,515 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3f0191db-6e64-4b2c-a6ba-2c47f5049cb5 2025-07-31 04:26:56,524 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/07fe2e71-947b-4e4e-bc3d-41131244c2aa 2025-07-31 04:26:56,532 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 04:26:56,532 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83cdb3cf-9b83-4f59-bd48-fe8162841ddc 2025-07-31 04:26:56,544 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3f0191db-6e64-4b2c-a6ba-2c47f5049cb5 2025-07-31 04:26:56,564 - INFO - Verified VN network id 14 for VN 83cdb3cf-9b83-4f59-bd48-fe8162841ddc 2025-07-31 04:26:56,564 - INFO - Verifications in API Server for VN ctest-trans_left_vn-01626215 passed 2025-07-31 04:26:56,565 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83cdb3cf-9b83-4f59-bd48-fe8162841ddc 2025-07-31 04:26:56,579 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3f0191db-6e64-4b2c-a6ba-2c47f5049cb5 2025-07-31 04:26:56,592 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3f0191db-6e64-4b2c-a6ba-2c47f5049cb5 2025-07-31 04:26:56,602 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/07fe2e71-947b-4e4e-bc3d-41131244c2aa 2025-07-31 04:26:56,621 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9497444893442920281', 'uuid-lslong': '13639431303148608988'}, 'enable': 'true', 'created': '2025-07-31T04:26:55', 'last-modified': '2025-07-31T04:26:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.496703'} 2025-07-31 04:26:56,628 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 04:26:56,634 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9497444893442920281', 'uuid-lslong': '13639431303148608988'}, 'enable': 'true', 'created': '2025-07-31T04:26:55', 'last-modified': '2025-07-31T04:26:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.510530'} 2025-07-31 04:26:56,642 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 04:26:56,648 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9497444893442920281', 'uuid-lslong': '13639431303148608988'}, 'enable': 'true', 'created': '2025-07-31T04:26:55', 'last-modified': '2025-07-31T04:26:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.521486'} 2025-07-31 04:26:56,655 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 04:26:56,655 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-01626215 passed 2025-07-31 04:26:56,655 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-01626215 in API_Server ====== 2025-07-31 04:26:56,656 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:56,663 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:56,677 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:56,792 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83cdb3cf-9b83-4f59-bd48-fe8162841ddc 2025-07-31 04:26:56,805 - DEBUG - =>VN ctest-trans_left_vn-01626215 has no policy to be verified 2025-07-31 04:26:56,805 - DEBUG - Verifying the vn in opserver 2025-07-31 04:26:56,805 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215 virtual network link through opserver 10.0.0.41 2025-07-31 04:26:56,805 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 04:26:56,819 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215?flat'} 2025-07-31 04:26:56,819 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215 virtual network link through opserver 10.0.0.38 2025-07-31 04:26:56,819 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 04:26:56,835 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215?flat'} 2025-07-31 04:26:56,835 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215 virtual network link through opserver 10.0.0.61 2025-07-31 04:26:56,835 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 04:26:56,849 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215?flat'} 2025-07-31 04:26:56,849 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_left_vn-01626215 is found in opserver 2025-07-31 04:26:56,883 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 04:26:56,899 - DEBUG - VRF ids for VN ctest-trans_left_vn-01626215: {} 2025-07-31 04:26:57,280 - DEBUG - Response for create_network : {'network': {'id': '8acebada-49f1-4032-b297-cbf86d912e66', 'name': 'ctest-trans_right_vn-10622586', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'project_id': '255806e513d042a0973b3779182ca9fa', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-41139644', 'ctest-trans_right_vn-10622586'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:26:57,606 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f0b8ddd3-b4f3-4f51-a3b3-717eaad35b17', 'name': '', 'tenant_id': '255806e513d042a0973b3779182ca9fa', 'network_id': '8acebada-49f1-4032-b297-cbf86d912e66', 'ip_version': 4, 'cidr': '213.27.80.128/26', 'allocation_pools': [{'start': '213.27.80.130', 'end': '213.27.80.190'}], 'gateway_ip': '213.27.80.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '213.27.80.130', 'tags': [], 'project_id': '255806e513d042a0973b3779182ca9fa'}} 2025-07-31 04:26:57,636 - INFO - Created VN ctest-trans_right_vn-10622586 2025-07-31 04:26:57,653 - DEBUG - VN ctest-trans_right_vn-10622586 UUID is 8acebada-49f1-4032-b297-cbf86d912e66 2025-07-31 04:26:57,727 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:57,734 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:57,747 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:57,863 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8acebada-49f1-4032-b297-cbf86d912e66 2025-07-31 04:26:57,876 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8acebada-49f1-4032-b297-cbf86d912e66 2025-07-31 04:26:57,886 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/21d1c92f-9389-4f85-8f6b-cddf56b694a0 2025-07-31 04:26:57,895 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/21d1c92f-9389-4f85-8f6b-cddf56b694a0 2025-07-31 04:26:57,910 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3b972ce5-b712-46c2-924e-ab90719b20d9 2025-07-31 04:26:57,924 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 04:26:57,924 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8acebada-49f1-4032-b297-cbf86d912e66 2025-07-31 04:26:57,936 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/21d1c92f-9389-4f85-8f6b-cddf56b694a0 2025-07-31 04:26:57,957 - INFO - Verified VN network id 15 for VN 8acebada-49f1-4032-b297-cbf86d912e66 2025-07-31 04:26:57,957 - INFO - Verifications in API Server for VN ctest-trans_right_vn-10622586 passed 2025-07-31 04:26:57,957 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8acebada-49f1-4032-b297-cbf86d912e66 2025-07-31 04:26:57,972 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/21d1c92f-9389-4f85-8f6b-cddf56b694a0 2025-07-31 04:26:57,982 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/21d1c92f-9389-4f85-8f6b-cddf56b694a0 2025-07-31 04:26:57,991 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3b972ce5-b712-46c2-924e-ab90719b20d9 2025-07-31 04:26:58,013 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10002137269142634546', 'uuid-lslong': '12868978728085040742'}, 'enable': 'true', 'created': '2025-07-31T04:26:57', 'last-modified': '2025-07-31T04:26:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.489604'} 2025-07-31 04:26:58,024 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 04:26:58,031 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10002137269142634546', 'uuid-lslong': '12868978728085040742'}, 'enable': 'true', 'created': '2025-07-31T04:26:57', 'last-modified': '2025-07-31T04:26:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.507766'} 2025-07-31 04:26:58,041 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 04:26:58,049 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-41139644', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10002137269142634546', 'uuid-lslong': '12868978728085040742'}, 'enable': 'true', 'created': '2025-07-31T04:26:57', 'last-modified': '2025-07-31T04:26:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.525223'} 2025-07-31 04:26:58,057 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 04:26:58,057 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-10622586 passed 2025-07-31 04:26:58,058 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-10622586 in API_Server ====== 2025-07-31 04:26:58,058 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:26:58,068 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:26:58,093 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:26:58,187 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8acebada-49f1-4032-b297-cbf86d912e66 2025-07-31 04:26:58,208 - DEBUG - =>VN ctest-trans_right_vn-10622586 has no policy to be verified 2025-07-31 04:26:58,208 - DEBUG - Verifying the vn in opserver 2025-07-31 04:26:58,208 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586 virtual network link through opserver 10.0.0.41 2025-07-31 04:26:58,208 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 04:26:58,222 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586?flat'} 2025-07-31 04:26:58,222 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586 virtual network link through opserver 10.0.0.38 2025-07-31 04:26:58,223 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 04:26:58,240 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586?flat'} 2025-07-31 04:26:58,240 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586 virtual network link through opserver 10.0.0.61 2025-07-31 04:26:58,240 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 04:26:58,254 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586?flat'} 2025-07-31 04:26:58,254 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-41139644:ctest-trans_right_vn-10622586 is found in opserver 2025-07-31 04:26:58,287 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 04:26:58,302 - DEBUG - VRF ids for VN ctest-trans_right_vn-10622586: {} 2025-07-31 04:26:58,367 - DEBUG - Services list from nova: [, , , ] 2025-07-31 04:26:59,712 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-1) 2025-07-31 04:27:01,121 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-2) 2025-07-31 04:27:01,121 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-90340974'] 2025-07-31 04:27:01,441 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-90340974'] created succesfully 2025-07-31 04:28:42,454 - DEBUG - Installing image ubuntu 2025-07-31 04:28:42,454 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-31 04:28:42,456 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:28:42,456 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:28:42,456 - DEBUG - Unzip image 2025-07-31 04:28:42,456 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:28:42,497 - DEBUG - Try to create image in user context 2025-07-31 04:28:42,705 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-90340974'] 2025-07-31 04:28:42,817 - INFO - Service template: ['default-domain', 'ctest-service_template_1-90340974'] deleted successfully. 2025-07-31 04:28:42,817 - INFO - Skip interface_detach for VM ctest-right_vm-48196383 in state BUILD 2025-07-31 04:28:42,817 - INFO - Deleting VM ctest-right_vm-48196383 2025-07-31 04:28:42,882 - ERROR - VM ctest-right_vm-48196383 has failed to come up 2025-07-31 04:28:42,882 - ERROR - Nova failed to get host of the VM 2025-07-31 04:28:42,882 - ERROR - VM ctest-right_vm-48196383 has failed to come up 2025-07-31 04:28:42,882 - ERROR - Nova failed to get host of the VM 2025-07-31 04:28:43,029 - INFO - Skip interface_detach for VM ctest-left_vm-84398663 in state BUILD 2025-07-31 04:28:43,029 - INFO - Deleting VM ctest-left_vm-84398663 2025-07-31 04:28:43,029 - ERROR - VM ctest-left_vm-84398663 has failed to come up 2025-07-31 04:28:43,029 - ERROR - Nova failed to get host of the VM 2025-07-31 04:28:43,030 - ERROR - VM ctest-left_vm-84398663 has failed to come up 2025-07-31 04:28:43,030 - ERROR - Nova failed to get host of the VM 2025-07-31 04:28:43,217 - INFO - Deleting VN ctest-trans_right_vn-10622586 2025-07-31 04:28:43,487 - DEBUG - Response for deleting network () 2025-07-31 04:28:43,487 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/21d1c92f-9389-4f85-8f6b-cddf56b694a0 2025-07-31 04:28:43,497 - DEBUG - Response Code: 404 2025-07-31 04:28:43,497 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:28:43,507 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:28:43,537 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:28:43,643 - INFO - Validated that VN ctest-trans_right_vn-10622586 is not found in API Server 2025-07-31 04:28:43,657 - DEBUG - VN ctest-trans_right_vn-10622586 is not present in Agent 10.0.0.27 2025-07-31 04:28:43,672 - DEBUG - VN ctest-trans_right_vn-10622586 is not present in Agent 10.0.0.57 2025-07-31 04:28:43,672 - INFO - Validated that VN ctest-trans_right_vn-10622586 is not in any agent 2025-07-31 04:28:43,722 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-10622586 info 2025-07-31 04:28:43,723 - INFO - Deleting VN ctest-trans_left_vn-01626215 2025-07-31 04:28:43,973 - DEBUG - Response for deleting network () 2025-07-31 04:28:43,973 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3f0191db-6e64-4b2c-a6ba-2c47f5049cb5 2025-07-31 04:28:43,991 - DEBUG - Response Code: 404 2025-07-31 04:28:43,991 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:28:44,015 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:28:44,040 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:28:44,156 - INFO - Validated that VN ctest-trans_left_vn-01626215 is not found in API Server 2025-07-31 04:28:44,180 - DEBUG - VN ctest-trans_left_vn-01626215 is not present in Agent 10.0.0.27 2025-07-31 04:28:44,196 - DEBUG - VN ctest-trans_left_vn-01626215 is not present in Agent 10.0.0.57 2025-07-31 04:28:44,196 - INFO - Validated that VN ctest-trans_left_vn-01626215 is not in any agent 2025-07-31 04:28:44,240 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-01626215 info 2025-07-31 04:28:44,241 - INFO - Deleting VN ctest-mgmt_vn-05186985 2025-07-31 04:28:44,457 - DEBUG - Response for deleting network () 2025-07-31 04:28:44,457 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/236930b7-2048-4b74-b903-5654b4840396 2025-07-31 04:28:44,463 - DEBUG - Response Code: 404 2025-07-31 04:28:44,463 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:28:44,488 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:28:44,505 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:28:44,602 - INFO - Validated that VN ctest-mgmt_vn-05186985 is not found in API Server 2025-07-31 04:28:44,615 - DEBUG - VN ctest-mgmt_vn-05186985 is not present in Agent 10.0.0.27 2025-07-31 04:28:44,628 - DEBUG - VN ctest-mgmt_vn-05186985 is not present in Agent 10.0.0.57 2025-07-31 04:28:44,628 - INFO - Validated that VN ctest-mgmt_vn-05186985 is not in any agent 2025-07-31 04:28:44,666 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-05186985 info 2025-07-31 04:28:44,666 - INFO - Deleting VN ctest-right-01368630 2025-07-31 04:28:44,861 - DEBUG - Response for deleting network () 2025-07-31 04:28:44,861 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3b3f4413-a8ce-4fda-884d-9cd1fef32e0b 2025-07-31 04:28:44,877 - DEBUG - Response Code: 404 2025-07-31 04:28:44,877 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:28:44,893 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:28:44,915 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:28:45,025 - INFO - Validated that VN ctest-right-01368630 is not found in API Server 2025-07-31 04:28:45,040 - DEBUG - VN ctest-right-01368630 is not present in Agent 10.0.0.27 2025-07-31 04:28:45,056 - DEBUG - VN ctest-right-01368630 is not present in Agent 10.0.0.57 2025-07-31 04:28:45,056 - INFO - Validated that VN ctest-right-01368630 is not in any agent 2025-07-31 04:28:45,116 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-01368630 info 2025-07-31 04:28:45,116 - INFO - Deleting VN ctest-left-30470874 2025-07-31 04:28:45,353 - DEBUG - Response for deleting network () 2025-07-31 04:28:45,353 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/227cd466-d644-4acc-8d1e-5c95e3f1d580 2025-07-31 04:28:45,360 - DEBUG - Response Code: 404 2025-07-31 04:28:45,360 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 04:28:45,372 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 04:28:45,392 - DEBUG - Requesting: http://10.0.0.41:8082/project/255806e5-13d0-42a0-973b-3779182ca9fa 2025-07-31 04:28:45,509 - INFO - Validated that VN ctest-left-30470874 is not found in API Server 2025-07-31 04:28:45,525 - DEBUG - VN ctest-left-30470874 is not present in Agent 10.0.0.27 2025-07-31 04:28:45,543 - DEBUG - VN ctest-left-30470874 is not present in Agent 10.0.0.57 2025-07-31 04:28:45,543 - INFO - Validated that VN ctest-left-30470874 is not in any agent 2025-07-31 04:28:45,610 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-30470874 info 2025-07-31 04:28:46,973 - ERROR -
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_mirror/test_mirror.py", line 24, in test_svc_v2_mirroring
    return self.verify_svc_mirroring()
  File "/contrail-test/common/servicechain/mirror/verify.py", line 14, in verify_svc_mirroring
    ret_dict = self.config_svc_mirroring(*args, **kwargs)
  File "/contrail-test/common/servicechain/mirror/config.py", line 42, in config_svc_mirroring
    create_svms=create_svms, **kwargs)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-31 04:28:47,006 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 04:28:47,006 - INFO -
2025-07-31 04:28:47,006 - INFO - END TEST : test_svc_v2_mirroring : FAILED[0:02:00]
2025-07-31 04:28:47,007 - INFO - -------------------------------------------------------------------------------- 2025-07-31 04:28:47,765 - INFO - Deleted project: ctest-TestSVCV2Mirror-41139644, ID : 255806e5-13d0-42a0-973b-3779182ca9fa