2025-08-06 08:13:55,075 - INFO - Domain Default found not creating 2025-08-06 08:13:55,256 - INFO - Project ctest-TestBasicPolicy-33340345 not found, creating it 2025-08-06 08:13:55,902 - INFO - Created Project:ctest-TestBasicPolicy-33340345, ID : cf2ac30e-209e-482c-9f71-476c1d4143f0 2025-08-06 08:13:57,494 - INFO - ================================================================================ 2025-08-06 08:13:57,495 - INFO - STARTING TEST : test_basic_policy_allow_deny 2025-08-06 08:13:57,495 - INFO - TEST DESCRIPTION : Create 2 Vns and allow icmp traffic between them and validate with pings Update the policy to deny the same traffic Check that pings fail 2025-08-06 08:13:58,793 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-08-06 08:13:58,793 - INFO - Initial checks done. Running the testcase now 2025-08-06 08:13:58,793 - INFO - 2025-08-06 08:14:00,073 - DEBUG - Response for create_network : {'network': {'id': '6d579937-e5d0-4f54-ae11-bdb76d545cfb', 'name': 'ctest-vn-02911634', 'tenant_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'project_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-vn-02911634'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 08:14:00,400 - DEBUG - Response for create_subnet : {'subnet': {'id': '92c9d1b5-d26d-41ca-a734-d28337ed3ada', 'name': '', 'tenant_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'network_id': '6d579937-e5d0-4f54-ae11-bdb76d545cfb', 'ip_version': 4, 'cidr': '220.124.87.128/26', 'allocation_pools': [{'start': '220.124.87.130', 'end': '220.124.87.190'}], 'gateway_ip': '220.124.87.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.124.87.130', 'tags': [], 'project_id': 'cf2ac30e209e482c9f71476c1d4143f0'}} 2025-08-06 08:14:00,424 - INFO - Created VN ctest-vn-02911634 2025-08-06 08:14:00,442 - DEBUG - VN ctest-vn-02911634 UUID is 6d579937-e5d0-4f54-ae11-bdb76d545cfb 2025-08-06 08:14:00,843 - DEBUG - Response for create_network : {'network': {'id': '7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f', 'name': 'ctest-vn-08139660', 'tenant_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'project_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-vn-08139660'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 08:14:01,101 - DEBUG - Response for create_subnet : {'subnet': {'id': '21a9036a-d2a4-423a-950c-31111cd564f0', 'name': '', 'tenant_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'network_id': '7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f', 'ip_version': 4, 'cidr': '187.12.158.64/26', 'allocation_pools': [{'start': '187.12.158.66', 'end': '187.12.158.126'}], 'gateway_ip': '187.12.158.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '187.12.158.66', 'tags': [], 'project_id': 'cf2ac30e209e482c9f71476c1d4143f0'}} 2025-08-06 08:14:01,128 - INFO - Created VN ctest-vn-08139660 2025-08-06 08:14:01,143 - DEBUG - VN ctest-vn-08139660 UUID is 7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f 2025-08-06 08:14:01,245 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-06 08:14:01,633 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '6d579937-e5d0-4f54-ae11-bdb76d545cfb', 'name': 'ctest-vn-02911634', 'tenant_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'project_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['92c9d1b5-d26d-41ca-a734-d28337ed3ada'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-vn-02911634'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-policy-allow-all-11148867']], 'subnet_ipam': [{'subnet_cidr': '220.124.87.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-06 08:14:01,873 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f', 'name': 'ctest-vn-08139660', 'tenant_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'project_id': 'cf2ac30e209e482c9f71476c1d4143f0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['21a9036a-d2a4-423a-950c-31111cd564f0'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-vn-08139660'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-policy-allow-all-11148867']], 'subnet_ipam': [{'subnet_cidr': '187.12.158.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-06 08:14:01,975 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 08:14:02,348 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 08:14:02,383 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 08:14:02,399 - DEBUG - Requesting: http://10.0.0.48:8082/project/cf2ac30e-209e-482c-9f71-476c1d4143f0 2025-08-06 08:14:02,501 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/6d579937-e5d0-4f54-ae11-bdb76d545cfb 2025-08-06 08:14:02,530 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/6d579937-e5d0-4f54-ae11-bdb76d545cfb 2025-08-06 08:14:02,545 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/ab606a9d-207f-4ebc-9355-aeb74a99aaf6 2025-08-06 08:14:02,559 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/ab606a9d-207f-4ebc-9355-aeb74a99aaf6 2025-08-06 08:14:02,576 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b6f3b0c1-abb6-41d0-9795-4908d54a44c6 2025-08-06 08:14:02,591 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 08:14:02,591 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/6d579937-e5d0-4f54-ae11-bdb76d545cfb 2025-08-06 08:14:02,604 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/ab606a9d-207f-4ebc-9355-aeb74a99aaf6 2025-08-06 08:14:02,627 - INFO - Verified VN network id 15 for VN 6d579937-e5d0-4f54-ae11-bdb76d545cfb 2025-08-06 08:14:02,627 - INFO - Verifications in API Server for VN ctest-vn-02911634 passed 2025-08-06 08:14:02,627 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/6d579937-e5d0-4f54-ae11-bdb76d545cfb 2025-08-06 08:14:02,641 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/ab606a9d-207f-4ebc-9355-aeb74a99aaf6 2025-08-06 08:14:02,650 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/ab606a9d-207f-4ebc-9355-aeb74a99aaf6 2025-08-06 08:14:02,671 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b6f3b0c1-abb6-41d0-9795-4908d54a44c6 2025-08-06 08:14:02,707 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-33340345', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7878934538465857364', 'uuid-lslong': '12543015032714452219'}, 'enable': 'true', 'created': '2025-08-06T08:13:59', 'last-modified': '2025-08-06T08:14:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.133584'} 2025-08-06 08:14:02,715 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 08:14:02,721 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-33340345', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7878934538465857364', 'uuid-lslong': '12543015032714452219'}, 'enable': 'true', 'created': '2025-08-06T08:13:59', 'last-modified': '2025-08-06T08:14:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.153541'} 2025-08-06 08:14:02,729 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 08:14:02,735 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-33340345', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7878934538465857364', 'uuid-lslong': '12543015032714452219'}, 'enable': 'true', 'created': '2025-08-06T08:13:59', 'last-modified': '2025-08-06T08:14:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.162241'} 2025-08-06 08:14:02,743 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 08:14:02,743 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-02911634 passed 2025-08-06 08:14:02,743 - DEBUG - ====Verifying policy data for ctest-vn-02911634 in API_Server ====== 2025-08-06 08:14:02,744 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 08:14:02,751 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 08:14:02,765 - DEBUG - Requesting: http://10.0.0.48:8082/project/cf2ac30e-209e-482c-9f71-476c1d4143f0 2025-08-06 08:14:02,864 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/6d579937-e5d0-4f54-ae11-bdb76d545cfb 2025-08-06 08:14:02,880 - DEBUG - ==>Verifying data for policy with id: 26a23ba9-e4ab-44e9-aaec-799f16c7e409, fqn: ['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-policy-allow-all-11148867'] 2025-08-06 08:14:02,880 - INFO - VN ctest-vn-02911634 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-06 08:14:02,880 - DEBUG - Verifying the vn in opserver 2025-08-06 08:14:02,880 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 virtual network link through opserver 10.0.0.48 2025-08-06 08:14:02,880 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 08:14:03,197 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 08:14:03,269 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634?flat'} 2025-08-06 08:14:03,269 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 virtual network link through opserver 10.0.0.254 2025-08-06 08:14:03,270 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 08:14:03,570 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 08:14:03,647 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634?flat'} 2025-08-06 08:14:03,648 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 virtual network link through opserver 10.0.0.38 2025-08-06 08:14:03,648 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 08:14:04,020 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 08:14:04,089 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634?flat'} 2025-08-06 08:14:04,089 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is found in opserver 2025-08-06 08:14:04,122 - DEBUG - Do not have enough data to verify VN in agent 2025-08-06 08:14:04,140 - DEBUG - VRF ids for VN ctest-vn-02911634: {} 2025-08-06 08:14:04,140 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 08:14:04,149 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 08:14:04,168 - DEBUG - Requesting: http://10.0.0.48:8082/project/cf2ac30e-209e-482c-9f71-476c1d4143f0 2025-08-06 08:14:04,292 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f 2025-08-06 08:14:04,313 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f 2025-08-06 08:14:04,328 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/96a666fd-9d70-40ad-ade5-70e8116c71b1 2025-08-06 08:14:04,340 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/96a666fd-9d70-40ad-ade5-70e8116c71b1 2025-08-06 08:14:04,351 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/8ec069b3-7076-46a4-aed8-3cc9b10f88f0 2025-08-06 08:14:04,361 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-06 08:14:04,361 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f 2025-08-06 08:14:04,373 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/96a666fd-9d70-40ad-ade5-70e8116c71b1 2025-08-06 08:14:04,394 - INFO - Verified VN network id 16 for VN 7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f 2025-08-06 08:14:04,394 - INFO - Verifications in API Server for VN ctest-vn-08139660 passed 2025-08-06 08:14:04,394 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f 2025-08-06 08:14:04,408 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/96a666fd-9d70-40ad-ade5-70e8116c71b1 2025-08-06 08:14:04,419 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/96a666fd-9d70-40ad-ade5-70e8116c71b1 2025-08-06 08:14:04,429 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/8ec069b3-7076-46a4-aed8-3cc9b10f88f0 2025-08-06 08:14:04,446 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-33340345', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8916971994134300819', 'uuid-lslong': '11110358562697690447'}, 'enable': 'true', 'created': '2025-08-06T08:14:00', 'last-modified': '2025-08-06T08:14:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.606821'} 2025-08-06 08:14:04,453 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-06 08:14:04,461 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-33340345', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8916971994134300819', 'uuid-lslong': '11110358562697690447'}, 'enable': 'true', 'created': '2025-08-06T08:14:00', 'last-modified': '2025-08-06T08:14:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.630338'} 2025-08-06 08:14:04,469 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-06 08:14:04,475 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-33340345', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8916971994134300819', 'uuid-lslong': '11110358562697690447'}, 'enable': 'true', 'created': '2025-08-06T08:14:00', 'last-modified': '2025-08-06T08:14:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.637350'} 2025-08-06 08:14:04,483 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-06 08:14:04,484 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-08139660 passed 2025-08-06 08:14:04,484 - DEBUG - ====Verifying policy data for ctest-vn-08139660 in API_Server ====== 2025-08-06 08:14:04,484 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 08:14:04,492 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 08:14:04,506 - DEBUG - Requesting: http://10.0.0.48:8082/project/cf2ac30e-209e-482c-9f71-476c1d4143f0 2025-08-06 08:14:04,614 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f 2025-08-06 08:14:04,627 - DEBUG - ==>Verifying data for policy with id: 26a23ba9-e4ab-44e9-aaec-799f16c7e409, fqn: ['default-domain', 'ctest-TestBasicPolicy-33340345', 'ctest-policy-allow-all-11148867'] 2025-08-06 08:14:04,627 - INFO - VN ctest-vn-08139660 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-06 08:14:04,627 - DEBUG - Verifying the vn in opserver 2025-08-06 08:14:04,627 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660 virtual network link through opserver 10.0.0.48 2025-08-06 08:14:04,627 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 08:14:04,698 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660?flat'} 2025-08-06 08:14:04,698 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660 virtual network link through opserver 10.0.0.254 2025-08-06 08:14:04,698 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 08:14:04,774 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660?flat'} 2025-08-06 08:14:04,774 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660 virtual network link through opserver 10.0.0.38 2025-08-06 08:14:04,774 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 08:14:04,848 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660?flat'} 2025-08-06 08:14:04,848 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-08139660 is found in opserver 2025-08-06 08:14:04,875 - DEBUG - Do not have enough data to verify VN in agent 2025-08-06 08:14:04,889 - DEBUG - VRF ids for VN ctest-vn-08139660: {} 2025-08-06 08:14:05,109 - DEBUG - Services list from nova: [, , , ] 2025-08-06 08:14:06,313 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-1) 2025-08-06 08:14:07,994 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-2) 2025-08-06 08:14:07,995 - INFO - Waiting for VM ctest-TestBasicPolicy-33340345-01374277 to be up.. 2025-08-06 08:14:08,119 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 08:14:13,218 - DEBUG - VM is in ACTIVE state now 2025-08-06 08:14:13,218 - INFO - VM name : ctest-TestBasicPolicy-33340345-01374277 2025-08-06 08:14:13,326 - DEBUG - VM ctest-TestBasicPolicy-33340345-01374277 ID is cf07778d-c372-4a1b-a69f-c61d689826b3 2025-08-06 08:14:13,351 - DEBUG - VM ctest-TestBasicPolicy-33340345-01374277 launched on Node an-jenkins-deploy-platform-ansible-os-3761-1 2025-08-06 08:14:13,448 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/cf07778d-c372-4a1b-a69f-c61d689826b3 2025-08-06 08:14:13,787 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/cf07778d-c372-4a1b-a69f-c61d689826b3 2025-08-06 08:14:13,826 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/baacbb82-90a1-45fe-bcd5-90751b93f662 2025-08-06 08:14:17,051 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-06 08:14:17,051 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 failed! 2025-08-06 08:14:17,069 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is 220.124.87.129 and allocation pool is NOT set 2025-08-06 08:14:21,151 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-06 08:14:21,151 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 failed! 2025-08-06 08:14:21,171 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is 220.124.87.129 and allocation pool is NOT set 2025-08-06 08:14:25,246 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-06 08:14:25,247 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 failed! 2025-08-06 08:14:25,265 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is 220.124.87.129 and allocation pool is NOT set 2025-08-06 08:14:29,334 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-08-06 08:14:29,334 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 failed! 2025-08-06 08:14:29,353 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is 220.124.87.129 and allocation pool is NOT set 2025-08-06 08:14:33,438 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-06 08:14:33,439 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 failed! 2025-08-06 08:14:33,460 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is 220.124.87.129 and allocation pool is NOT set 2025-08-06 08:14:37,535 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-06 08:14:37,535 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 failed! 2025-08-06 08:14:37,560 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is 220.124.87.129 and allocation pool is NOT set 2025-08-06 08:14:41,622 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-08-06 08:14:41,622 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 failed! 2025-08-06 08:14:41,639 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-33340345:ctest-vn-02911634 is 220.124.87.129 and allocation pool is NOT set 2025-08-06 08:14:45,726 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=6.74 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1022ms\r\nrtt min/avg/max/mdev = 6.735/6.735/6.735/0.000 ms') 2025-08-06 08:14:45,726 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-01374277 passed 2025-08-06 08:14:45,849 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:14:45,849 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-33340345-01374277, IP 220.124.87.131, Port 22 2025-08-06 08:14:45,904 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 08:14:46,002 - DEBUG - VM ctest-TestBasicPolicy-33340345-01374277 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 08:14:51,003 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:14:51,003 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-33340345-01374277, IP 220.124.87.131, Port 22 2025-08-06 08:14:51,071 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 08:14:51,191 - DEBUG - VM ctest-TestBasicPolicy-33340345-01374277 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 08:14:56,192 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:14:56,192 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-33340345-01374277, IP 220.124.87.131, Port 22 2025-08-06 08:14:56,248 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 08:14:56,343 - DEBUG - VM ctest-TestBasicPolicy-33340345-01374277 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 08:15:01,344 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:15:01,344 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-33340345-01374277, IP 220.124.87.131, Port 22 2025-08-06 08:15:01,401 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 08:15:01,495 - DEBUG - VM ctest-TestBasicPolicy-33340345-01374277 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 08:15:06,496 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:15:06,496 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-33340345-01374277, IP 220.124.87.131, Port 22 2025-08-06 08:15:06,667 - DEBUG - VM ctest-TestBasicPolicy-33340345-01374277 is ready for SSH connections 2025-08-06 08:15:06,667 - INFO - Waiting for VM ctest-TestBasicPolicy-33340345-09781247 to be up.. 2025-08-06 08:15:06,844 - DEBUG - VM is in ACTIVE state now 2025-08-06 08:15:06,845 - INFO - VM name : ctest-TestBasicPolicy-33340345-09781247 2025-08-06 08:15:07,005 - DEBUG - VM ctest-TestBasicPolicy-33340345-09781247 ID is fd523b05-72fa-497b-944d-31df3393c5ad 2025-08-06 08:15:07,005 - DEBUG - VM ctest-TestBasicPolicy-33340345-09781247 launched on Node an-jenkins-deploy-platform-ansible-os-3761-2 2025-08-06 08:15:07,139 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/fd523b05-72fa-497b-944d-31df3393c5ad 2025-08-06 08:15:07,153 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/c38fc1f6-b8d1-40f4-a11f-fde76f78c356 2025-08-06 08:15:08,390 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.75 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.66 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.656/4.700/5.745/1.044 ms') 2025-08-06 08:15:08,390 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-33340345-09781247 passed 2025-08-06 08:15:08,514 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:15:08,514 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-33340345-09781247, IP 187.12.158.67, Port 22 2025-08-06 08:15:08,580 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 08:15:08,684 - DEBUG - VM ctest-TestBasicPolicy-33340345-09781247 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 08:15:13,685 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:15:13,685 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-33340345-09781247, IP 187.12.158.67, Port 22 2025-08-06 08:15:13,854 - DEBUG - VM ctest-TestBasicPolicy-33340345-09781247 is ready for SSH connections 2025-08-06 08:15:13,854 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:15:13,854 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 187.12.158.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 08:15:13,854 - DEBUG - ping -s 56 -c 3 -W 1 187.12.158.67 2025-08-06 08:15:56,329 - DEBUG - PING 187.12.158.67 (187.12.158.67) 56(84) bytes of data. 64 bytes from 187.12.158.67: icmp_req=1 ttl=63 time=10.4 ms 64 bytes from 187.12.158.67: icmp_req=2 ttl=63 time=1.49 ms 64 bytes from 187.12.158.67: icmp_req=3 ttl=63 time=1.39 ms --- 187.12.158.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.399/4.459/10.484/4.260 ms 2025-08-06 08:15:56,329 - INFO - Ping to IP 187.12.158.67 from VM ctest-TestBasicPolicy-33340345-01374277 passed 2025-08-06 08:15:56,546 - DEBUG - Policy Update Response {"network-policy": {"uuid": "26a23ba9-e4ab-44e9-aaec-799f16c7e409", "href": "http://10.0.0.38:8082/network-policy/26a23ba9-e4ab-44e9-aaec-799f16c7e409"}} 2025-08-06 08:15:56,547 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 08:15:56,547 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 187.12.158.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 08:15:56,547 - DEBUG - ping -s 56 -c 3 -W 1 187.12.158.67 2025-08-06 08:15:59,986 - DEBUG - PING 187.12.158.67 (187.12.158.67) 56(84) bytes of data. 64 bytes from 187.12.158.67: icmp_req=1 ttl=63 time=2.40 ms --- 187.12.158.67 ping statistics --- 3 packets transmitted, 1 received, 66% packet loss, time 2010ms rtt min/avg/max/mdev = 2.401/2.401/2.401/0.000 ms 2025-08-06 08:15:59,986 - WARNING - Ping to IP 187.12.158.67 from VM ctest-TestBasicPolicy-33340345-01374277 failed 2025-08-06 08:15:59,986 - INFO - Deleting VM ctest-TestBasicPolicy-33340345-09781247 2025-08-06 08:16:00,083 - INFO - Deleting VM ctest-TestBasicPolicy-33340345-01374277 2025-08-06 08:16:00,610 - INFO - Deleted policy ctest-policy-allow-all-11148867 2025-08-06 08:16:00,610 - INFO - Deleting VN ctest-vn-08139660 2025-08-06 08:16:00,667 - DEBUG - VN 7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f still in use: Unable to complete operation on network 7bbf72c8-d67b-4893-9a2f-ec3f60d0bd4f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1b6ba2cf-4104-4e72-a04f-763db4f773e5'] 2025-08-06 08:16:00,667 - WARNING - Deleting VN ctest-vn-08139660 failed..Will retry 2025-08-06 08:16:02,885 - DEBUG - Response for deleting network () 2025-08-06 08:16:02,885 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/96a666fd-9d70-40ad-ade5-70e8116c71b1 2025-08-06 08:16:02,892 - DEBUG - Response Code: 404 2025-08-06 08:16:02,892 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 08:16:02,909 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 08:16:02,928 - DEBUG - Requesting: http://10.0.0.48:8082/project/cf2ac30e-209e-482c-9f71-476c1d4143f0 2025-08-06 08:16:03,023 - INFO - Validated that VN ctest-vn-08139660 is not found in API Server 2025-08-06 08:16:03,037 - DEBUG - VN ctest-vn-08139660 is not present in Agent 10.0.0.49 2025-08-06 08:16:03,053 - DEBUG - VN ctest-vn-08139660 is not present in Agent 10.0.0.57 2025-08-06 08:16:03,054 - INFO - Validated that VN ctest-vn-08139660 is not in any agent 2025-08-06 08:16:03,094 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-08139660 info 2025-08-06 08:16:03,094 - INFO - Deleting VN ctest-vn-02911634 2025-08-06 08:16:03,286 - DEBUG - Response for deleting network () 2025-08-06 08:16:03,286 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/ab606a9d-207f-4ebc-9355-aeb74a99aaf6 2025-08-06 08:16:03,297 - DEBUG - Response Code: 404 2025-08-06 08:16:03,297 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 08:16:03,332 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 08:16:03,360 - DEBUG - Requesting: http://10.0.0.48:8082/project/cf2ac30e-209e-482c-9f71-476c1d4143f0 2025-08-06 08:16:03,495 - INFO - Validated that VN ctest-vn-02911634 is not found in API Server 2025-08-06 08:16:03,510 - DEBUG - VN ctest-vn-02911634 is not present in Agent 10.0.0.49 2025-08-06 08:16:03,527 - DEBUG - VN ctest-vn-02911634 is not present in Agent 10.0.0.57 2025-08-06 08:16:03,527 - INFO - Validated that VN ctest-vn-02911634 is not in any agent 2025-08-06 08:16:03,574 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-02911634 info 2025-08-06 08:16:04,870 - DEBUG - No XMPP flaps were noticed during the test 2025-08-06 08:16:04,870 - INFO - END TEST : test_basic_policy_allow_deny : PASSED[0:02:07] 2025-08-06 08:16:04,870 - INFO - -------------------------------------------------------------------------------- 2025-08-06 08:16:05,705 - INFO - Deleted project: ctest-TestBasicPolicy-33340345, ID : cf2ac30e-209e-482c-9f71-476c1d4143f0