2025-06-24 19:32:03,154 - INFO - Domain Default found not creating 2025-06-24 19:32:03,300 - INFO - Project ctest-TestBasicPolicy-77340874 not found, creating it 2025-06-24 19:32:03,769 - INFO - Created Project:ctest-TestBasicPolicy-77340874, ID : 8c0490ce-27b4-4ca9-986b-98b3a5053eef 2025-06-24 19:32:05,328 - INFO - ================================================================================ 2025-06-24 19:32:05,328 - INFO - STARTING TEST : test_basic_policy_allow_deny 2025-06-24 19:32:05,328 - INFO - TEST DESCRIPTION : Create 2 Vns and allow icmp traffic between them and validate with pings Update the policy to deny the same traffic Check that pings fail 2025-06-24 19:32:05,588 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.17': '0'}} with 2025-06-24 19:32:05,588 - INFO - Initial checks done. Running the testcase now 2025-06-24 19:32:05,588 - INFO - 2025-06-24 19:32:06,177 - DEBUG - Response for create_network : {'network': {'id': '4ca646d4-0e11-4629-8a5a-2916122bf13c', 'name': 'ctest-vn-22875966', 'tenant_id': '8c0490ce27b44ca9986b98b3a5053eef', 'project_id': '8c0490ce27b44ca9986b98b3a5053eef', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-vn-22875966'], 'port_security_enabled': True, 'description': ''}} 2025-06-24 19:32:06,398 - DEBUG - Response for create_subnet : {'subnet': {'id': '995669ff-59aa-4b5a-b2d8-a5a25decc94a', 'name': '', 'tenant_id': '8c0490ce27b44ca9986b98b3a5053eef', 'network_id': '4ca646d4-0e11-4629-8a5a-2916122bf13c', 'ip_version': 4, 'cidr': '5.67.18.192/26', 'allocation_pools': [{'start': '5.67.18.194', 'end': '5.67.18.254'}], 'gateway_ip': '5.67.18.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.67.18.194', 'tags': [], 'project_id': '8c0490ce27b44ca9986b98b3a5053eef'}} 2025-06-24 19:32:06,417 - INFO - Created VN ctest-vn-22875966 2025-06-24 19:32:06,470 - DEBUG - VN ctest-vn-22875966 UUID is 4ca646d4-0e11-4629-8a5a-2916122bf13c 2025-06-24 19:32:06,775 - DEBUG - Response for create_network : {'network': {'id': 'c91b9010-babd-4510-86ca-118e9de3494e', 'name': 'ctest-vn-75833080', 'tenant_id': '8c0490ce27b44ca9986b98b3a5053eef', 'project_id': '8c0490ce27b44ca9986b98b3a5053eef', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-vn-75833080'], 'port_security_enabled': True, 'description': ''}} 2025-06-24 19:32:07,012 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c66788a0-d975-4ba4-8bb5-cfb11e1357f7', 'name': '', 'tenant_id': '8c0490ce27b44ca9986b98b3a5053eef', 'network_id': 'c91b9010-babd-4510-86ca-118e9de3494e', 'ip_version': 4, 'cidr': '95.85.203.128/26', 'allocation_pools': [{'start': '95.85.203.130', 'end': '95.85.203.190'}], 'gateway_ip': '95.85.203.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '95.85.203.130', 'tags': [], 'project_id': '8c0490ce27b44ca9986b98b3a5053eef'}} 2025-06-24 19:32:07,031 - INFO - Created VN ctest-vn-75833080 2025-06-24 19:32:07,081 - DEBUG - VN ctest-vn-75833080 UUID is c91b9010-babd-4510-86ca-118e9de3494e 2025-06-24 19:32:07,237 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-22875966, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-75833080, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-06-24 19:32:07,549 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '4ca646d4-0e11-4629-8a5a-2916122bf13c', 'name': 'ctest-vn-22875966', 'tenant_id': '8c0490ce27b44ca9986b98b3a5053eef', 'project_id': '8c0490ce27b44ca9986b98b3a5053eef', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['995669ff-59aa-4b5a-b2d8-a5a25decc94a'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-vn-22875966'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-policy-allow-all-38236324']], 'subnet_ipam': [{'subnet_cidr': '5.67.18.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-06-24 19:32:07,833 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'c91b9010-babd-4510-86ca-118e9de3494e', 'name': 'ctest-vn-75833080', 'tenant_id': '8c0490ce27b44ca9986b98b3a5053eef', 'project_id': '8c0490ce27b44ca9986b98b3a5053eef', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['c66788a0-d975-4ba4-8bb5-cfb11e1357f7'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-vn-75833080'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-policy-allow-all-38236324']], 'subnet_ipam': [{'subnet_cidr': '95.85.203.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-06-24 19:32:07,990 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-06-24 19:32:08,326 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-06-24 19:32:08,354 - DEBUG - Requesting: http://10.0.0.33:8082/domain/dc75db7d-aaef-4a5a-b932-dc19bbe78927 2025-06-24 19:32:08,370 - DEBUG - Requesting: http://10.0.0.33:8082/project/8c0490ce-27b4-4ca9-986b-98b3a5053eef 2025-06-24 19:32:08,445 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/4ca646d4-0e11-4629-8a5a-2916122bf13c 2025-06-24 19:32:08,457 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/4ca646d4-0e11-4629-8a5a-2916122bf13c 2025-06-24 19:32:08,467 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/6a9d54e4-d6a7-4779-8a32-32957f025a92 2025-06-24 19:32:08,474 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/6a9d54e4-d6a7-4779-8a32-32957f025a92 2025-06-24 19:32:08,481 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/ba98f40b-5b1a-4a29-bd84-1b9ebcb30cf6 2025-06-24 19:32:08,487 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-24 19:32:08,487 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/4ca646d4-0e11-4629-8a5a-2916122bf13c 2025-06-24 19:32:08,497 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/6a9d54e4-d6a7-4779-8a32-32957f025a92 2025-06-24 19:32:08,511 - INFO - Verified VN network id 8 for VN 4ca646d4-0e11-4629-8a5a-2916122bf13c 2025-06-24 19:32:08,511 - INFO - Verifications in API Server for VN ctest-vn-22875966 passed 2025-06-24 19:32:08,511 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/4ca646d4-0e11-4629-8a5a-2916122bf13c 2025-06-24 19:32:08,521 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/6a9d54e4-d6a7-4779-8a32-32957f025a92 2025-06-24 19:32:08,528 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/6a9d54e4-d6a7-4779-8a32-32957f025a92 2025-06-24 19:32:08,535 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/ba98f40b-5b1a-4a29-bd84-1b9ebcb30cf6 2025-06-24 19:32:08,547 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-22875966', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-77340874', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5523179869599516201', 'uuid-lslong': '9969325899908903228'}, 'enable': 'true', 'created': '2025-06-24T19:32:06', 'last-modified': '2025-06-24T19:32:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.026207'} 2025-06-24 19:32:08,555 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-24 19:32:08,555 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-22875966 passed 2025-06-24 19:32:08,555 - DEBUG - ====Verifying policy data for ctest-vn-22875966 in API_Server ====== 2025-06-24 19:32:08,556 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-06-24 19:32:08,562 - DEBUG - Requesting: http://10.0.0.33:8082/domain/dc75db7d-aaef-4a5a-b932-dc19bbe78927 2025-06-24 19:32:08,574 - DEBUG - Requesting: http://10.0.0.33:8082/project/8c0490ce-27b4-4ca9-986b-98b3a5053eef 2025-06-24 19:32:08,654 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/4ca646d4-0e11-4629-8a5a-2916122bf13c 2025-06-24 19:32:08,666 - DEBUG - ==>Verifying data for policy with id: 011a3b44-2b4c-448b-8e5e-b30659abe483, fqn: ['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-policy-allow-all-38236324'] 2025-06-24 19:32:08,666 - INFO - VN ctest-vn-22875966 Policy verification: verify_vn_policy_in_api_server, status: True 2025-06-24 19:32:08,666 - DEBUG - Verifying the vn in opserver 2025-06-24 19:32:08,666 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-22875966 virtual network link through opserver 10.0.0.33 2025-06-24 19:32:08,666 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-06-24 19:32:08,998 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-06-24 19:32:09,058 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-22875966', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-22875966?flat'} 2025-06-24 19:32:09,058 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-22875966 is found in opserver 2025-06-24 19:32:09,069 - DEBUG - Do not have enough data to verify VN in agent 2025-06-24 19:32:09,075 - DEBUG - VRF ids for VN ctest-vn-22875966: {} 2025-06-24 19:32:09,075 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-06-24 19:32:09,081 - DEBUG - Requesting: http://10.0.0.33:8082/domain/dc75db7d-aaef-4a5a-b932-dc19bbe78927 2025-06-24 19:32:09,093 - DEBUG - Requesting: http://10.0.0.33:8082/project/8c0490ce-27b4-4ca9-986b-98b3a5053eef 2025-06-24 19:32:09,170 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c91b9010-babd-4510-86ca-118e9de3494e 2025-06-24 19:32:09,184 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c91b9010-babd-4510-86ca-118e9de3494e 2025-06-24 19:32:09,195 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/e9ce9d06-2bae-4114-938a-9283a7dcd7c4 2025-06-24 19:32:09,203 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/e9ce9d06-2bae-4114-938a-9283a7dcd7c4 2025-06-24 19:32:09,212 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/6d65687b-be7b-4ba3-9f4b-c4170ad54783 2025-06-24 19:32:09,221 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-06-24 19:32:09,222 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c91b9010-babd-4510-86ca-118e9de3494e 2025-06-24 19:32:09,233 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/e9ce9d06-2bae-4114-938a-9283a7dcd7c4 2025-06-24 19:32:09,248 - INFO - Verified VN network id 9 for VN c91b9010-babd-4510-86ca-118e9de3494e 2025-06-24 19:32:09,248 - INFO - Verifications in API Server for VN ctest-vn-75833080 passed 2025-06-24 19:32:09,248 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c91b9010-babd-4510-86ca-118e9de3494e 2025-06-24 19:32:09,259 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/e9ce9d06-2bae-4114-938a-9283a7dcd7c4 2025-06-24 19:32:09,266 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/e9ce9d06-2bae-4114-938a-9283a7dcd7c4 2025-06-24 19:32:09,274 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/6d65687b-be7b-4ba3-9f4b-c4170ad54783 2025-06-24 19:32:09,287 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-75833080', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-77340874', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14491334627521545488', 'uuid-lslong': '9712594850609842510'}, 'enable': 'true', 'created': '2025-06-24T19:32:06', 'last-modified': '2025-06-24T19:32:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.523417'} 2025-06-24 19:32:09,294 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-06-24 19:32:09,294 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-75833080 passed 2025-06-24 19:32:09,294 - DEBUG - ====Verifying policy data for ctest-vn-75833080 in API_Server ====== 2025-06-24 19:32:09,294 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-06-24 19:32:09,300 - DEBUG - Requesting: http://10.0.0.33:8082/domain/dc75db7d-aaef-4a5a-b932-dc19bbe78927 2025-06-24 19:32:09,313 - DEBUG - Requesting: http://10.0.0.33:8082/project/8c0490ce-27b4-4ca9-986b-98b3a5053eef 2025-06-24 19:32:09,390 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c91b9010-babd-4510-86ca-118e9de3494e 2025-06-24 19:32:09,400 - DEBUG - ==>Verifying data for policy with id: 011a3b44-2b4c-448b-8e5e-b30659abe483, fqn: ['default-domain', 'ctest-TestBasicPolicy-77340874', 'ctest-policy-allow-all-38236324'] 2025-06-24 19:32:09,400 - INFO - VN ctest-vn-75833080 Policy verification: verify_vn_policy_in_api_server, status: True 2025-06-24 19:32:09,400 - DEBUG - Verifying the vn in opserver 2025-06-24 19:32:09,401 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-75833080 virtual network link through opserver 10.0.0.33 2025-06-24 19:32:09,401 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-06-24 19:32:09,411 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-75833080', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-75833080?flat'} 2025-06-24 19:32:09,411 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-77340874:ctest-vn-75833080 is found in opserver 2025-06-24 19:32:09,422 - DEBUG - Do not have enough data to verify VN in agent 2025-06-24 19:32:09,428 - DEBUG - VRF ids for VN ctest-vn-75833080: {} 2025-06-24 19:32:09,483 - DEBUG - Services list from nova: [, , ] 2025-06-24 19:32:10,595 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3541-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3541-1) 2025-06-24 19:32:11,908 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3541-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3541-1) 2025-06-24 19:32:11,908 - INFO - Waiting for VM ctest-TestBasicPolicy-77340874-40927662 to be up.. 2025-06-24 19:32:11,981 - DEBUG - VM is in ERROR state now 2025-06-24 19:32:11,981 - ERROR - VM in error state. 2025-06-24 19:32:11,981 - ERROR - VM is not in ACTIVE state 2025-06-24 19:32:12,074 - ERROR - Fatal Nova Exception while getting VM detail 2025-06-24 19:32:12,074 - DEBUG - None 2025-06-24 19:32:12,074 - INFO - Waiting for VM ctest-TestBasicPolicy-77340874-71413380 to be up.. 2025-06-24 19:32:12,128 - DEBUG - VM is in ERROR state now 2025-06-24 19:32:12,128 - ERROR - VM in error state. 2025-06-24 19:32:12,128 - ERROR - VM is not in ACTIVE state 2025-06-24 19:32:12,205 - ERROR - Fatal Nova Exception while getting VM detail 2025-06-24 19:32:12,205 - DEBUG - None 2025-06-24 19:32:12,205 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:32:12,257 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:17,317 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:22,467 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:27,524 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:32,580 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:37,640 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:37,640 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:32:39,640 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:32:39,700 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:44,760 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:49,818 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:54,875 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:32:59,936 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:04,992 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:04,992 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:33:06,992 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:33:07,062 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:12,117 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:17,175 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:22,237 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:27,291 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:32,347 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:32,347 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:33:34,348 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:33:34,411 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:39,467 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:44,526 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:49,587 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:54,644 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:59,705 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:33:59,705 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:34:01,706 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:34:01,762 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:06,818 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:11,876 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:16,932 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:21,991 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:27,046 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:27,046 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:34:29,047 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:34:29,105 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:34,163 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:39,221 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:44,276 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:49,341 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:54,404 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:54,404 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:34:54,412 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:34:54,469 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:34:59,524 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:04,579 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:09,636 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:14,696 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:19,755 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:19,755 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:35:21,756 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:35:21,849 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:26,903 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:31,965 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:37,021 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:42,077 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:47,135 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:47,135 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:35:49,135 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:35:49,191 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:54,247 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:35:59,305 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:04,374 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:09,431 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:14,486 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:14,487 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:36:16,487 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:36:16,546 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:21,603 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:26,667 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:31,726 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:36,787 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:41,844 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:41,844 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:36:43,845 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:36:43,900 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:48,957 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:54,014 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:36:59,070 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:04,127 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:09,227 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:09,227 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:37:11,228 - INFO - VM name : ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:37:11,286 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:16,342 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:21,401 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:26,461 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:31,522 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:36,577 - DEBUG - VM ctest-TestBasicPolicy-77340874-71413380 : Status=ERROR, Addresses : {} 2025-06-24 19:37:36,577 - ERROR - VM 51cf67c5-1a8e-4c92-8756-9c6358be799c is not launched yet 2025-06-24 19:37:36,577 - INFO - Skip interface_detach for VM ctest-TestBasicPolicy-77340874-71413380 in state ERROR 2025-06-24 19:37:36,577 - INFO - Deleting VM ctest-TestBasicPolicy-77340874-71413380 2025-06-24 19:37:36,597 - ERROR - VM ctest-TestBasicPolicy-77340874-71413380 has failed to come up 2025-06-24 19:37:36,597 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-06-24T19:32:11Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-06-24 19:37:36,597 - INFO - Skip interface_detach for VM ctest-TestBasicPolicy-77340874-40927662 in state ERROR 2025-06-24 19:37:36,597 - INFO - Deleting VM ctest-TestBasicPolicy-77340874-40927662 2025-06-24 19:37:36,598 - ERROR - VM ctest-TestBasicPolicy-77340874-40927662 has failed to come up 2025-06-24 19:37:36,598 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-06-24T19:32:10Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-06-24 19:37:36,904 - INFO - Deleted policy ctest-policy-allow-all-38236324 2025-06-24 19:37:36,904 - INFO - Deleting VN ctest-vn-75833080 2025-06-24 19:37:37,036 - DEBUG - Response for deleting network () 2025-06-24 19:37:37,036 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/e9ce9d06-2bae-4114-938a-9283a7dcd7c4 2025-06-24 19:37:37,064 - DEBUG - Response Code: 404 2025-06-24 19:37:37,064 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-06-24 19:37:37,070 - DEBUG - Requesting: http://10.0.0.33:8082/domain/dc75db7d-aaef-4a5a-b932-dc19bbe78927 2025-06-24 19:37:37,085 - DEBUG - Requesting: http://10.0.0.33:8082/project/8c0490ce-27b4-4ca9-986b-98b3a5053eef 2025-06-24 19:37:37,157 - INFO - Validated that VN ctest-vn-75833080 is not found in API Server 2025-06-24 19:37:37,168 - DEBUG - VN ctest-vn-75833080 is not present in Agent 10.0.0.33 2025-06-24 19:37:37,168 - INFO - Validated that VN ctest-vn-75833080 is not in any agent 2025-06-24 19:37:37,185 - DEBUG - Control-node config DB still has VN ctest-vn-75833080 2025-06-24 19:37:42,199 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-75833080 info 2025-06-24 19:37:42,199 - INFO - Deleting VN ctest-vn-22875966 2025-06-24 19:37:42,299 - DEBUG - Response for deleting network () 2025-06-24 19:37:42,299 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/6a9d54e4-d6a7-4779-8a32-32957f025a92 2025-06-24 19:37:42,305 - DEBUG - Response Code: 404 2025-06-24 19:37:42,305 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-06-24 19:37:42,311 - DEBUG - Requesting: http://10.0.0.33:8082/domain/dc75db7d-aaef-4a5a-b932-dc19bbe78927 2025-06-24 19:37:42,371 - DEBUG - Requesting: http://10.0.0.33:8082/project/8c0490ce-27b4-4ca9-986b-98b3a5053eef 2025-06-24 19:37:42,444 - INFO - Validated that VN ctest-vn-22875966 is not found in API Server 2025-06-24 19:37:42,456 - DEBUG - VN ctest-vn-22875966 is not present in Agent 10.0.0.33 2025-06-24 19:37:42,456 - INFO - Validated that VN ctest-vn-22875966 is not in any agent 2025-06-24 19:37:42,473 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-22875966 info 2025-06-24 19:37:42,725 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/policy/test_policy_basic.py", line 118, in test_basic_policy_allow_deny
    assert vm1_fixture.ping_with_certainty(vm2_fixture.vm_ip), (
  File "/contrail-test/fixtures/vm_test.py", line 349, in vm_ip
    assert self.verify_vm_launched()
AssertionError
2025-06-24 19:37:42,732 - DEBUG - No XMPP flaps were noticed during the test 2025-06-24 19:37:42,732 - INFO - 2025-06-24 19:37:42,732 - INFO - END TEST : test_basic_policy_allow_deny : FAILED[0:05:37] 2025-06-24 19:37:42,732 - INFO - -------------------------------------------------------------------------------- 2025-06-24 19:37:43,478 - INFO - Deleted project: ctest-TestBasicPolicy-77340874, ID : 8c0490ce-27b4-4ca9-986b-98b3a5053eef