2026-05-20 15:36:16,041 - INFO - Domain Default found not creating 2026-05-20 15:36:16,258 - INFO - Project ctest-SecurityGroupBasicRegressionTests1_contrail-69954729 not found, creating it 2026-05-20 15:36:16,881 - INFO - Created Project:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729, ID : 8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:18,924 - INFO - ================================================================================ 2026-05-20 15:36:18,924 - INFO - STARTING TEST : test_sec_group_basic 2026-05-20 15:36:18,925 - INFO - TEST DESCRIPTION : Description: Test basic SG features 1. Security group create and delete 2. Create security group with custom rules and then update it for tcp 3. Launch VM with custom created security group and verify 4. Remove secuity group association with VM 5. Add back custom security group to VM and verify 6. Test with ping, which should fail 7. Test with TCP which should pass 8. Update the rules to allow icmp, ping should pass now 9. Delete security group while ports still reference it; SG is detached from VMs and removed (Neutron/Tempest semantics) 2026-05-20 15:36:20,224 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.20.0.25': '0', '10.20.0.193': '0'}, '10.0.0.249': {'10.20.0.25': '0', '10.20.0.14': '0'}} with 2026-05-20 15:36:20,224 - INFO - Initial checks done. Running the testcase now 2026-05-20 15:36:20,224 - INFO - 2026-05-20 15:36:20,703 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] 2026-05-20 15:36:20,910 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] created succesfully 2026-05-20 15:36:20,910 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:21,264 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:21,308 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:21,362 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:21,487 - DEBUG - Requesting: http://10.0.0.57:8082/security-group/9ad536ae-6f58-438b-95fd-001de20065d7 2026-05-20 15:36:21,503 - INFO - Security group ctest-test_sec_group-33682722 found in the API Server 2026-05-20 15:36:21,504 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:21,512 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:21,526 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:21,649 - DEBUG - Requesting: http://10.0.0.57:8082/access-control-lists 2026-05-20 15:36:21,665 - INFO - Validated that ACLs for Security group ctest-test_sec_group-33682722 are present in API Server 2026-05-20 15:36:21,673 - INFO - Validated that Security group ctest-test_sec_group-33682722 is found in control node 10.0.0.57 2026-05-20 15:36:21,680 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs found in the control node 10.0.0.57 2026-05-20 15:36:21,688 - INFO - Validated that Security group ctest-test_sec_group-33682722 is found in control node 10.0.0.141 2026-05-20 15:36:21,696 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs found in the control node 10.0.0.141 2026-05-20 15:36:21,704 - INFO - Validated that Security group ctest-test_sec_group-33682722 is found in control node 10.0.0.56 2026-05-20 15:36:21,714 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs found in the control node 10.0.0.56 2026-05-20 15:36:21,714 - INFO - Validated SG ctest-test_sec_group-33682722 in Control nodes 2026-05-20 15:36:21,714 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] 2026-05-20 15:36:21,826 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] deleted successfully. 2026-05-20 15:36:21,826 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:21,834 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:21,861 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:21,977 - INFO - Security group ctest-test_sec_group-33682722 removed from the API Server 2026-05-20 15:36:21,977 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:21,986 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:22,004 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:22,115 - DEBUG - Requesting: http://10.0.0.57:8082/access-control-lists 2026-05-20 15:36:22,128 - DEBUG - ACLs for Security group ctest-test_sec_group-33682722 removed from the API Server 2026-05-20 15:36:22,137 - INFO - security group ctest-test_sec_group-33682722 removed from Control-node 10.0.0.57 2026-05-20 15:36:22,147 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs removed from the control node 10.0.0.57 2026-05-20 15:36:22,154 - INFO - security group ctest-test_sec_group-33682722 removed from Control-node 10.0.0.141 2026-05-20 15:36:22,161 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs removed from the control node 10.0.0.141 2026-05-20 15:36:22,167 - INFO - security group ctest-test_sec_group-33682722 removed from Control-node 10.0.0.56 2026-05-20 15:36:22,173 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs removed from the control node 10.0.0.56 2026-05-20 15:36:22,173 - INFO - Validated that SG ctest-test_sec_group-33682722 is not in control nodes 2026-05-20 15:36:22,179 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] 2026-05-20 15:36:22,381 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] created succesfully 2026-05-20 15:36:22,381 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:22,391 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:22,407 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:22,528 - DEBUG - Requesting: http://10.0.0.57:8082/security-group/ad383a5d-6290-426d-b66e-7611fa707784 2026-05-20 15:36:22,547 - INFO - Security group ctest-test_sec_group-33682722 found in the API Server 2026-05-20 15:36:22,547 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:22,555 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:22,570 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:22,685 - DEBUG - Requesting: http://10.0.0.57:8082/access-control-lists 2026-05-20 15:36:22,694 - INFO - Validated that ACLs for Security group ctest-test_sec_group-33682722 are present in API Server 2026-05-20 15:36:22,710 - INFO - Validated that Security group ctest-test_sec_group-33682722 is found in control node 10.0.0.57 2026-05-20 15:36:22,724 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs found in the control node 10.0.0.57 2026-05-20 15:36:22,733 - INFO - Validated that Security group ctest-test_sec_group-33682722 is found in control node 10.0.0.141 2026-05-20 15:36:22,742 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs found in the control node 10.0.0.141 2026-05-20 15:36:22,750 - INFO - Validated that Security group ctest-test_sec_group-33682722 is found in control node 10.0.0.56 2026-05-20 15:36:22,758 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs found in the control node 10.0.0.56 2026-05-20 15:36:22,759 - INFO - Validated SG ctest-test_sec_group-33682722 in Control nodes 2026-05-20 15:36:22,760 - DEBUG - Replace all the rules of this security group ctest-test_sec_group-33682722 with the new rules 2026-05-20 15:36:22,760 - DEBUG - [{'protocol': 'tcp', 'dst_addresses': [{'subnet': {'ip_prefix': '190.90.76.64', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'src_addresses': [{'security_group': 'local'}]}, {'protocol': 'tcp', 'src_addresses': [{'subnet': {'ip_prefix': '190.90.76.64', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'dst_addresses': [{'security_group': 'local'}]}] 2026-05-20 15:36:23,229 - DEBUG - Response for create_network : {'network': {'id': '31fbf800-8672-4ee2-9785-e82f16378974', 'name': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'tenant_id': '8ad9515ddab247ff92fe75bd19ef8265', 'project_id': '8ad9515ddab247ff92fe75bd19ef8265', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943'], 'port_security_enabled': True, 'description': ''}} 2026-05-20 15:36:23,606 - DEBUG - Response for create_subnet : {'subnet': {'id': '274ad517-44c2-471e-81b6-d5c225fa5ae8', 'name': '', 'tenant_id': '8ad9515ddab247ff92fe75bd19ef8265', 'network_id': '31fbf800-8672-4ee2-9785-e82f16378974', 'ip_version': 4, 'cidr': '190.90.76.64/26', 'allocation_pools': [{'start': '190.90.76.66', 'end': '190.90.76.126'}], 'gateway_ip': '190.90.76.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '190.90.76.66', 'tags': [], 'project_id': '8ad9515ddab247ff92fe75bd19ef8265'}} 2026-05-20 15:36:23,633 - INFO - Created VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:36:23,649 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 UUID is 31fbf800-8672-4ee2-9785-e82f16378974 2026-05-20 15:36:23,742 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:23,751 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:23,774 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:23,886 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/31fbf800-8672-4ee2-9785-e82f16378974 2026-05-20 15:36:23,907 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/31fbf800-8672-4ee2-9785-e82f16378974 2026-05-20 15:36:23,926 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6d803e18-ca77-4ce5-9a0c-f2aa478ac4cd 2026-05-20 15:36:23,936 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6d803e18-ca77-4ce5-9a0c-f2aa478ac4cd 2026-05-20 15:36:23,948 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/65b0506a-601c-494b-b286-7fcde9f0adbc 2026-05-20 15:36:23,960 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-20 15:36:23,960 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/31fbf800-8672-4ee2-9785-e82f16378974 2026-05-20 15:36:23,978 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6d803e18-ca77-4ce5-9a0c-f2aa478ac4cd 2026-05-20 15:36:24,004 - INFO - Verified VN network id 13 for VN 31fbf800-8672-4ee2-9785-e82f16378974 2026-05-20 15:36:24,004 - INFO - Verifications in API Server for VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 passed 2026-05-20 15:36:24,005 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/31fbf800-8672-4ee2-9785-e82f16378974 2026-05-20 15:36:24,022 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6d803e18-ca77-4ce5-9a0c-f2aa478ac4cd 2026-05-20 15:36:24,036 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6d803e18-ca77-4ce5-9a0c-f2aa478ac4cd 2026-05-20 15:36:24,051 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/65b0506a-601c-494b-b286-7fcde9f0adbc 2026-05-20 15:36:24,075 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3601745008152170210', 'uuid-lslong': '10918388160563480948'}, 'enable': 'true', 'created': '2026-05-20T15:36:23', 'last-modified': '2026-05-20T15:36:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.563139'} 2026-05-20 15:36:24,084 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-20 15:36:24,092 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3601745008152170210', 'uuid-lslong': '10918388160563480948'}, 'enable': 'true', 'created': '2026-05-20T15:36:23', 'last-modified': '2026-05-20T15:36:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.586969'} 2026-05-20 15:36:24,101 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-20 15:36:24,110 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3601745008152170210', 'uuid-lslong': '10918388160563480948'}, 'enable': 'true', 'created': '2026-05-20T15:36:23', 'last-modified': '2026-05-20T15:36:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.602192'} 2026-05-20 15:36:24,117 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-20 15:36:24,117 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 passed 2026-05-20 15:36:24,117 - DEBUG - ====Verifying policy data for ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 in API_Server ====== 2026-05-20 15:36:24,117 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:36:24,127 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:36:24,146 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:36:24,257 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/31fbf800-8672-4ee2-9785-e82f16378974 2026-05-20 15:36:24,270 - DEBUG - =>VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 has no policy to be verified 2026-05-20 15:36:24,270 - DEBUG - Verifying the vn in opserver 2026-05-20 15:36:24,270 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 virtual network link through opserver 10.0.0.57 2026-05-20 15:36:24,270 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2026-05-20 15:36:24,645 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2026-05-20 15:36:24,744 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943?flat'} 2026-05-20 15:36:24,744 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 virtual network link through opserver 10.0.0.141 2026-05-20 15:36:24,744 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-20 15:36:25,115 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-20 15:36:25,197 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943?flat'} 2026-05-20 15:36:25,197 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 virtual network link through opserver 10.0.0.56 2026-05-20 15:36:25,197 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2026-05-20 15:36:25,563 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2026-05-20 15:36:25,650 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943?flat'} 2026-05-20 15:36:25,650 - INFO - Validated that VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is found in opserver 2026-05-20 15:36:25,675 - DEBUG - Do not have enough data to verify VN in agent 2026-05-20 15:36:25,687 - DEBUG - VRF ids for VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943: {} 2026-05-20 15:36:25,928 - DEBUG - Services list from nova: [, , , ] 2026-05-20 15:36:27,371 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5803-2) 2026-05-20 15:36:29,207 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5803-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5803-1) 2026-05-20 15:36:29,316 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-05-20 15:36:34,426 - DEBUG - VM is in ACTIVE state now 2026-05-20 15:36:34,426 - INFO - VM name : ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:36:34,528 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 ID is af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:36:34,635 - DEBUG - VM is in ACTIVE state now 2026-05-20 15:36:34,667 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 launched on Node an-jenkins-deploy-platform-ansible-os-5803-2 2026-05-20 15:36:34,772 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:36:35,133 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:36:35,180 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:36:35,190 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:36:35,200 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:36:35,209 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:36:35,221 - DEBUG - Requesting: http://10.0.0.56:8082/instance-ip/b4f5d0b4-644e-4ef9-82b9-51897418bd07 2026-05-20 15:36:35,233 - DEBUG - Verifying in api server 10.0.0.56 2026-05-20 15:36:35,233 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:36:35,243 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:36:35,256 - DEBUG - Requesting: http://10.0.0.56:8082/instance-ip/b4f5d0b4-644e-4ef9-82b9-51897418bd07 2026-05-20 15:36:35,266 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 verfication in all API Servers passed 2026-05-20 15:36:35,294 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 Tap interface: {'index': '4', 'name': 'tapa5808b4a-5f', 'uuid': 'a5808b4a-5f0e-4518-bfde-80a94cfa5ddd', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'vm_uuid': 'af518faf-9d7b-4c0d-9785-b8a555f7fad3', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969', 'ip_addr': '190.90.76.67', 'mac_addr': '02:a5:80:8b:4a:5f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '75', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:a5808b4a-5f0e-4518-bfde-80a94cfa5ddd', 'sg_uuid_list': ['ad383a5d-6290-426d-b66e-7611fa707784'], 'static_route_list': None, 'vm_project_uuid': '8ad9515d-dab2-47ff-92fe-75bd19ef8265', 'admin_state': 'Enabled', 'flow_key_idx': '40', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-20 15:36:35,294 - DEBUG - Agent 10.0.0.249 vrf name: default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:36:35,305 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.18:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-05-20 15:36:35,390 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 : Tap interface tapa5808b4a-5f is set to Active 2026-05-20 15:36:35,390 - DEBUG - Tap interface tapa5808b4a-5f detail : {'index': '4', 'name': 'tapa5808b4a-5f', 'uuid': 'a5808b4a-5f0e-4518-bfde-80a94cfa5ddd', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'vm_uuid': 'af518faf-9d7b-4c0d-9785-b8a555f7fad3', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969', 'ip_addr': '190.90.76.67', 'mac_addr': '02:a5:80:8b:4a:5f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '75', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:a5808b4a-5f0e-4518-bfde-80a94cfa5ddd', 'sg_uuid_list': ['ad383a5d-6290-426d-b66e-7611fa707784'], 'static_route_list': None, 'vm_project_uuid': '8ad9515d-dab2-47ff-92fe-75bd19ef8265', 'admin_state': 'Enabled', 'flow_key_idx': '40', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-20 15:36:35,506 - DEBUG - Starting Layer 2 verification in Agent 2026-05-20 15:36:35,521 - DEBUG - Layer 2 path is seen for VM MAC 02:a5:80:8b:4a:5f in agent 10.0.0.249 2026-05-20 15:36:35,521 - DEBUG - Active layer 2 route in agent is present for VMI tapa5808b4a-5f 2026-05-20 15:36:35,521 - DEBUG - L2 label(36) matches bw route table and interface table 2026-05-20 15:36:35,530 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is found in Agent of node 10.0.0.242 2026-05-20 15:36:35,674 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is consistent in agent 10.0.0.242 2026-05-20 15:36:35,675 - DEBUG - Route for VM IP ['190.90.76.67'] is consistent in agent 10.0.0.242 2026-05-20 15:36:35,675 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 verification for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 in Agent 10.0.0.242 passed 2026-05-20 15:36:35,804 - DEBUG - Starting all layer 2 verification in agent 10.0.0.242 2026-05-20 15:36:35,822 - DEBUG - Route for VM MAC 02:a5:80:8b:4a:5f is consistent in agent 10.0.0.242 2026-05-20 15:36:35,833 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is found in Agent of node 10.0.0.249 2026-05-20 15:36:35,970 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is consistent in agent 10.0.0.249 2026-05-20 15:36:35,971 - DEBUG - Route for VM IP ['190.90.76.67'] is consistent in agent 10.0.0.249 2026-05-20 15:36:35,971 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 verification for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 in Agent 10.0.0.249 passed 2026-05-20 15:36:36,087 - DEBUG - Starting all layer 2 verification in agent 10.0.0.249 2026-05-20 15:36:36,102 - DEBUG - Route for VM MAC 02:a5:80:8b:4a:5f is consistent in agent 10.0.0.249 2026-05-20 15:36:39,317 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2026-05-20 15:36:39,317 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:36:39,334 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:36:43,415 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2026-05-20 15:36:43,415 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:36:43,431 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:36:47,510 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-05-20 15:36:47,510 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:36:47,528 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:36:51,604 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-05-20 15:36:51,604 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:36:51,624 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:36:55,702 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2026-05-20 15:36:55,702 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:36:55,718 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:36:59,793 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-05-20 15:36:59,793 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:36:59,809 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:37:03,888 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-05-20 15:37:03,888 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:37:03,906 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:37:07,988 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-05-20 15:37:07,988 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed! 2026-05-20 15:37:08,004 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is 190.90.76.65 and allocation pool is NOT set 2026-05-20 15:37:12,082 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=5.46 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1018ms\r\nrtt min/avg/max/mdev = 5.456/5.456/5.456/0.000 ms') 2026-05-20 15:37:12,083 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 passed 2026-05-20 15:37:12,083 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 verifications in Compute nodes passed 2026-05-20 15:37:12,348 - DEBUG - Validated VM route 190.90.76.67 in vrouter of 10.0.0.242 2026-05-20 15:37:12,357 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.18, 32; Got 10.20.0.18,32 2026-05-20 15:37:12,357 - DEBUG - Validated VM route 190.90.76.67 in vrouter of 10.0.0.242 2026-05-20 15:37:12,493 - DEBUG - Validated VM route 190.90.76.67 in vrouter of 10.0.0.249 2026-05-20 15:37:12,501 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-05-20 15:37:12,501 - INFO - Validated routes of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 in all vrouters 2026-05-20 15:37:12,963 - DEBUG - Starting all layer2 verification in 10.0.0.57 Control Node 2026-05-20 15:37:13,104 - DEBUG - Layer2 route found for VM MAC 02:a5:80:8b:4a:5f in Control-node 10.0.0.57 2026-05-20 15:37:13,105 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 same between Control-node 10.0.0.57 and Agent, Expected: 36, Seen: 36 2026-05-20 15:37:13,105 - DEBUG - Starting all layer2 verification in 10.0.0.141 Control Node 2026-05-20 15:37:13,246 - DEBUG - Layer2 route found for VM MAC 02:a5:80:8b:4a:5f in Control-node 10.0.0.141 2026-05-20 15:37:13,246 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 same between Control-node 10.0.0.141 and Agent, Expected: 36, Seen: 36 2026-05-20 15:37:13,246 - DEBUG - Starting all layer2 verification in 10.0.0.56 Control Node 2026-05-20 15:37:13,394 - DEBUG - Layer2 route found for VM MAC 02:a5:80:8b:4a:5f in Control-node 10.0.0.56 2026-05-20 15:37:13,394 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 same between Control-node 10.0.0.56 and Agent, Expected: 36, Seen: 36 2026-05-20 15:37:13,394 - INFO - Verification in Control-nodes for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 passed 2026-05-20 15:37:13,395 - DEBUG - Verifying the vm in opserver 2026-05-20 15:37:13,395 - DEBUG - Verifying in collector 10.0.0.56 ... 2026-05-20 15:37:13,395 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3?flat 2026-05-20 15:37:13,518 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:a5808b4a-5f0e-4518-bfde-80a94cfa5ddd?flat 2026-05-20 15:37:13,633 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:a5808b4a-5f0e-4518-bfde-80a94cfa5ddd?flat 2026-05-20 15:37:13,728 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3?flat 2026-05-20 15:37:13,746 - DEBUG - Verifying vm in vn uve 2026-05-20 15:37:13,746 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:a5808b4a-5f0e-4518-bfde-80a94cfa5ddd?flat 2026-05-20 15:37:13,769 - DEBUG - VM uve shows interface as {'admin_state': True, 'gateway': '190.90.76.65', 'fixed_ip4_list': ['190.90.76.67'], 'ip6_active': False, 'is_health_check_active': True, 'rx_vlan': 65535, 'label': 32, 'vm_uuid': 'af518faf-9d7b-4c0d-9785-b8a555f7fad3', 'vhostuser_mode': 0, 'virtual_network': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'ip6_address': '::', '__T': 1779291409902543, 'tx_vlan': 65535, 'mac_address': '02:a5:80:8b:4a:5f', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969', 'ip4_active': True, 'active': True, 'uuid': 'a5808b4a-5f0e-4518-bfde-80a94cfa5ddd', 'ip_address': '190.90.76.67', 'vn_uuid': '31fbf800-8672-4ee2-9785-e82f16378974', 'port_mirror_enabled': False, 'l2_active': True} 2026-05-20 15:37:13,769 - DEBUG - VM uve shows ip address as ['190.90.76.67', '::'] 2026-05-20 15:37:13,769 - DEBUG - VM uve shows virtual network as default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:37:13,769 - INFO - Verifying through opserver in 10.0.0.57 2026-05-20 15:37:13,770 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943?flat 2026-05-20 15:37:13,801 - DEBUG - expected vm list af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:37:13,801 - DEBUG - Extracted vm list ['af518faf-9d7b-4c0d-9785-b8a555f7fad3'] 2026-05-20 15:37:13,801 - INFO - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is present in default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:37:13,801 - DEBUG - Verifying vm in vrouter uve 2026-05-20 15:37:13,801 - DEBUG - Getting info from collector 10.0.0.56.. 2026-05-20 15:37:13,801 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3?flat 2026-05-20 15:37:13,919 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5803-2'] 2026-05-20 15:37:13,920 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:37:13,965 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:37:13,996 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:37:13,996 - DEBUG - Validated that VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is in Vrouter an-jenkins-deploy-platform-ansible-os-5803-2 UVE 2026-05-20 15:37:13,996 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-05-20 15:37:14,005 - DEBUG - Expected tap interface of VM uuid af518faf-9d7b-4c0d-9785-b8a555f7fad3 is default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:37:14,006 - DEBUG - Expected VN of VM uuid af518faf-9d7b-4c0d-9785-b8a555f7fad3 is default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:37:14,006 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:37:14,048 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:37:14,078 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:37:14,078 - INFO - tap interface default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:a5808b4a-5f0e-4518-bfde-80a94cfa5ddd of vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:37:14,078 - DEBUG - Connected network default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 of vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:37:14,078 - DEBUG - Verifying the af518faf-9d7b-4c0d-9785-b8a555f7fad3 virtual network link through opserver 10.0.0.57 2026-05-20 15:37:14,078 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines 2026-05-20 15:37:14,094 - DEBUG - VM link and name as {'name': 'af518faf-9d7b-4c0d-9785-b8a555f7fad3', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3?flat'} 2026-05-20 15:37:14,094 - DEBUG - Verifying the af518faf-9d7b-4c0d-9785-b8a555f7fad3 virtual network link through opserver 10.0.0.141 2026-05-20 15:37:14,094 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-machines 2026-05-20 15:37:14,200 - DEBUG - VM link and name as {'name': 'af518faf-9d7b-4c0d-9785-b8a555f7fad3', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3?flat'} 2026-05-20 15:37:14,200 - DEBUG - Verifying the af518faf-9d7b-4c0d-9785-b8a555f7fad3 virtual network link through opserver 10.0.0.56 2026-05-20 15:37:14,200 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2026-05-20 15:37:14,214 - DEBUG - VM link and name as {'name': 'af518faf-9d7b-4c0d-9785-b8a555f7fad3', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3?flat'} 2026-05-20 15:37:14,214 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 validations in Opserver passed 2026-05-20 15:37:14,214 - INFO - Waiting for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 to be up.. 2026-05-20 15:37:14,215 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:14,215 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:37:14,224 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:37:15,421 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.90 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.952 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.952/1.928/2.904/0.976 ms') 2026-05-20 15:37:15,422 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 passed 2026-05-20 15:37:15,499 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:15,499 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969, IP 190.90.76.67, Port 22 2026-05-20 15:37:15,581 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-20 15:37:15,719 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-20 15:37:20,720 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:20,720 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969, IP 190.90.76.67, Port 22 2026-05-20 15:37:20,778 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-20 15:37:20,881 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-20 15:37:25,882 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:25,883 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969, IP 190.90.76.67, Port 22 2026-05-20 15:37:25,952 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-20 15:37:26,070 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-20 15:37:31,071 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:31,071 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969, IP 190.90.76.67, Port 22 2026-05-20 15:37:31,229 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is ready for SSH connections 2026-05-20 15:37:31,359 - DEBUG - VM is in ACTIVE state now 2026-05-20 15:37:31,359 - INFO - VM name : ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 2026-05-20 15:37:31,471 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 ID is 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:37:31,586 - DEBUG - VM is in ACTIVE state now 2026-05-20 15:37:31,586 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 launched on Node an-jenkins-deploy-platform-ansible-os-5803-1 2026-05-20 15:37:31,688 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:37:31,701 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:37:31,711 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0 2026-05-20 15:37:31,723 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:37:31,733 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0 2026-05-20 15:37:31,747 - DEBUG - Requesting: http://10.0.0.56:8082/instance-ip/28fd24cb-cc3c-48b8-8c67-a62566ac98df 2026-05-20 15:37:31,764 - DEBUG - Verifying in api server 10.0.0.56 2026-05-20 15:37:31,764 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:37:31,777 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0 2026-05-20 15:37:31,791 - DEBUG - Requesting: http://10.0.0.56:8082/instance-ip/28fd24cb-cc3c-48b8-8c67-a62566ac98df 2026-05-20 15:37:31,805 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 verfication in all API Servers passed 2026-05-20 15:37:31,834 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 Tap interface: {'index': '4', 'name': 'tapfaae20c2-3c', 'uuid': 'faae20c2-3c55-481f-99e5-66d1661ef2b0', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'vm_uuid': '0a4143b2-bb82-4b9e-aa54-8c707106f0e5', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285', 'ip_addr': '190.90.76.68', 'mac_addr': '02:fa:ae:20:c2:3c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '63', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:faae20c2-3c55-481f-99e5-66d1661ef2b0', 'sg_uuid_list': ['ad383a5d-6290-426d-b66e-7611fa707784'], 'static_route_list': None, 'vm_project_uuid': '8ad9515d-dab2-47ff-92fe-75bd19ef8265', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-20 15:37:31,834 - DEBUG - Agent 10.0.0.242 vrf name: default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:37:31,842 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.129:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-05-20 15:37:31,943 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 : Tap interface tapfaae20c2-3c is set to Active 2026-05-20 15:37:31,943 - DEBUG - Tap interface tapfaae20c2-3c detail : {'index': '4', 'name': 'tapfaae20c2-3c', 'uuid': 'faae20c2-3c55-481f-99e5-66d1661ef2b0', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'vm_uuid': '0a4143b2-bb82-4b9e-aa54-8c707106f0e5', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285', 'ip_addr': '190.90.76.68', 'mac_addr': '02:fa:ae:20:c2:3c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '63', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:faae20c2-3c55-481f-99e5-66d1661ef2b0', 'sg_uuid_list': ['ad383a5d-6290-426d-b66e-7611fa707784'], 'static_route_list': None, 'vm_project_uuid': '8ad9515d-dab2-47ff-92fe-75bd19ef8265', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-20 15:37:32,067 - DEBUG - Starting Layer 2 verification in Agent 2026-05-20 15:37:32,084 - DEBUG - Layer 2 path is seen for VM MAC 02:fa:ae:20:c2:3c in agent 10.0.0.242 2026-05-20 15:37:32,084 - DEBUG - Active layer 2 route in agent is present for VMI tapfaae20c2-3c 2026-05-20 15:37:32,084 - DEBUG - L2 label(36) matches bw route table and interface table 2026-05-20 15:37:32,093 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is found in Agent of node 10.0.0.242 2026-05-20 15:37:32,242 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is consistent in agent 10.0.0.242 2026-05-20 15:37:32,243 - DEBUG - Route for VM IP ['190.90.76.68'] is consistent in agent 10.0.0.242 2026-05-20 15:37:32,243 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 verification for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 in Agent 10.0.0.242 passed 2026-05-20 15:37:32,364 - DEBUG - Starting all layer 2 verification in agent 10.0.0.242 2026-05-20 15:37:32,382 - DEBUG - Route for VM MAC 02:fa:ae:20:c2:3c is consistent in agent 10.0.0.242 2026-05-20 15:37:32,389 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is found in Agent of node 10.0.0.249 2026-05-20 15:37:32,531 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is consistent in agent 10.0.0.249 2026-05-20 15:37:32,531 - DEBUG - Route for VM IP ['190.90.76.68'] is consistent in agent 10.0.0.249 2026-05-20 15:37:32,531 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 verification for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 in Agent 10.0.0.249 passed 2026-05-20 15:37:32,648 - DEBUG - Starting all layer 2 verification in agent 10.0.0.249 2026-05-20 15:37:32,666 - DEBUG - Route for VM MAC 02:fa:ae:20:c2:3c is consistent in agent 10.0.0.249 2026-05-20 15:37:33,847 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.70 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=4.85 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.695/4.270/4.846/0.575 ms') 2026-05-20 15:37:33,848 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 passed 2026-05-20 15:37:33,848 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 verifications in Compute nodes passed 2026-05-20 15:37:34,089 - DEBUG - Validated VM route 190.90.76.68 in vrouter of 10.0.0.242 2026-05-20 15:37:34,096 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-05-20 15:37:34,222 - DEBUG - Validated VM route 190.90.76.68 in vrouter of 10.0.0.249 2026-05-20 15:37:34,228 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.129, 32; Got 10.20.0.129,32 2026-05-20 15:37:34,228 - DEBUG - Validated VM route 190.90.76.68 in vrouter of 10.0.0.249 2026-05-20 15:37:34,228 - INFO - Validated routes of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 in all vrouters 2026-05-20 15:37:34,681 - DEBUG - Starting all layer2 verification in 10.0.0.57 Control Node 2026-05-20 15:37:34,817 - DEBUG - Layer2 route found for VM MAC 02:fa:ae:20:c2:3c in Control-node 10.0.0.57 2026-05-20 15:37:34,817 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 same between Control-node 10.0.0.57 and Agent, Expected: 36, Seen: 36 2026-05-20 15:37:34,817 - DEBUG - Starting all layer2 verification in 10.0.0.141 Control Node 2026-05-20 15:37:34,954 - DEBUG - Layer2 route found for VM MAC 02:fa:ae:20:c2:3c in Control-node 10.0.0.141 2026-05-20 15:37:34,954 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 same between Control-node 10.0.0.141 and Agent, Expected: 36, Seen: 36 2026-05-20 15:37:34,954 - DEBUG - Starting all layer2 verification in 10.0.0.56 Control Node 2026-05-20 15:37:35,089 - DEBUG - Layer2 route found for VM MAC 02:fa:ae:20:c2:3c in Control-node 10.0.0.56 2026-05-20 15:37:35,090 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 same between Control-node 10.0.0.56 and Agent, Expected: 36, Seen: 36 2026-05-20 15:37:35,090 - INFO - Verification in Control-nodes for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 passed 2026-05-20 15:37:35,090 - DEBUG - Verifying the vm in opserver 2026-05-20 15:37:35,090 - DEBUG - Verifying in collector 10.0.0.56 ... 2026-05-20 15:37:35,090 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5?flat 2026-05-20 15:37:35,109 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:faae20c2-3c55-481f-99e5-66d1661ef2b0?flat 2026-05-20 15:37:35,132 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:faae20c2-3c55-481f-99e5-66d1661ef2b0?flat 2026-05-20 15:37:35,154 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5?flat 2026-05-20 15:37:35,171 - DEBUG - Verifying vm in vn uve 2026-05-20 15:37:35,171 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:faae20c2-3c55-481f-99e5-66d1661ef2b0?flat 2026-05-20 15:37:35,197 - DEBUG - VM uve shows interface as {'admin_state': True, 'gateway': '190.90.76.65', 'fixed_ip4_list': ['190.90.76.68'], 'ip6_active': False, 'is_health_check_active': True, 'rx_vlan': 65535, 'label': 32, 'vm_uuid': '0a4143b2-bb82-4b9e-aa54-8c707106f0e5', 'vhostuser_mode': 0, 'virtual_network': 'default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943', 'ip6_address': '::', '__T': 1779291411272451, 'tx_vlan': 65535, 'mac_address': '02:fa:ae:20:c2:3c', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285', 'ip4_active': True, 'active': True, 'uuid': 'faae20c2-3c55-481f-99e5-66d1661ef2b0', 'ip_address': '190.90.76.68', 'vn_uuid': '31fbf800-8672-4ee2-9785-e82f16378974', 'port_mirror_enabled': False, 'l2_active': True} 2026-05-20 15:37:35,197 - DEBUG - VM uve shows ip address as ['190.90.76.68', '::'] 2026-05-20 15:37:35,197 - DEBUG - VM uve shows virtual network as default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:37:35,197 - INFO - Verifying through opserver in 10.0.0.57 2026-05-20 15:37:35,198 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943?flat 2026-05-20 15:37:35,225 - DEBUG - expected vm list 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:37:35,225 - DEBUG - Extracted vm list ['0a4143b2-bb82-4b9e-aa54-8c707106f0e5'] 2026-05-20 15:37:35,225 - INFO - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is present in default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:37:35,226 - DEBUG - Verifying vm in vrouter uve 2026-05-20 15:37:35,226 - DEBUG - Getting info from collector 10.0.0.56.. 2026-05-20 15:37:35,226 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5?flat 2026-05-20 15:37:35,243 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5803-1'] 2026-05-20 15:37:35,243 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:37:35,285 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:37:35,320 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:37:35,320 - DEBUG - Validated that VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is in Vrouter an-jenkins-deploy-platform-ansible-os-5803-1 UVE 2026-05-20 15:37:35,320 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-05-20 15:37:35,332 - DEBUG - Expected tap interface of VM uuid 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:faae20c2-3c55-481f-99e5-66d1661ef2b0 2026-05-20 15:37:35,332 - DEBUG - Expected VN of VM uuid 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:37:35,332 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:37:35,373 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:37:35,408 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:37:35,408 - INFO - tap interface default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:faae20c2-3c55-481f-99e5-66d1661ef2b0 of vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:37:35,409 - DEBUG - Connected network default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 of vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:37:35,409 - DEBUG - Verifying the 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 virtual network link through opserver 10.0.0.57 2026-05-20 15:37:35,409 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines 2026-05-20 15:37:35,424 - DEBUG - VM link and name as {'name': '0a4143b2-bb82-4b9e-aa54-8c707106f0e5', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5?flat'} 2026-05-20 15:37:35,424 - DEBUG - Verifying the 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 virtual network link through opserver 10.0.0.141 2026-05-20 15:37:35,424 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-machines 2026-05-20 15:37:35,439 - DEBUG - VM link and name as {'name': '0a4143b2-bb82-4b9e-aa54-8c707106f0e5', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5?flat'} 2026-05-20 15:37:35,439 - DEBUG - Verifying the 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 virtual network link through opserver 10.0.0.56 2026-05-20 15:37:35,439 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2026-05-20 15:37:35,454 - DEBUG - VM link and name as {'name': '0a4143b2-bb82-4b9e-aa54-8c707106f0e5', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5?flat'} 2026-05-20 15:37:35,454 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 validations in Opserver passed 2026-05-20 15:37:35,454 - INFO - Waiting for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 to be up.. 2026-05-20 15:37:35,454 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:35,454 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:37:35,465 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0 2026-05-20 15:37:36,646 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.45 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.548 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.548/3.500/6.452/2.952 ms') 2026-05-20 15:37:36,646 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 passed 2026-05-20 15:37:36,724 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:36,724 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285, IP 190.90.76.68, Port 22 2026-05-20 15:37:36,792 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-20 15:37:36,902 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-20 15:37:41,904 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:41,904 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285, IP 190.90.76.68, Port 22 2026-05-20 15:37:41,972 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-20 15:37:42,078 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-20 15:37:47,079 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:47,079 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285, IP 190.90.76.68, Port 22 2026-05-20 15:37:47,256 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is ready for SSH connections 2026-05-20 15:37:47,256 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:37:47,267 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:37:47,281 - DEBUG - Security group ctest-test_sec_group-33682722 is attached to the VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:47,301 - DEBUG - Agent: Security group ctest-test_sec_group-33682722 is attached to the VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:47,398 - INFO - Validated that SG ctest-test_sec_group-33682722 is bound to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:47,398 - INFO - Remove security group ctest-test_sec_group-33682722 from VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:47,634 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:37:47,644 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:37:47,657 - WARNING - Security group ctest-test_sec_group-33682722 is not attached to the VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:47,885 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:37:47,895 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd 2026-05-20 15:37:47,908 - DEBUG - Security group ctest-test_sec_group-33682722 is attached to the VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:47,928 - DEBUG - Agent: Security group ctest-test_sec_group-33682722 is attached to the VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:48,033 - INFO - Validated that SG ctest-test_sec_group-33682722 is bound to VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:37:48,033 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:37:48,034 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 190.90.76.68, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.249, gateway password: c0ntrail123 2026-05-20 15:37:48,034 - DEBUG - ping -s 56 -c 3 -W 1 190.90.76.68 2026-05-20 15:38:36,734 - DEBUG - sudo: unable to resolve host ctest-securitygroupbasicregressiontests1-contrail-69954729-8753 PING 190.90.76.68 (190.90.76.68) 56(84) bytes of data. --- 190.90.76.68 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2001ms 2026-05-20 15:38:36,734 - WARNING - Ping to IP 190.90.76.68 from VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 failed 2026-05-20 15:38:36,734 - INFO - Ping FAILED as expected 2026-05-20 15:38:36,734 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:38:36,735 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -ll -p 10000 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2026-05-20 15:38:36,735 - DEBUG - nohup rm -f testfile;ls -la;nc -ll -p 10000 > testfile & 2026-05-20 15:39:24,936 - DEBUG - sudo: unable to resolve host ctest-securitygroupbasicregressiontests1-contrail-69954729-2283 total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2026-05-20 15:39:24,936 - DEBUG - Running remote_cmd, Cmd : nc -ll 10000 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2026-05-20 15:39:24,936 - DEBUG - nohup nc -ll 10000 > testfile & 2026-05-20 15:39:25,553 - DEBUG - sudo: unable to resolve host ctest-securitygroupbasicregressiontests1-contrail-69954729-2283 2026-05-20 15:39:25,553 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -p 10001 190.90.76.68 10000 < testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.249, gateway password: c0ntrail123 2026-05-20 15:39:25,553 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -p 10001 190.90.76.68 10000 < testfile 2026-05-20 15:39:52,738 - DEBUG - sudo: unable to resolve host ctest-securitygroupbasicregressiontests1-contrail-69954729-8753 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00108136 s, 92.5 kB/s 2026-05-20 15:39:52,738 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2026-05-20 15:39:52,738 - DEBUG - ls -l testfile 2026-05-20 15:39:53,199 - DEBUG - -rw-r--r-- 1 root root 100 May 20 15:39 testfile 2026-05-20 15:39:53,199 - INFO - File transfer verification for file size 100 passed on the VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 2026-05-20 15:39:53,199 - DEBUG - Replace all the rules of this security group ctest-test_sec_group-33682722 with the new rules 2026-05-20 15:39:53,199 - DEBUG - [{'protocol': '1', 'dst_addresses': [{'subnet': {'ip_prefix': '190.90.76.64', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'src_addresses': [{'security_group': 'local'}]}, {'protocol': '1', 'src_addresses': [{'subnet': {'ip_prefix': '190.90.76.64', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'dst_addresses': [{'security_group': 'local'}]}] 2026-05-20 15:39:53,274 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-20 15:39:53,274 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 190.90.76.68, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.249, gateway password: c0ntrail123 2026-05-20 15:39:53,274 - DEBUG - ping -s 56 -c 3 -W 1 190.90.76.68 2026-05-20 15:39:55,784 - DEBUG - sudo: unable to resolve host ctest-securitygroupbasicregressiontests1-contrail-69954729-8753 PING 190.90.76.68 (190.90.76.68) 56(84) bytes of data. 64 bytes from 190.90.76.68: icmp_req=1 ttl=64 time=3.49 ms 64 bytes from 190.90.76.68: icmp_req=2 ttl=64 time=1.33 ms 64 bytes from 190.90.76.68: icmp_req=3 ttl=64 time=1.27 ms --- 190.90.76.68 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.278/2.037/3.496/1.032 ms 2026-05-20 15:39:55,784 - INFO - Ping to IP 190.90.76.68 from VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 passed 2026-05-20 15:39:55,784 - INFO - Delete security group ctest-test_sec_group-33682722 with port back refs. 2026-05-20 15:39:55,784 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] 2026-05-20 15:39:55,807 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 2026-05-20 15:39:56,088 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 2026-05-20 15:39:56,187 - DEBUG - Verifying in api server 10.0.0.56 2026-05-20 15:39:56,187 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:39:56,198 - DEBUG - VM ID 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is still found in API Server 2026-05-20 15:39:58,200 - DEBUG - Verifying in api server 10.0.0.56 2026-05-20 15:39:58,200 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:39:58,207 - DEBUG - Response Code: 404 2026-05-20 15:39:58,208 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:39:58,215 - DEBUG - Response Code: 404 2026-05-20 15:39:58,215 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/0a4143b2-bb82-4b9e-aa54-8c707106f0e5 2026-05-20 15:39:58,222 - DEBUG - Response Code: 404 2026-05-20 15:39:58,223 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is fully removed in API-Server 2026-05-20 15:39:58,388 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-05-20 15:39:58,432 - DEBUG - Validated that vrouter 10.0.0.242 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:39:58,603 - DEBUG - VM route 190.90.76.68 has been marked for discard in VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 of compute 10.0.0.249 2026-05-20 15:39:58,611 - DEBUG - Validated that vrouter 10.0.0.249 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:39:58,611 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:39:58,611 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is removed in Compute, and routes are removed in all compute nodes 2026-05-20 15:39:58,855 - INFO - Routes for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-22836285 is removed in all control-nodes 2026-05-20 15:39:58,856 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:39:58,908 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:39:58,942 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:39:58,942 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:39:58,942 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:39:58,942 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:01,943 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:01,988 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:02,024 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:02,024 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:02,024 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:02,024 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:05,025 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:05,066 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:05,098 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:05,098 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:05,098 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:05,098 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:08,099 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:08,139 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:08,170 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:08,170 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:08,170 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:08,170 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:11,171 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:11,214 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:11,248 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:11,248 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:11,248 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:11,248 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:14,248 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:14,294 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:14,324 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:14,324 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:14,324 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:14,324 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:17,325 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:17,364 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:17,397 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:17,397 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:17,397 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:17,397 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:20,398 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:20,440 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:20,477 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:20,477 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:20,477 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:20,478 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:23,478 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-1:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:23,519 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-1?flat 2026-05-20 15:40:23,556 - DEBUG - VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is not present in vrouter an-jenkins-deploy-platform-ansible-os-5803-1 uve 2026-05-20 15:40:23,556 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:23,556 - DEBUG - interface for vm 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 deleted from vrouter uve ... 2026-05-20 15:40:23,556 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:23,556 - DEBUG - Validated that VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is removed in Vrouter UVE 2026-05-20 15:40:23,556 - DEBUG - Verifying through opserver in 10.0.0.57 2026-05-20 15:40:23,556 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943?flat 2026-05-20 15:40:23,583 - DEBUG - 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 BM not in default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 uve 2026-05-20 15:40:23,583 - DEBUG - Validated that VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is not present in the VN UVE 2026-05-20 15:40:23,583 - DEBUG - Verifying the 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 virtual network link through opserver 10.0.0.57 2026-05-20 15:40:23,583 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines 2026-05-20 15:40:23,599 - INFO - 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 vm uve deleted from opserver 2026-05-20 15:40:23,599 - DEBUG - Verifying the 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 virtual network link through opserver 10.0.0.141 2026-05-20 15:40:23,599 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-machines 2026-05-20 15:40:23,614 - INFO - 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 vm uve deleted from opserver 2026-05-20 15:40:23,614 - DEBUG - Verifying the 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 virtual network link through opserver 10.0.0.56 2026-05-20 15:40:23,614 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2026-05-20 15:40:23,631 - INFO - 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 vm uve deleted from opserver 2026-05-20 15:40:23,631 - INFO - Validated that VM 0a4143b2-bb82-4b9e-aa54-8c707106f0e5 is removed from Opserver 2026-05-20 15:40:23,631 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:40:23,914 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 2026-05-20 15:40:24,028 - DEBUG - Verifying in api server 10.0.0.56 2026-05-20 15:40:24,029 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:40:24,039 - DEBUG - VM ID af518faf-9d7b-4c0d-9785-b8a555f7fad3 of VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is still found in API Server 2026-05-20 15:40:26,040 - DEBUG - Verifying in api server 10.0.0.56 2026-05-20 15:40:26,040 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:40:26,048 - DEBUG - Response Code: 404 2026-05-20 15:40:26,049 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:40:26,057 - DEBUG - Response Code: 404 2026-05-20 15:40:26,057 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-machine/af518faf-9d7b-4c0d-9785-b8a555f7fad3 2026-05-20 15:40:26,063 - DEBUG - Response Code: 404 2026-05-20 15:40:26,064 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is fully removed in API-Server 2026-05-20 15:40:26,229 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-05-20 15:40:26,282 - DEBUG - Validated that vrouter 10.0.0.242 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:40:26,295 - DEBUG - Validated that vrouter 10.0.0.249 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:40:26,295 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:40:26,296 - INFO - VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is removed in Compute, and routes are removed in all compute nodes 2026-05-20 15:40:26,503 - INFO - Routes for VM ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-87535969 is removed in all control-nodes 2026-05-20 15:40:26,503 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:26,542 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:26,574 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:26,574 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:26,574 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:26,574 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:29,575 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:29,615 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:29,647 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:29,647 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:29,647 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:29,647 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:32,648 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:32,689 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:32,726 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:32,726 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:32,726 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:32,726 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:35,727 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:35,770 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:35,803 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:35,804 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:35,804 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:35,804 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:38,805 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:38,852 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:38,893 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:38,893 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:38,893 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:38,893 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:41,894 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:41,932 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:41,962 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:41,963 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:41,963 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:41,963 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:44,964 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:45,017 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:45,053 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:45,053 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:45,053 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:45,053 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:48,053 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:48,093 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:48,132 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:48,132 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:48,132 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:48,132 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:51,133 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5803-2:Compute:contrail-vrouter-agent:0?flat 2026-05-20 15:40:51,172 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5803-2?flat 2026-05-20 15:40:51,205 - DEBUG - VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is not present in vrouter an-jenkins-deploy-platform-ansible-os-5803-2 uve 2026-05-20 15:40:51,205 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-20 15:40:51,205 - DEBUG - interface for vm af518faf-9d7b-4c0d-9785-b8a555f7fad3 deleted from vrouter uve ... 2026-05-20 15:40:51,205 - DEBUG - Deleted interface not in error interface list ... 2026-05-20 15:40:51,205 - DEBUG - Validated that VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is removed in Vrouter UVE 2026-05-20 15:40:51,205 - DEBUG - Verifying through opserver in 10.0.0.57 2026-05-20 15:40:51,205 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943?flat 2026-05-20 15:40:51,226 - DEBUG - af518faf-9d7b-4c0d-9785-b8a555f7fad3 BM not in default-domain:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729:ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 uve 2026-05-20 15:40:51,226 - DEBUG - Validated that VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is not present in the VN UVE 2026-05-20 15:40:51,226 - DEBUG - Verifying the af518faf-9d7b-4c0d-9785-b8a555f7fad3 virtual network link through opserver 10.0.0.57 2026-05-20 15:40:51,227 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines 2026-05-20 15:40:51,247 - INFO - af518faf-9d7b-4c0d-9785-b8a555f7fad3 vm uve deleted from opserver 2026-05-20 15:40:51,247 - DEBUG - Verifying the af518faf-9d7b-4c0d-9785-b8a555f7fad3 virtual network link through opserver 10.0.0.141 2026-05-20 15:40:51,247 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-machines 2026-05-20 15:40:51,263 - INFO - af518faf-9d7b-4c0d-9785-b8a555f7fad3 vm uve deleted from opserver 2026-05-20 15:40:51,263 - DEBUG - Verifying the af518faf-9d7b-4c0d-9785-b8a555f7fad3 virtual network link through opserver 10.0.0.56 2026-05-20 15:40:51,263 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2026-05-20 15:40:51,278 - INFO - af518faf-9d7b-4c0d-9785-b8a555f7fad3 vm uve deleted from opserver 2026-05-20 15:40:51,279 - INFO - Validated that VM af518faf-9d7b-4c0d-9785-b8a555f7fad3 is removed from Opserver 2026-05-20 15:40:51,279 - INFO - Deleting VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 2026-05-20 15:40:51,486 - DEBUG - Response for deleting network () 2026-05-20 15:40:51,486 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6d803e18-ca77-4ce5-9a0c-f2aa478ac4cd 2026-05-20 15:40:51,494 - DEBUG - Response Code: 404 2026-05-20 15:40:51,495 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:40:51,503 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:40:51,523 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:40:51,633 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is not found in API Server 2026-05-20 15:40:51,648 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is not present in Agent 10.0.0.242 2026-05-20 15:40:51,662 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is not present in Agent 10.0.0.249 2026-05-20 15:40:51,662 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 is not in any agent 2026-05-20 15:40:51,709 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-SecurityGroupBasicRegressionTests1_contrail-69954729-93517943 info 2026-05-20 15:40:51,709 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] 2026-05-20 15:40:51,826 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1_contrail-69954729', 'ctest-test_sec_group-33682722'] deleted successfully. 2026-05-20 15:40:51,826 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:40:51,833 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:40:51,858 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:40:51,953 - INFO - Security group ctest-test_sec_group-33682722 removed from the API Server 2026-05-20 15:40:51,953 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2026-05-20 15:40:51,962 - DEBUG - Requesting: http://10.0.0.57:8082/domain/ffb590f3-7b6e-40e6-89b8-bd634f94ea0b 2026-05-20 15:40:51,983 - DEBUG - Requesting: http://10.0.0.57:8082/project/8ad9515d-dab2-47ff-92fe-75bd19ef8265 2026-05-20 15:40:52,083 - DEBUG - Requesting: http://10.0.0.57:8082/access-control-lists 2026-05-20 15:40:52,100 - DEBUG - ACLs for Security group ctest-test_sec_group-33682722 removed from the API Server 2026-05-20 15:40:52,106 - INFO - security group ctest-test_sec_group-33682722 removed from Control-node 10.0.0.57 2026-05-20 15:40:52,112 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs removed from the control node 10.0.0.57 2026-05-20 15:40:52,120 - INFO - security group ctest-test_sec_group-33682722 removed from Control-node 10.0.0.141 2026-05-20 15:40:52,126 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs removed from the control node 10.0.0.141 2026-05-20 15:40:52,132 - INFO - security group ctest-test_sec_group-33682722 removed from Control-node 10.0.0.56 2026-05-20 15:40:52,142 - DEBUG - Security group ctest-test_sec_group-33682722 ACLs removed from the control node 10.0.0.56 2026-05-20 15:40:52,142 - INFO - Validated that SG ctest-test_sec_group-33682722 is not in control nodes 2026-05-20 15:40:53,425 - ERROR - RefsExistError Python 3.9.25: /usr/bin/python3 Wed May 20 15:39:55 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/securitygroup/test_regression_basic.py in test_sec_group_basic(self=) 152 sg_fixture.quantum_h.delete_security_group(sg_fixture.secgrp_id) 153 else: 154 sg_fixture.cleanUp() 155 try: 156 self.vnc_lib.security_group_read(fq_name=sg_fixture.secgrp_fq_name) sg_fixture = sg_fixture.cleanUp = > /contrail-test/fixtures/security_group.py in cleanUp(self=) 85 86 def cleanUp(self): 87 self.delete() 88 super(SecurityGroupFixture, self).cleanUp() 89 self = self.delete = > /contrail-test/fixtures/security_group.py in delete(self=, verify=False) 100 if self.inputs.is_gui_based_config(): 101 self.webui.delete_security_group(self) 102 self.orch.delete_security_group(sg_id=self.secgrp_id, option=self.option) 103 if self.verify_is_run or verify: 104 result, msg = self.verify_on_cleanup() self = self.orch = self.orch.delete_security_group = > sg_id undefined self.secgrp_id = 'ad383a5d-6290-426d-b66e-7611fa707784' option undefined self.option = 'contrail' /contrail-test/fixtures/openstack.py in delete_security_group(self=, sg_id='ad383a5d-6290-426d-b66e-7611fa707784', option='contrail', **kwargs={}) 267 def delete_security_group(self, sg_id, option='orch', **kwargs): 268 if option == 'contrail': 269 return super(OpenstackOrchestrator, self).delete_security_group(sg_id=sg_id, **kwargs) 270 self.quantum_h.delete_security_group(sg_id) 271 builtinsuper = global OpenstackOrchestrator = self = ).delete_security_group = > sg_id = 'ad383a5d-6290-426d-b66e-7611fa707784' kwargs = {} /contrail-test/fixtures/orchestrator.py in delete_security_group(self=, sg_id='ad383a5d-6290-426d-b66e-7611fa707784', **kwargs={}) 177 178 def delete_security_group(self, sg_id, **kwargs): 179 return self.vnc_h.delete_security_group(sg_id, **kwargs) 180 181 def get_security_group(self, sg_id, **kwargs): self = self.vnc_h = self.vnc_h.delete_security_group = > sg_id = 'ad383a5d-6290-426d-b66e-7611fa707784' kwargs = {} /contrail-test/fixtures/contrailapi.py in delete_security_group(self=, sg_id='ad383a5d-6290-426d-b66e-7611fa707784', **kwargs={}) 254 255 def delete_security_group(self, sg_id, **kwargs): 256 self._vnc.security_group_delete(id=sg_id) 257 258 def get_security_group(self, sg_id, **kwargs): self = self._vnc = self._vnc.security_group_delete = functools.partial(>, 'security-group') builtinid = sg_id = 'ad383a5d-6290-426d-b66e-7611fa707784' /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in wrapper(self=, *args=('security-group',), **kwargs={'id': 'ad383a5d-6290-426d-b66e-7611fa707784'}) 50 retry_on_error=False) 51 self._parse_homepage(homepage) 52 return func(self, *args, **kwargs) 53 return wrapper 54 func = self = args = ('security-group',) kwargs = {'id': 'ad383a5d-6290-426d-b66e-7611fa707784'} /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _object_delete(self=, res_type='security-group', fq_name=None, id='ad383a5d-6290-426d-b66e-7611fa707784', ifmap_id=None) 861 uri = obj_cls.resource_uri_base[res_type] + '/' + id 862 863 self._request_server(OP_DELETE, uri) 864 # end _object_delete 865 self = self._request_server = > global OP_DELETE = 4 uri = '/security-group/ad383a5d-6290-426d-b66e-7611fa707784' /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _request_server(self=, op=4, url='/security-group/ad383a5d-6290-426d-b66e-7611fa707784', data=None, retry_on_error=True, retry_after_authn=False, retry_count=30) 1124 raise ConnectionError("Unable to retrive the api server root url.") 1125 1126 return self._request( 1127 op, url, data=data, retry_on_error=retry_on_error, 1128 retry_after_authn=retry_after_authn, retry_count=retry_count) self = self._request = > op = 4 url = '/security-group/ad383a5d-6290-426d-b66e-7611fa707784' data = None retry_on_error = True retry_after_authn = False retry_count = 30 /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _request(self=, op=4, url='/security-group/ad383a5d-6290-426d-b66e-7611fa707784', data=None, retry_on_error=True, retry_after_authn=False, retry_count=30) 1185 raise OverQuota(content) 1186 elif status == 409: 1187 raise RefsExistError(content) 1188 elif status == 413: 1189 raise RequestSizeError(content) global RefsExistError = content = "Delete when resource still referred: ['http://10...-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0']" RefsExistError: Delete when resource still referred: ['http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd', 'http://10.0.0.56:8082/virtual-machine-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0'] __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'vnc_api.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ("Delete when resource still referred: ['http://10...-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0']",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/securitygroup/test_regression_basic.py", line 154, in test_sec_group_basic sg_fixture.cleanUp() File "/contrail-test/fixtures/security_group.py", line 87, in cleanUp self.delete() File "/contrail-test/fixtures/security_group.py", line 102, in delete self.orch.delete_security_group(sg_id=self.secgrp_id, option=self.option) File "/contrail-test/fixtures/openstack.py", line 269, in delete_security_group return super(OpenstackOrchestrator, self).delete_security_group(sg_id=sg_id, **kwargs) File "/contrail-test/fixtures/orchestrator.py", line 179, in delete_security_group return self.vnc_h.delete_security_group(sg_id, **kwargs) File "/contrail-test/fixtures/contrailapi.py", line 256, in delete_security_group self._vnc.security_group_delete(id=sg_id) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 52, in wrapper return func(self, *args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 863, in _object_delete self._request_server(OP_DELETE, uri) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 1126, in _request_server return self._request( File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 1187, in _request raise RefsExistError(content) vnc_api.exceptions.RefsExistError: Delete when resource still referred: ['http://10.0.0.56:8082/virtual-machine-interface/a5808b4a-5f0e-4518-bfde-80a94cfa5ddd', 'http://10.0.0.56:8082/virtual-machine-interface/faae20c2-3c55-481f-99e5-66d1661ef2b0'] 2026-05-20 15:40:53,440 - DEBUG - No XMPP flaps were noticed during the test 2026-05-20 15:40:53,440 - INFO -

2026-05-20 15:40:53,440 - INFO - END TEST : test_sec_group_basic : FAILED[0:04:35]

2026-05-20 15:40:53,441 - INFO - -------------------------------------------------------------------------------- 2026-05-20 15:40:54,330 - INFO - Deleted project: ctest-SecurityGroupBasicRegressionTests1_contrail-69954729, ID : 8ad9515d-dab2-47ff-92fe-75bd19ef8265