2025-05-08 02:21:43,680 - INFO - Domain Default found not creating 2025-05-08 02:21:43,812 - INFO - Project ctest-TestBasicVMVN-30141096 not found, creating it 2025-05-08 02:21:44,245 - INFO - Created Project:ctest-TestBasicVMVN-30141096, ID : f477dfc9-39f6-4d8d-b8e4-d3037ff8568a 2025-05-08 02:21:45,625 - INFO - ================================================================================ 2025-05-08 02:21:45,625 - INFO - STARTING TEST : test_generic_link_local_service 2025-05-08 02:21:45,625 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-05-08 02:21:45,880 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.18': '0'}} with 2025-05-08 02:21:45,880 - INFO - Initial checks done. Running the testcase now 2025-05-08 02:21:45,880 - INFO - 2025-05-08 02:21:46,401 - DEBUG - Response for create_network : {'network': {'id': '4cf1b5ff-9395-4d33-a1bb-7e98de366210', 'name': 'ctest-vn2_metadata-17370505', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-30141096', 'ctest-vn2_metadata-17370505'], 'port_security_enabled': True, 'description': ''}} 2025-05-08 02:21:46,610 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b24d7e99-fb85-486b-b6cd-5266d25379bd', 'name': '', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'network_id': '4cf1b5ff-9395-4d33-a1bb-7e98de366210', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a'}} 2025-05-08 02:21:46,627 - INFO - Created VN ctest-vn2_metadata-17370505 2025-05-08 02:21:46,680 - DEBUG - VN ctest-vn2_metadata-17370505 UUID is 4cf1b5ff-9395-4d33-a1bb-7e98de366210 2025-05-08 02:21:46,866 - DEBUG - Services list from nova: [, , ] 2025-05-08 02:21:47,794 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3285-1) 2025-05-08 02:21:47,900 - DEBUG - Link local service introspect added 2025-05-08 02:21:47,940 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-05-08 02:21:53,037 - DEBUG - VM is in ACTIVE state now 2025-05-08 02:21:53,164 - INFO - Waiting for VM ctest-TestBasicVMVN-30141096-90155892 to be up.. 2025-05-08 02:21:53,164 - INFO - VM name : ctest-TestBasicVMVN-30141096-90155892 2025-05-08 02:21:53,241 - DEBUG - VM ctest-TestBasicVMVN-30141096-90155892 ID is ba545890-1f6a-40d4-8697-61ced8c41dcd 2025-05-08 02:21:53,242 - DEBUG - VM ctest-TestBasicVMVN-30141096-90155892 launched on Node cn-jenkins-deploy-platform-ansible-os-3285-1 2025-05-08 02:21:53,349 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ba545890-1f6a-40d4-8697-61ced8c41dcd 2025-05-08 02:21:53,651 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ba545890-1f6a-40d4-8697-61ced8c41dcd 2025-05-08 02:21:53,698 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/4028597b-4e9d-4242-a1af-a43c3ad1eb7b 2025-05-08 02:21:56,962 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-05-08 02:21:56,963 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-30141096-90155892 failed! 2025-05-08 02:21:57,021 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-30141096:ctest-vn2_metadata-17370505 is 11.1.1.1 and allocation pool is NOT set 2025-05-08 02:21:59,087 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.05 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.49 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.485/2.766/3.047/0.281 ms') 2025-05-08 02:21:59,088 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-30141096-90155892 passed 2025-05-08 02:21:59,249 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:21:59,249 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-30141096-90155892, IP 11.1.1.3, Port 22 2025-05-08 02:21:59,414 - DEBUG - VM ctest-TestBasicVMVN-30141096-90155892 is ready for SSH connections 2025-05-08 02:21:59,414 - INFO - Retry 0 2025-05-08 02:21:59,414 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:21:59,415 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-05-08 02:22:00,984 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-05-08 02:22:00,985 - INFO - Generic metadata worked 2025-05-08 02:22:01,232 - DEBUG - Link local service introspect removed 2025-05-08 02:22:01,232 - INFO - Deleting VM ctest-TestBasicVMVN-30141096-90155892 2025-05-08 02:22:01,291 - INFO - Deleting VN ctest-vn2_metadata-17370505 2025-05-08 02:22:01,330 - DEBUG - VN 4cf1b5ff-9395-4d33-a1bb-7e98de366210 still in use: Unable to complete operation on network 4cf1b5ff-9395-4d33-a1bb-7e98de366210. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e600380c-4ca7-4159-b65a-ab8844917966'] 2025-05-08 02:22:01,331 - WARNING - Deleting VN ctest-vn2_metadata-17370505 failed..Will retry 2025-05-08 02:22:03,437 - DEBUG - Response for deleting network () 2025-05-08 02:22:03,698 - DEBUG - No XMPP flaps were noticed during the test 2025-05-08 02:22:03,698 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:18] 2025-05-08 02:22:03,698 - INFO - -------------------------------------------------------------------------------- 2025-05-08 02:22:03,700 - INFO - ================================================================================ 2025-05-08 02:22:03,700 - INFO - STARTING TEST : test_metadata_service 2025-05-08 02:22:03,700 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2025-05-08 02:22:03,986 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.18': '0'}} with 2025-05-08 02:22:03,986 - INFO - Initial checks done. Running the testcase now 2025-05-08 02:22:03,986 - INFO - 2025-05-08 02:22:03,986 - DEBUG - Requesting: http://10.0.0.27:8082/global-vrouter-configs 2025-05-08 02:22:03,992 - DEBUG - Requesting: http://10.0.0.27:8082/global-vrouter-config/b5c445c6-2108-4012-a2ed-52fd22fcda89 2025-05-08 02:22:04,164 - DEBUG - Response for create_network : {'network': {'id': 'df7c7001-541d-4e9b-820d-b69aa246658f', 'name': 'ctest-vn-24131109', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-30141096', 'ctest-vn-24131109'], 'port_security_enabled': True, 'description': ''}} 2025-05-08 02:22:04,336 - DEBUG - Response for create_subnet : {'subnet': {'id': '5f319dc6-da49-478c-bf7a-b3acdfe75fa0', 'name': '', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'network_id': 'df7c7001-541d-4e9b-820d-b69aa246658f', 'ip_version': 4, 'cidr': '94.132.143.192/26', 'allocation_pools': [{'start': '94.132.143.194', 'end': '94.132.143.254'}], 'gateway_ip': '94.132.143.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '94.132.143.194', 'tags': [], 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a'}} 2025-05-08 02:22:04,354 - INFO - Created VN ctest-vn-24131109 2025-05-08 02:22:04,408 - DEBUG - VN ctest-vn-24131109 UUID is df7c7001-541d-4e9b-820d-b69aa246658f 2025-05-08 02:22:05,432 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3285-1) 2025-05-08 02:22:05,432 - INFO - Waiting for VM ctest-TestBasicVMVN-30141096-33112312 to be up.. 2025-05-08 02:22:05,467 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-05-08 02:22:10,548 - DEBUG - VM is in ACTIVE state now 2025-05-08 02:22:10,548 - INFO - VM name : ctest-TestBasicVMVN-30141096-33112312 2025-05-08 02:22:10,628 - DEBUG - VM ctest-TestBasicVMVN-30141096-33112312 ID is e340adb4-4c2c-4c87-af57-a006a506975e 2025-05-08 02:22:10,628 - DEBUG - VM ctest-TestBasicVMVN-30141096-33112312 launched on Node cn-jenkins-deploy-platform-ansible-os-3285-1 2025-05-08 02:22:10,701 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e340adb4-4c2c-4c87-af57-a006a506975e 2025-05-08 02:22:10,712 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/12809a3f-423c-4df9-b66e-2ad0f249c978 2025-05-08 02:22:13,959 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-05-08 02:22:13,959 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-30141096-33112312 failed! 2025-05-08 02:22:14,021 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-24131109 is 94.132.143.193 and allocation pool is NOT set 2025-05-08 02:22:16,086 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.37 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.460 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.460/1.417/2.374/0.957 ms') 2025-05-08 02:22:16,086 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-30141096-33112312 passed 2025-05-08 02:22:16,237 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:16,237 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-30141096-33112312, IP 94.132.143.195, Port 22 2025-05-08 02:22:16,388 - DEBUG - VM ctest-TestBasicVMVN-30141096-33112312 is ready for SSH connections 2025-05-08 02:22:16,388 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:16,389 - DEBUG - cat /tmp/output.txt 2025-05-08 02:22:17,959 - DEBUG - Hello World. The time is now Wed, 07 May 2025 20:22:14 -0600! 2025-05-08 02:22:17,960 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Wed, 07 May 2025 20:22:14 -0600!'} 2025-05-08 02:22:17,960 - INFO - metadata_script.txt got executed in the vm 2025-05-08 02:22:17,960 - INFO - Deleting VM ctest-TestBasicVMVN-30141096-33112312 2025-05-08 02:22:18,031 - INFO - Deleting VN ctest-vn-24131109 2025-05-08 02:22:18,068 - DEBUG - VN df7c7001-541d-4e9b-820d-b69aa246658f still in use: Unable to complete operation on network df7c7001-541d-4e9b-820d-b69aa246658f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-df43897c-6db1-41e0-9470-44fa6432eac3'] 2025-05-08 02:22:18,068 - WARNING - Deleting VN ctest-vn-24131109 failed..Will retry 2025-05-08 02:22:20,163 - DEBUG - Response for deleting network () 2025-05-08 02:22:20,418 - DEBUG - No XMPP flaps were noticed during the test 2025-05-08 02:22:20,418 - INFO - END TEST : test_metadata_service : PASSED[0:00:17] 2025-05-08 02:22:20,419 - INFO - -------------------------------------------------------------------------------- 2025-05-08 02:22:20,421 - INFO - ================================================================================ 2025-05-08 02:22:20,421 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-05-08 02:22:20,421 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-05-08 02:22:20,706 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.18': '0'}} with 2025-05-08 02:22:20,706 - INFO - Initial checks done. Running the testcase now 2025-05-08 02:22:20,706 - INFO - 2025-05-08 02:22:21,205 - DEBUG - Response for create_network : {'network': {'id': '5ac5af08-fef0-486e-af1f-259ba4e9f6e3', 'name': 'ctest-vn-79418625', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-30141096', 'ctest-vn-79418625'], 'port_security_enabled': True, 'description': ''}} 2025-05-08 02:22:21,363 - DEBUG - Response for create_subnet : {'subnet': {'id': '4cdb0247-d593-4aa6-a062-2626bfcffdc6', 'name': '', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'network_id': '5ac5af08-fef0-486e-af1f-259ba4e9f6e3', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a'}} 2025-05-08 02:22:21,530 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd19716da-b9c3-4820-a1a8-eab6b2bed969', 'name': '', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'network_id': '5ac5af08-fef0-486e-af1f-259ba4e9f6e3', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a'}} 2025-05-08 02:22:21,549 - INFO - Created VN ctest-vn-79418625 2025-05-08 02:22:21,600 - DEBUG - VN ctest-vn-79418625 UUID is 5ac5af08-fef0-486e-af1f-259ba4e9f6e3 2025-05-08 02:22:21,967 - DEBUG - Response for create_port : {'port': {'name': '1dbfbed5-0587-45f0-ba2b-97ed300b958f', 'id': '1dbfbed5-0587-45f0-ba2b-97ed300b958f', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'network_id': '5ac5af08-fef0-486e-af1f-259ba4e9f6e3', 'mac_address': '02:1d:bf:be:d5:05', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '4cdb0247-d593-4aa6-a062-2626bfcffdc6'}], 'security_groups': ['be0ea481-7ad7-460d-a46d-23934520b980'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a'}} 2025-05-08 02:22:22,136 - DEBUG - Response for create_port : {'port': {'name': '5c031aa6-5d2a-420f-9448-3cb5263681ab', 'id': '5c031aa6-5d2a-420f-9448-3cb5263681ab', 'tenant_id': 'f477dfc939f64d8db8e4d3037ff8568a', 'network_id': '5ac5af08-fef0-486e-af1f-259ba4e9f6e3', 'mac_address': '02:5c:03:1a:a6:5d', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'd19716da-b9c3-4820-a1a8-eab6b2bed969'}], 'security_groups': ['be0ea481-7ad7-460d-a46d-23934520b980'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'f477dfc939f64d8db8e4d3037ff8568a'}} 2025-05-08 02:22:22,589 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3285-1) 2025-05-08 02:22:22,949 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3285-1) 2025-05-08 02:22:24,059 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3285-1) 2025-05-08 02:22:24,059 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-05-08 02:22:24,064 - DEBUG - Requesting: http://10.0.0.27:8082/domain/c43aaa1d-bd19-4865-a667-7accb5b556be 2025-05-08 02:22:24,077 - DEBUG - Requesting: http://10.0.0.27:8082/project/f477dfc9-39f6-4d8d-b8e4-d3037ff8568a 2025-05-08 02:22:24,153 - DEBUG - Requesting: http://10.0.0.27:8082/network-ipam/93c99d21-5f5e-4c08-87ca-67c1c9011147 2025-05-08 02:22:24,168 - INFO - Verifications in API Server for IPAM: ctest-ipam-85362670 passed 2025-05-08 02:22:24,175 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-30141096:ctest-ipam-85362670', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-30141096', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10649215560553745416', 'uuid-lslong': '9784747222414463303'}, 'enable': 'true', 'created': '2025-05-08T02:22:20', 'last-modified': '2025-05-08T02:22:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.239651'} 2025-05-08 02:22:24,175 - INFO - Verifications in Control node for IPAM: ctest-ipam-85362670 passed 2025-05-08 02:22:24,175 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-05-08 02:22:24,187 - DEBUG - Requesting: http://10.0.0.27:8082/domain/c43aaa1d-bd19-4865-a667-7accb5b556be 2025-05-08 02:22:24,207 - DEBUG - Requesting: http://10.0.0.27:8082/project/f477dfc9-39f6-4d8d-b8e4-d3037ff8568a 2025-05-08 02:22:24,290 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ac5af08-fef0-486e-af1f-259ba4e9f6e3 2025-05-08 02:22:24,309 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ac5af08-fef0-486e-af1f-259ba4e9f6e3 2025-05-08 02:22:24,321 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a250f086-966b-4da6-8b52-58e173e17bf9 2025-05-08 02:22:24,330 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a250f086-966b-4da6-8b52-58e173e17bf9 2025-05-08 02:22:24,338 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/726ae4a5-558c-4b18-a867-ac9ae8b9ea2d 2025-05-08 02:22:24,346 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-05-08 02:22:24,346 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ac5af08-fef0-486e-af1f-259ba4e9f6e3 2025-05-08 02:22:24,358 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a250f086-966b-4da6-8b52-58e173e17bf9 2025-05-08 02:22:24,376 - INFO - Verified VN network id 9 for VN 5ac5af08-fef0-486e-af1f-259ba4e9f6e3 2025-05-08 02:22:24,376 - INFO - Verifications in API Server for VN ctest-vn-79418625 passed 2025-05-08 02:22:24,376 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ac5af08-fef0-486e-af1f-259ba4e9f6e3 2025-05-08 02:22:24,388 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a250f086-966b-4da6-8b52-58e173e17bf9 2025-05-08 02:22:24,397 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a250f086-966b-4da6-8b52-58e173e17bf9 2025-05-08 02:22:24,407 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/726ae4a5-558c-4b18-a867-ac9ae8b9ea2d 2025-05-08 02:22:24,423 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-30141096', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6540826486997272686', 'uuid-lslong': '12618846031332374243'}, 'enable': 'true', 'created': '2025-05-08T02:22:21', 'last-modified': '2025-05-08T02:22:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.925231'} 2025-05-08 02:22:24,438 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-05-08 02:22:24,438 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-79418625 passed 2025-05-08 02:22:24,438 - DEBUG - ====Verifying policy data for ctest-vn-79418625 in API_Server ====== 2025-05-08 02:22:24,438 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-05-08 02:22:24,447 - DEBUG - Requesting: http://10.0.0.27:8082/domain/c43aaa1d-bd19-4865-a667-7accb5b556be 2025-05-08 02:22:24,463 - DEBUG - Requesting: http://10.0.0.27:8082/project/f477dfc9-39f6-4d8d-b8e4-d3037ff8568a 2025-05-08 02:22:24,555 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ac5af08-fef0-486e-af1f-259ba4e9f6e3 2025-05-08 02:22:24,570 - DEBUG - =>VN ctest-vn-79418625 has no policy to be verified 2025-05-08 02:22:24,570 - DEBUG - Verifying the vn in opserver 2025-05-08 02:22:24,571 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625 virtual network link through opserver 10.0.0.27 2025-05-08 02:22:24,571 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-05-08 02:22:24,871 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-05-08 02:22:24,951 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625?flat'} 2025-05-08 02:22:24,951 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625 is found in opserver 2025-05-08 02:22:24,958 - DEBUG - VRF ids for VN ctest-vn-79418625: {'10.0.0.27': '2'} 2025-05-08 02:22:24,958 - INFO - Waiting for VM ctest-TestBasicVMVN-30141096-44758437 to be up.. 2025-05-08 02:22:25,082 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-05-08 02:22:30,173 - DEBUG - VM is in ACTIVE state now 2025-05-08 02:22:30,173 - INFO - VM name : ctest-TestBasicVMVN-30141096-44758437 2025-05-08 02:22:30,269 - DEBUG - VM ctest-TestBasicVMVN-30141096-44758437 ID is ebf65036-c25b-4101-8c4b-2fbdc6723ef1 2025-05-08 02:22:30,269 - DEBUG - VM ctest-TestBasicVMVN-30141096-44758437 launched on Node cn-jenkins-deploy-platform-ansible-os-3285-1 2025-05-08 02:22:30,354 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ebf65036-c25b-4101-8c4b-2fbdc6723ef1 2025-05-08 02:22:30,365 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/1dbfbed5-0587-45f0-ba2b-97ed300b958f 2025-05-08 02:22:33,640 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-05-08 02:22:33,641 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-30141096-44758437 failed! 2025-05-08 02:22:33,701 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625 is 31.1.1.1 and allocation pool is NOT set 2025-05-08 02:22:33,701 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625 is 31.1.2.1 and allocation pool is NOT set 2025-05-08 02:22:35,758 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.51 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.410 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.410/1.458/2.506/1.048 ms') 2025-05-08 02:22:35,758 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-30141096-44758437 passed 2025-05-08 02:22:35,908 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:35,909 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-30141096-44758437, IP 31.1.1.4, Port 22 2025-05-08 02:22:36,060 - DEBUG - VM ctest-TestBasicVMVN-30141096-44758437 is ready for SSH connections 2025-05-08 02:22:36,060 - INFO - Waiting for VM ctest-TestBasicVMVN-30141096-21821838 to be up.. 2025-05-08 02:22:36,141 - DEBUG - VM is in ACTIVE state now 2025-05-08 02:22:36,141 - INFO - VM name : ctest-TestBasicVMVN-30141096-21821838 2025-05-08 02:22:36,221 - DEBUG - VM ctest-TestBasicVMVN-30141096-21821838 ID is 46de5cc0-1c92-4e8f-9e75-7a34381c6822 2025-05-08 02:22:36,221 - DEBUG - VM ctest-TestBasicVMVN-30141096-21821838 launched on Node cn-jenkins-deploy-platform-ansible-os-3285-1 2025-05-08 02:22:36,303 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/46de5cc0-1c92-4e8f-9e75-7a34381c6822 2025-05-08 02:22:36,313 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/5c031aa6-5d2a-420f-9448-3cb5263681ab 2025-05-08 02:22:37,561 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.429 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.429/1.647/2.865/1.218 ms') 2025-05-08 02:22:37,561 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-30141096-21821838 passed 2025-05-08 02:22:37,708 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:37,709 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-30141096-21821838, IP 31.1.2.4, Port 22 2025-05-08 02:22:37,860 - DEBUG - VM ctest-TestBasicVMVN-30141096-21821838 is ready for SSH connections 2025-05-08 02:22:37,861 - INFO - Waiting for VM ctest-TestBasicVMVN-30141096-08398660 to be up.. 2025-05-08 02:22:37,954 - DEBUG - VM is in ACTIVE state now 2025-05-08 02:22:37,954 - INFO - VM name : ctest-TestBasicVMVN-30141096-08398660 2025-05-08 02:22:38,039 - DEBUG - VM ctest-TestBasicVMVN-30141096-08398660 ID is 833faaa3-6ff5-4beb-8d13-eb9bbdb69395 2025-05-08 02:22:38,040 - DEBUG - VM ctest-TestBasicVMVN-30141096-08398660 launched on Node cn-jenkins-deploy-platform-ansible-os-3285-1 2025-05-08 02:22:38,123 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/833faaa3-6ff5-4beb-8d13-eb9bbdb69395 2025-05-08 02:22:38,135 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/a0400a31-1a5b-40af-8c34-19f2a3fc6512 2025-05-08 02:22:39,375 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.81 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.426 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.426/1.616/2.807/1.190 ms') 2025-05-08 02:22:39,375 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-30141096-08398660 passed 2025-05-08 02:22:39,529 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:39,529 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-30141096-08398660, IP 31.1.1.3, Port 22 2025-05-08 02:22:39,684 - DEBUG - VM ctest-TestBasicVMVN-30141096-08398660 is ready for SSH connections 2025-05-08 02:22:39,684 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:39,684 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:39,685 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-05-08 02:22:43,620 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.360 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.921 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.043 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.921/1.774/3.360 ms 2025-05-08 02:22:43,620 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-30141096-44758437 passed 2025-05-08 02:22:43,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:43,621 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:43,621 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-05-08 02:22:47,220 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=2.586 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.887 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.914 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.887/1.462/2.586 ms 2025-05-08 02:22:47,220 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-30141096-21821838 passed 2025-05-08 02:22:47,220 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:47,220 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:47,221 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-05-08 02:22:47,221 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:47,221 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-05-08 02:22:47,390 - DEBUG - None 2025-05-08 02:22:47,390 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:47,390 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-05-08 02:22:47,597 - DEBUG - None 2025-05-08 02:22:47,597 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:47,597 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-05-08 02:22:48,188 - DEBUG - None 2025-05-08 02:22:48,189 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:48,189 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-05-08 02:22:50,421 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.298 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=7.072 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.469 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.731 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.610 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.469/2.436/7.072 ms 2025-05-08 02:22:50,421 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:50,422 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-05-08 02:22:52,664 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.981 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.259 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.403 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.759 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.421 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.495 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.519 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.519/2.262/4.403 ms 2025-05-08 02:22:52,664 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-05-08 02:22:52,664 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-05-08 02:22:54,905 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.612 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.446 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.156 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.436 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.750 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.599 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.391 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.391/1.912/4.156 ms 2025-05-08 02:22:54,905 - INFO - Deleting VM ctest-TestBasicVMVN-30141096-08398660 2025-05-08 02:22:54,984 - INFO - Detaching port 5c031aa6-5d2a-420f-9448-3cb5263681ab from VM ctest-TestBasicVMVN-30141096-21821838 2025-05-08 02:22:55,037 - INFO - Deleting VM ctest-TestBasicVMVN-30141096-21821838 2025-05-08 02:22:55,119 - INFO - Detaching port 1dbfbed5-0587-45f0-ba2b-97ed300b958f from VM ctest-TestBasicVMVN-30141096-44758437 2025-05-08 02:22:55,155 - INFO - Deleting VM ctest-TestBasicVMVN-30141096-44758437 2025-05-08 02:22:55,253 - INFO - Deleting VN ctest-vn-79418625 2025-05-08 02:22:55,473 - DEBUG - Response for delete_port : () 2025-05-08 02:22:55,778 - DEBUG - Response for delete_port : () 2025-05-08 02:22:55,969 - DEBUG - Response for deleting network () 2025-05-08 02:22:55,969 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a250f086-966b-4da6-8b52-58e173e17bf9 2025-05-08 02:22:55,975 - DEBUG - Response Code: 404 2025-05-08 02:22:55,975 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-05-08 02:22:55,981 - DEBUG - Requesting: http://10.0.0.27:8082/domain/c43aaa1d-bd19-4865-a667-7accb5b556be 2025-05-08 02:22:56,035 - DEBUG - Requesting: http://10.0.0.27:8082/project/f477dfc9-39f6-4d8d-b8e4-d3037ff8568a 2025-05-08 02:22:56,111 - INFO - Validated that VN ctest-vn-79418625 is not found in API Server 2025-05-08 02:22:56,122 - DEBUG - VN ctest-vn-79418625 is not present in Agent 10.0.0.27 2025-05-08 02:22:56,122 - INFO - Validated that VN ctest-vn-79418625 is not in any agent 2025-05-08 02:22:56,128 - DEBUG - VRF 2 is not seen in agent 10.0.0.27 2025-05-08 02:22:56,133 - DEBUG - Vrouter 10.0.0.27 does not have vrf 2 for VN ctest-vn-79418625 2025-05-08 02:22:56,133 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-30141096:ctest-vn-79418625 2025-05-08 02:22:56,143 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-79418625 info 2025-05-08 02:22:56,216 - INFO - IPAM: ctest-ipam-85362670 is not found in API Server 2025-05-08 02:22:56,226 - INFO - IPAM:ctest-ipam-85362670 is not found in control node 2025-05-08 02:22:56,478 - DEBUG - No XMPP flaps were noticed during the test 2025-05-08 02:22:56,478 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:36] 2025-05-08 02:22:56,478 - INFO - -------------------------------------------------------------------------------- 2025-05-08 02:22:57,149 - INFO - Deleted project: ctest-TestBasicVMVN-30141096, ID : f477dfc9-39f6-4d8d-b8e4-d3037ff8568a