Composing space in the space: An Augmented and Virtual Reality sound spatialization system

Giovanni Santini*

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

2 Citations (Scopus)


This paper describes a tool for gesture-based control of sound spatialization in Augmented and Virtual Reality (AR and VR). While the increased precision and availability of sensors of any kind has made possible, in the last twenty years, the development of a considerable number of interfaces for sound spatialization control through gesture, their integration with VR and AR has not been fully explored yet. Such technologies provide an unprecedented level of interaction, immersivity and ease of use, by letting the user visualize and modify position, trajectory and behaviour of sound sources in 3D space. Like VR/AR painting programs, the application allows to draw lines that have the function of 3D automations for spatial motion. The system also stores information about movement speed and directionality of the sound source. Additionally, other parameters can be controlled from a virtual menu. The possibility to alternate AR and VR allows to switch between different environment (the actual space where the system is located or a virtual one). Virtual places can also be connected to different room parameters inside the spatialization algorithm.

Original languageEnglish
Title of host publicationProceedings of the 16th Sound and Music Computing Conference, SMC 2019
EditorsIsabel Barbancho, Lorenzo J. Tardon, Alberto Peinado, Ana M. Barbancho
Number of pages5
ISBN (Electronic)9788409085187
Publication statusPublished - 20 May 2019
Externally publishedYes
Event16th Sound and Music Computing Conference, SMC 2019 - Malaga, Spain
Duration: 28 May 201931 May 2019

Publication series

NameProceedings of the Sound and Music Computing Conferences
ISSN (Print)2518-3672


Conference16th Sound and Music Computing Conference, SMC 2019


Dive into the research topics of 'Composing space in the space: An Augmented and Virtual Reality sound spatialization system'. Together they form a unique fingerprint.

Cite this