Immersive VisualAudioDesign: Spectral Editing in VR

Authors. Lars Engeln, Natalie Hube, Rainer Groh

Venue. Audio Mostly (2018) Full Paper

Type. Full Paper

Materials. DOI PDF

Abstract. VisualAudioDesign (VAD) is an attempt to design audio in a visual way. The frequency-domain visualized as a spectrogram construed as pixel data can be manipulated with image filters. Thereby, an approach is described to get away from direct DSP parameter manipulation to a more comprehensible sound design. Virtual Reality (VR) offers immersive insights into data and embodied interaction in the virtual environment. VAD and VR combined enrich spectral editing with a natural work-flow. Therefore, a design paper prototype for interaction with audio data in an virtual environment was used and examined.

@inproceedings{10.1145/3243274.3243279,
    title        = {Immersive VisualAudioDesign: Spectral Editing in VR},
    author       = {Engeln, Lars and Hube, Natalie and Groh, Rainer},
    year         = {2018},
    booktitle    = {Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion},
    publisher    = {Association for Computing Machinery},
    series       = {AM'18},
    doi          = {10.1145/3243274.3243279},
    url          = {https://doi.org/10.1145/3243274.3243279},
    abstract     = {VisualAudioDesign (VAD) is an attempt to design audio in a visual way. The frequency-domain visualized as a spectrogram construed as pixel data can be manipulated with image filters. Thereby, an approach is described to get away from direct DSP parameter manipulation to a more comprehensible sound design. Virtual Reality (VR) offers immersive insights into data and embodied interaction in the virtual environment. VAD and VR combined enrich spectral editing with a natural work-flow. Therefore, a design paper prototype for interaction with audio data in an virtual environment was used and examined.},
    articleno    = {38},
    numpages     = {4},
    keywords     = {Immersive Analytics, VisualAudioDesign, Virtual Reality, Paper Prototype, Spectral Editing, Immersive Audio}
}