A Binaural Spatialization System for 3D Audio Immersive Communication in Virtual Networked Environments

Davide Andrea Mauro 1, 2
1 S2A - Signal, Statistique et Apprentissage
LTCI - Laboratoire Traitement et Communication de l'Information
Abstract :

Realistic 3D audio can greatly enhance the sense of presence in a virtual environment. This paper discusses an application 3D audio by the mean of Binaural Spatialization within a larger 3D immersive system, with state of art capturing and rendering modules for visual data. We introduce a framework for capturing, transmitting and rendering 3D audio in such an environment. The framework allows realtime rendering of audio based on the positions of objects in the scene, including animated avatars and on the fly reconstructed humans. We provide a general overview of the application, how audio is integrated in the whole system, and how it can exploit the positions of the objects and the knowledge of room geometry already to render realistic reverberations using HRTFs (head related transfer functions). The network streaming modules used to achieve lip-synchronization, high-quality audio frame reception, are taken into account highlighting how large computational and networking challenges can be addressed efficiently. The proposed architecture as well as the actual implementation represent a first step in adequate networking support for Binaural 3D Audio, useful for tele-presence.

Complete list of metadatas

https://hal.telecom-paristech.fr/hal-02286760
Contributor : Telecomparis Hal <>
Submitted on : Friday, September 13, 2019 - 4:09:18 PM
Last modification on : Thursday, October 17, 2019 - 12:37:02 PM

Identifiers

  • HAL Id : hal-02286760, version 1

Collections

Citation

Davide Andrea Mauro. A Binaural Spatialization System for 3D Audio Immersive Communication in Virtual Networked Environments. EAA Joint Symposium on Auralization and Ambisonics 2014, Apr 2014, Berlin, Germany. ⟨hal-02286760⟩

Share

Metrics

Record views

4