3D AUDIO MIXING WORKFLOW WITH DEARVR SPATIAL CONNECT

Immersive audio formats are offering us many new creative opportunities and tools as they simultaneously become more and more realistic. However, when mixing audio for multi-channel loudspeaker setups with height channels, traditional workflows using mixing desks with pan pots and joysticks often hinder us from having an intuitive production process. In this article, we want to show you how dearVR SPATIAL CONNECT helps you overcome these technological barriers by enabling you to intuitively mix audio for immersive linear and interactive audio formats.

OVERVIEW

In its essence, dearVR SPATIAL CONNECT is a standalone application which enables you to directly control your DAW in a VR environment. Whether you want to deliver a binaural, an Ambisonics or a 7.1.4 mix, you can now see and control your audio tracks within a VR headset. With dearVR SPATIAL CONNECT and a direct visual representation of your audio session, your workflow will speed up and you will feel more empowered to work creatively within immersive audio formats.

It’s this simple: use the VR controllers in your hand to control the spatializer plugins dearVR PROdearVR AMBI MICRO, or the Nuendo VST MultiPanner. That way you can easily position audio objects in a 360° space and even draw complex automation lines. The virtual faders and the meter bridge allow smooth and individual levelling whilethe direct access to your DAW controls, like solo and mute, as well as transport and marker functions, enable a faster workflow.

dearVR SPATIAL CONNECT is a standalone application housing the VR control interface. Here, you can insert your 2D or 360° video or even decide to work without any video and use a virtual studio environment. dearVR SPATIAL CONNECT is designed to run alongside your DAW session and supports Steinberg’s Nuendo and Reaper.

MACHINE SETUP

dearVR SPATIAL CONNECT canalsorun on the same Windows machine which hosts your DAW.

Alternately, the application can be installed on a separate VR-ready computer. In this kind of two-machine setup, the DAW runs either on a Windows or a Mac machine and both computers are connected by a common network.

HEADTRACKING

Using a VR headset offers immediate headtracking. Headtracking enables us to integrate the listener’s movements into binaural rendering in real-time. This results in a steady soundfield, which reflects a real world acoustic environment and contains enhanced externalization.

dearVR SPATIAL CONNECT supplies the DAW session with the head-tracking data derived from the VR headset. When you turn your head 180°, sound sources previously located in the front will now be perceived from behind. Headtracking is available for DAW tracks that hold a dearVR PRO or dearVR AMBI MICRO instance or for the NUENDO VST MultiPanner.

VIEW MODES

In addition to the visual representation in the VR headset, dearVR SPATIAL CONNECT can be operated on any common display in 3 different view modes:

VR-Mode: This modepresents the same field of view which isalsoshown in the connected VR hardware.

3D-Mode: In this mode,a cropped field of view of the 360° videoistranslated to a 2D screen. It enables you to change the field of view to the desired angle by clicking and dragging the mouse.

2D-Mode: This mode displays the 360°-video in its equirectangular view, essentially squashing the whole 360° field of view into a 2D representation. The 2D view enables you to use dearVR SPATIAL CONNECT even without a VR-headset. In this mode,you can use your mouse to directly position the audio sources without any connected VR goggles connected to dearVR SPATIAL CONNECT.

As already mentioned, you can also use dearVR SPATIAL CONNECT alongside 2D video content. This view-mode comes in handy if you want to judge your 3D-audio mix next to a 2D movie while still taking advantage of the whole 360° sphere for your audio mixing. You can also use dearVR SPATIAL CONNECT without any video content, thus simulating a virtual environment like a cinema or a high-end studio.

REPRESENTATION

In dearVR SPATIAL CONNECT you can see both spatialized 3D dearVR sources as well as non-dearVR sources of your DAW session. Both sources are represented by visible objects, which can be grabbed, repositioned, and automated.

dearVR Sources

dearVR sources contain an instance of dearVR PRO in their Fx-slot. Therefore, the position in the 3D space will automatically be translated into the dearVR PRO rendering engine.

Non-dearVR sources

Non-dearVR sources contain no instance of dearVR PRO in their Fx-slots. Thus, the position in a 3D space will automatically be translated into the stereo panning of the audio track.

VR MODULES

When wearing the VR headset, different modules are available as interactive mixing panels. These modules provide you with the enhanced functionality of the VR-mixing workflow. You can individually position all these modules by simply grabbing and dragging them to your desired position.

Transport module

The transport module is the main module of dearVR SPATIAL CONNECT and is always visible in the VR space. It gives you the essential transport functions known from your DAW. From here, you can also activate all the other VR modules.

Minimap

As the mixing session grows in complexity, you might want to get yourself an overview of all our audio sources. This is where the Minimap comes into play. The Minimap is an interactive miniature view of the whole mixing session, which reflects the surrounding VR space like the 360° video, audio sources and the automation in real time.

Source List

The source list provides an overview of all the important data of your session within VR. It is divided into DAW-related parameters (left side) and 3D audio AAX/VST/AU spatializer plugin dearVR PRO (right side). You can also access basic DAW channel functions like solo and mute status, the level of each audio source, and the automation mode. In addition, within this view, you can control the most used features of dearVR PRO like Azimuth, elevation, distance as well as the selected room preset.

Meter bridge

The meter bridge brings the traditional mixing console to the VR world. You can directly monitor and level your audio sources from here. In addition, you can change the levels by selecting the channels and moving your hand up or down.

Controllers

dearVR SPATIAL CONNECT can be controlled by the HTC VIVE, Oculus Rift and Rift S. The controllers can switch into different modes, each of which changes the functionality of the controller. Based on the selected function, you can control the position of an object, change its level, solo and mute objects, and change the individual automation status.

To sum things up, we showed you different ways to integrate dearVR SPATIAL CONNECT into your mixing environment. dearVR SPATIAL CONNECT enables you to directly control the 3D audio spatializer dearVR PRO, dearVR AMBI MICRO as well as the most important DAW features. In addition to that, it enables you to change the position of audio sources, draw automation data, insert markers, and access the transport control while staying in VR. With dearVR SPATIAL CONNECT you can also speed up your immersive audio production workflow and achieve accurate and creative results.

Kai Detlefsen
Kai combines a creative approach with profound knowledge about international business processes having two bachelor’s degrees in Music and International Management. As a researcher and author, Kai publishes articles about developments in the music industry induced by the digitalization and the constant change in the level playing field. As a musician and mixing engineer, he can be found at concert venues and in recording studios. At Dear Reality, Kai works as a Marketing Manager and strives to make the 3D audio world accessible for everyone.

Also in Overview

Why Spatial Audio Production is Inescapable in 2024
Why Spatial Audio Production is Inescapable in 2024

In recent years, the way we perceive audio has undergone a dramatic transformation. Immersive and Spatial Audio are no longer just buzzwords; they have become essential technologies elevating our auditory experiences to new heights. Production tools such as those offered by Dear Reality, including dearVR PRO 2, dearVR MONITOR, and dearVR SPATIAL CONNECT, have firmly established themselves in the daily workflow of audio producers. This blog article explores why, in 2024, creators cannot avoid embracing these audiovisual innovations.

Read More

dearVR PRO 2: The Perfect Choice for Crafting Immersive Reverbs in Spatial Audio Production
dearVR PRO 2: The Perfect Choice for Crafting Immersive Reverbs in Spatial Audio Production

As of 2024, spatial audio formats dominate the field of professional audio production, a trend that shows no signs of waning. Not only will Apple's Vision Pro accelerate its proliferation, but developments like AMBEO 2-Channel Spatial Audio show that spatial audio formats can seamlessly establish themselves as standard formats in AAA media production and that spatial audio is finding its way into "usually" stereo contexts.

Read More

dearVR PRO 2: Elevating Your Audio Mixing to New Heights
dearVR PRO 2: Elevating Your Audio Mixing to New Heights

If you're serious about audio mixing and ready to explore the realms of spatial audio, look no further than dearVR PRO 2. This cutting-edge plugin from Dear Reality represents the pinnacle of evolution in audio mixing technology, designed to take your audio productions to unprecedented levels of depth and realism. 

Read More