Using Meta Quest3 in NVIDIA Omniverse

By popular demand here’s a a repost from my article on Medium with a short description on how to get started with?Meta Quest3?VR headset in?NVIDIA Omniverse?on Windows.

We have at least two options to enjoy raytraced VR in NVIDIA Omniverse on our Meta Quest 3 — either by using Meta’s Air Link with the free Oculus Desktop App or by using the Virtual Desktop app with its own VDXR OpenXR Runtime which is available from the Meta Store.

Both do the job, the Oculus Desktop App is free but takes almost 3GBs for installation and requires registration with Meta, Virtual Desktop App costs about 20$ but has a much smaller installation footprint and is said to be more performant — this article describes both options, so choose what you like best.

Option A: Oculus Desktop App (Air Link)

Install Oculus Desktop App

Follow the instructions on the meta support article to install the oculus desktop application.

Connect Meta Quest to your PC over Wi-Fi with Air Link

Make sure to set the Oculus OpenXR Runtime to “Active” and to allow “Unknown Sources” (Unbekannte Quellen) by activating the corresponding switch in the settings dialog (Einstellungen).

Thank you @brad (dreadful7) from Omniverse Discord Channel for pointing me to Air Link and also to Ashley Goldstein for providing the screenshot in english.

Option B: Virtual Desktop App (VDXR)

The best performance seems to be achievable using the “Virtual Desktop” app with its?builtin VDXR OpenXR Runtime?.

Install Virtual Desktop App on Quest3

Get it from?Virtual Desktop on Meta Quest | Quest VR games | Meta Store?& install it (costs ~20$)

Install Virtual Desktop on Desktop

get it from?Home | Virtual Desktop (vrdesktop.net)?, install, open settings and set OpenXR Runtime to ‘VDXR’ in ‘OPTIONS’, make also sure to set the oculus username in ‘ACCOUNTS’ to the name you’ve set in the step before.

Make sure that the Virtual Desktop App is running on the Quest3 device and VR mode has been activated on desktop with “Shift-Windows-D”.

Activate VR Rendering in USD Composer

Now we can activate VR rendering with Window->Rendering->VR

In the newly openened “VR” tab we can click on “start VR” and we’re good to go.

Have fun :-D

Fix for Option B: Activate & patch Oculus Assets Extension in USD Composer

With the default setup VIVE Controllers are rendered instead of our Quest controllers, in oder to fix that we have to locate the extension ‘omni.kit.xr.ui.config.metaquest’ in the Extensions window and activate it.

(Thank you Jen from NVIDIA for pointing that out)

At the time of writing there are only quest2 assets built in but the controllers look comparable.

In order to make the extension aware of the quest3 with virtual desktop I had to patch the recognition code, this might be fixed in the future.

Here are the steps to do that :

Open the extension code with VS Code by clicking the VS-Code icon.

Locate the file ‘xr_extension.py’ and change the code to check for “quest” instead of “oculus”.

Now the correct controllers should be displayed.

?