How To Best Handle Worldspace UI For VR

[TKTSWalker]

I'm working on a Stride3D project and would like to render a number of UIs onto the screen for VR. However, the setup of a render texture for each page gets extremely taxing. Is there any way to do so in a better way?

I wanted to use the UI object but that does not seem to work unfortunately.

I would be fine with using sprites and the like to create a UI system template, turn it into a prefab and open source it but i'm on a time budget to have a project completed by March.

[yuechen-li-dev]

This should be moved to discussions.

I would recommend using SkiaSharp that Stride includes for rendering UI like elements. However, Skia doesn't work in DX11 and only works either on CPU or Vulkan/DX12 GPU. I've made some tests where I've gotten some good results for render Skia elements in 3D space, however, rendering is the easy part, focus is the real issue with UI, as the game has to know that you clicked on the object and not something else.

If you're interested, I'll upload my research from this failed/stalled test project PoC to github for you guys to play with.

[Eideren]

We do have support for worldspace UI:

Set Fullscreen and Billboard off on the UIComponent