Oku3D Video Player - Free Real-Time AI 3D Video Player (Windows App + Browser)

3D Apps
1

Hello,

some of you may remember my Browser-Based 3D SBS Video Player for VR180/VR360 Content that I shared here a while ago. I’ve now turned it into a proper standalone app: Oku3D.

It still plays all native 3D formats (SBS, Top-Bottom, VR180, VR360), but the big addition is real-time AI 2D-to-3D conversion - similar to the LeiaPlayer on the LumePad, but for desktop. Open any video, hit play, watch it in 3D. Works with screen capture too (Netflix, YouTube, etc.).

My motivation: I have an AMD GPU, and pretty much every other tool that does this requires NVIDIA (CUDA), costs money, or involves a complicated setup. Oku3D uses WebGPU instead, so it runs on NVIDIA, AMD, and Intel GPUs - no vendor lock-in, no special drivers.

Available as a free Windows app (installer + portable) and as a browser version (Chrome/Edge).

I’ve just released v1.0.0, and I’d love to hear your feedback, especially from those of you with glasses-free displays like the Odyssey 3D or SpatialLabs.

Best regards,
Jens

2 Likes
2

Hallo Jens, könntest du bitte auch eiine Androidd Version als APK-Datei entwickeln, die flüssig auf dem Lume Pad 2 3D läuft?

Vielen Dank!

Dirk

–

Hello Jens,

could you please also develop an Android Version as APK file to run smoothly on the lume pad 2 ?

Thank you in advance.

Dirk

3

Hallo Dirk,

was genau ist denn dein Use-Case? Der LeiaPlayer kann doch schon ziemlich gut 2D-Material in 3D umwandeln.

Viele Grüße,
Jens

4

Du hast in deinem Blog geschrieben, dass man die Browserversion von Oku3D auf dem Lumepad 2 3D verwendenn soll. Welchen Browser empfiehlst du? Ich werde es einmall ausprobieren.

Ich habe verschiedene 3D MKV-Dateien (H264/H265) mit mehreren Tonspuren. Im vorinstallierten Leia Player ist Wiedergabe von mehreren Tonspuren und von Untertiteln leider eingeschränkt. Auch bei verschiedenen 3D Formaten. Man kann man nicht in verschiedenen 3D Modi wechseln (SBS/HSBS/FSBS).

Das Red Magic 3D Tablet hat zur Zeit im Gegensatz zum Lumepad 2 3D wohl die beste Performance und man kann fast überall im Gerät zwischen 2D und 3D wechseln. Die Preise sind aber 2-3 Mal so hoch (1000-1200 Euro).

Wenn du magst können wir uns darüber gern mal in WhatsApp austauschen. Schreib mich hier einfach privat an.

5

Awesome, finally some 3D conversion with proper AMD support, running on real time, that said I would love to see a conversion with maximium quality profile, since it tends to be too slow to real time conversion.

And with conversion, would be possible export to full side-by-side videos, in current version we have only half sbs support since it the display convert from the split screen content, or, maybe if you detect the LeiaSR monitor and directly apply the weaver will be awesome.

Thanks for this awesome tool.

6

by the way, on desktop version I think will be better add more video container support, for example usually high quality videos are all MKVs, and on desktop you can run some ffmpeg or what you need.

7

Hello @Pocketgenga and @marcussacana ,

I think there might be some confusion - I haven’t mentioned using Oku3D’s browser version on the LumePad 2 anywhere. You might be thinking of my Stereo Photo Optimizer thread (native Android APK), or my older browser-based SBS player thread - in that one I actually mentioned buying a Samsung monitor as a replacement for a LumePad 2, not as a target device for the browser version. The browser version hasn’t been specifically tested on the LumePad 2 yet - that’s on my to-do list, but hasn’t been a priority since the LumePad 2 already has the Leia Player for 3D playback.

Oku3D is focused on real-time playback. For offline conversion at maximum quality, I have a separate project for exactly that: Video Stereo Converter on GitHub - the trade-off being that it takes significantly longer to process.

I’m not sure I fully understand what you mean here. The Leia display driver already handles the lenticular interlacing automatically when switching to fullscreen - so what exactly do you mean by “apply the weaver”?

Extended container support is actually already on the roadmap! I’m planning to add MKV, AVI, FLV, TS, and VOB support, using FFmpeg. This would also unlock audio track selection (multiple language tracks) and eventually embedded subtitle support.

In general, Oku3D is still in early development - there’s a long list of features I’m planning to add over the coming weeks and months, so stay tuned! Thanks for your feedback and ideas - keep them coming!

Best regards,
Jens

8

Hi! The Leia-based 3D display works by tracking your head/eyes and adjusting the pixels for each eye accordingly. This is handled by software running on Windows, not by the monitor itself.

This processm, head tracking combined with pixel shifting for each lens, is called “weaving” in the LeiaSDK. You can find more details in the documentation (it’s free, but requires an account):

The workflow is basically as follows:

  1. Use the Leia Runtime to enable the 3D lens.
  2. Render a full side-by-side buffer.
  3. Send this buffer to the Leia Runtime.
  4. The runtime tracks the user’s head and adjusts the pixels accordingly.
  5. It returns a new buffer with the corrected pixel mapping.
  6. Display this buffer in fullscreen.

At step 6, as long as the 3D lens is enabled, the 3D effect will be visible.

Regarding the converter, I’ll take a look, but it seems that Oku3D has a much better and more user-friendly UI. I hope you’ll consider supporting it in the future anyway.

9

Hello @marcussacana

Now I think I understand what you mean. Instead of half SBS, I should output full SBS so the Leia Runtime can directly use it as input for the weaving process.

For my Odyssey 3D the benefit might be limited though: the display requires a 4K resolution (3840x2160) to switch into 3D mode, but the effective 3D resolution is only 3840x1080. That means the image is already full SBS in width, and even twice the height that the display actually needs. Or is that different for other Leia-based displays?

One thing I do see as a potential benefit: if the app could send the 3840x1080 image directly to the SDK, I don’t need to generate a full 4K image, which could save some processing overhead.

Thanks for the hint, I’ll put that on my to-do list!

Best regards,
Jens

10

Hi, you’re right about the resolution, I was referring more to lower-resolution content, which can have issues due to aspect ratio, may be not a problem since your focus is screen conversion.

That said, the main advantage of using LeiaSR is performance. If you let Odyssey Hub handle the conversion, you may end up converting the image twice. For example:

YouTube video → Oku3D captures the screen → converts to SBS → displays on screen → Odyssey3D captures the screen → Leia Runtime applies the weaving → displays on screen

If you use the Leia Runtime directly, the execution flow looks like this:

YouTube video → Oku3D captures the screen → converts to SBS → Leia Runtime applies the weaving → displays on screen

In this case, both latency and performance overhead are significantly reduced.

11

Hello,

I’ve just released version 1.3.0 with a lot of new features:

I’ve also already downloaded the LeiaSR SDK and started preparing for it. For example, the new subtitle rendering was designed with LeiaSR integration in mind. But it still requires significant refactoring of the UI components, so full integration will take a while.

Best regards,
Jens

1 Like
12

Hello and thank you for this fabulous software. I currently have many 180 SBS videos of my recently deceased parents that I would like to view on my PC. I have the Insta360 EVO camera, which converts between 180-degree SBS and 360. I currently have an Asus 27" ROG Swift PG278QR G-Sync 165Hz Nvidia 3D Vision monitor with active glasses. There is no Windows 10 PC player that can play them; could yours one day?

13

Hello Carole,

Thank you for the kind words, and I’m sorry for your loss - those recordings sound very precious.

Unfortunately, I won’t be able to add NVIDIA 3D Vision support. NVIDIA officially ended 3D Vision driver support back in April 2019. I also don’t personally own a 3D Vision monitor, an NVIDIA card, or the IR emitter, so I’d have nothing to develop or test against - and given that the installed base is shrinking rather than growing, the reverse-engineering effort is hard to justify.

Oku3D already handles 180° SBS/VR180/VR360 content and projects it onto a virtual sphere you can pan around with your mouse, either in 2D or using anaglyph 3D output, if a Leia-compatible display isn’t an option for you.

Best regards,
Jens

14

Thank you so much for replying! I have the Leia Lumepad 2 which can view a 180-degree SBS image, but it’s incomparable to a 27-inch screen. So I was hoping your software would help. Thanks anyway. What you’re doing is fantastic!!