# real-time monocular depth estimation

**URL:** https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704
**Category:** Unity SDK
**Created:** [April 29, 2023, 5:14pm UTC](https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704 "2023-04-29T17:14:31Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![acidys230](https://avatars.discourse-cdn.com/v4/letter/a/c68b51/32.png) [@acidys230](https://forums.leialoft.com/u/acidys230)
#### Post date: [April 29, 2023, 5:14pm UTC](https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704/1 "2023-04-29T17:14:31Z")

</div>

I’m making a monocular depth estimation app for autostereoscopic viewing like this. However, when I built this app for LumePad, the load was too high and it stopped after only one frame. You guys have a very nice technique for local depth estimation and consistent depth on Android with LriaPlayer and LeiaTube. I want to incorporate your real-time depth estimation technology into my app. can it? If not, I would like information about your depth estimation model. Is the model published on OSS? Is it your own research model?

---

<div class="post-metadata">

### Author: ![Marlon](https://sea1.discourse-cdn.com/flex015/user_avatar/forums.leialoft.com/marlon/32/830_2.png) [@Marlon](https://forums.leialoft.com/u/Marlon)
#### Post date: [April 29, 2023, 6:35pm UTC](https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704/2 "2023-04-29T18:35:34Z")

</div>

Hey @acidys230! Thanks for coming by the forum! We’ve passed along your questions to the team. What type of app are you building? Cheers, Marlon - Community Manager

---

<div class="post-metadata">

### Author: ![cybereality](https://sea1.discourse-cdn.com/flex015/user_avatar/forums.leialoft.com/cybereality/32/1021_2.png) [@cybereality](https://forums.leialoft.com/u/cybereality)
#### Post date: [April 29, 2023, 9:48pm UTC](https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704/3 "2023-04-29T21:48:40Z")

</div>

If this is for game content or real time 3D in an engine like Unity, you can use the color + depth shader I wrote and open sourced. Basically you just need access to the regular back buffer and the depth buffer and it can produce a stereo image pretty fast (around 1ms). The code is for anaglyph 3D in Godot, but would not be hard to port to other engines.

> **[Godot Stereo 3D : Add-On For Godot Engine by Andres Hernandez](https://cybereality.itch.io/godot-stereo-3d-add-on-for-godot-engine)**
>
> Adds stereoscopic 3D support to Godot Engine (red/cyan anaglyph 3D glasses) in game and in editor.

---

<div class="post-metadata">

### Author: ![Marlon](https://sea1.discourse-cdn.com/flex015/user_avatar/forums.leialoft.com/marlon/32/830_2.png) [@Marlon](https://forums.leialoft.com/u/Marlon)
#### Post date: [April 29, 2023, 10:15pm UTC](https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704/4 "2023-04-29T22:15:46Z")

</div>

Hey Andres! Welcome! Thanks for chiming in here! Maybe this can help @acidys230? Would be fun to hack together sometime. LumePad2 Hackathon anyone??? 😉

---

<div class="post-metadata">

### Author: ![acidys230](https://avatars.discourse-cdn.com/v4/letter/a/c68b51/32.png) [@acidys230](https://forums.leialoft.com/u/acidys230)
#### Post date: [April 29, 2023, 11:06pm UTC](https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704/5 "2023-04-29T23:06:07Z")

</div>

Oops, I forgot to put a link.

> <https://twitter.com/asidys230/status/1636068154211467264>
>
> そいちろ @asidys230

I’m creating an app with Unity. I’m excited about your company’s depth estimation technology.  
I would also be very happy if Unity provided a way to access the camera’s color map and depth map.

---

<div class="post-metadata">

### Author: ![cybereality](https://sea1.discourse-cdn.com/flex015/user_avatar/forums.leialoft.com/cybereality/32/1021_2.png) [@cybereality](https://forums.leialoft.com/u/cybereality)
#### Post date: [May 3, 2023, 6:40am UTC](https://forums.leialoft.com/t/real-time-monocular-depth-estimation/2704/6 "2023-05-03T06:40:27Z")

</div>

That looks really cool.
