We do have a solution for that, but not on Lume Pad. This uses FFMPEG on PC. It will work very, very fast and can work well, but there are a LOT of caveats to that. That’s why we strongly recommend just using the Lightfield Studio tool for the best quality. Either way, I figure I should share this script with you since it might be exactly what you’re looking for.
The requirements for compatible video are as follows:
- The video must be shot with the camera moving horizontally at a consistent speed with little to no vertical or zooming motion.
- The subjects in the video should not move or move as little as possible.
These instructions will use FFMPEG to duplicate a video, set a time delay, clip the ends of the two video clips, then generate a 3D SBS video.
Install FFMPEG using Brew (MacOS/Linux), Chocolatey (Windows), your favorite package manager, or from ffmpeg.org
You can create two time delayed clips(Left Eye & Right Eye) by doing the following:
- Duplicate/copy the 2D clip you want to convert.
- Choose your baseline, which becomes your time delay value(t). Larger time delay is a larger baseline.
- Delete (t) from the end of one clip(making it your Left Eye clip)
- Delete (t) from the beginning of the other clip(making it your Right Eye clip)
NOTE: The above instructions assume your video was shot from Left to Right. If your video was shot from Right to Left, then the eye values in step 3 and 4 are reversed.
That’s it, you now have a left and a right eye clip, so you just need to stitch them together.
The FFMPEG script required to create a 3D video from two pre-time delayed clips is as follows:
ffmpeg -i Right_Input.mp4 -vf "movie=Left_Input.mp4 [in1]; [in]pad=iw*2:ih:iw:0[in0]; [in0][in1] overlay=0:0 [out]" SBS_Output.mp4
How to Choose a Good Time Delay:
If you’d like to identify the perfect time delay for your particular clip, you can export frames from the video at regular intervals and create SBS photos to preview on Lume Pad or other SBS viewer. You should probably choose a small slice of your total footage to capture the frames from as more than 5 or 6 per output are unneeded. The following FFMPEG script will output frames, where “n” should be replaced with the number of frames per second you’d like to output. e.g. using the value 4 on a 60fps video will output the first frame, 15th frame, 30th frame, and 45th frame in the first second, and another sequence of four starting with the 60th frame the next second.
ffmpeg -i LinearFootageSlice.mp4 -r n output_%04d.jpg
This will be a fast way for you to generate 3D video from your orbital and horizontally shot content using a rig, slider, drone, or other source, but if there are variations like lots of movement of subjects, vertical motion of the camera, or zooms in or out or focus changes, this will have clear visual issues.
Running the script above on Lume Pad is impossible in realtime especially if you’re talking about duplicating and stitching 2D video of 4K resolution and similar! I think it’s better we leave things like this to Creators on PC who can easily share it with Lume Pad after running the script.