I'm developing a product and exploring various video rendering technologies, including Remotion, Helios, and FFrames. My experience with Remotion has been frustrating as its rendering times are significantly longer than the actual video duration, which isn't practical for my needs. I've noticed that some platforms like Veed and Tella can render videos at speeds exceeding real-time, sometimes completing a 10-minute video in just 2 minutes. I'm curious about the methods they employ to achieve such efficiency. My content includes dynamic elements where users can program overlays, captions, and backgrounds, rather than just using static graphics. I want to incorporate this flexibility into the videos, similar to examples I found online. Any tips or techniques that could help improve my rendering speed would be greatly appreciated!
3 Answers
A lot of fast platforms might not be rendering live code from browsers. They typically convert everything to simpler video elements first before rendering, which boosts their speed significantly.
The quicker video platforms often utilize headless Chrome rendering with multiple workers running at the same time. Rather than processing frames one at a time, they divide the workload among several workers to render different sections in parallel and then stitch everything together afterward. For your case with iframe overlays, it can be more complex because maintaining the state across workers isn't straightforward without resetting everything. Remotion is slow because it mimics the browser's process directly. One potential solution is to pre-render your iframe overlays onto a canvas at keyframes, using those images for compositing instead of live iframes. This approach sacrifices some interactivity, but it will speed up the rendering by focusing on image compositing. Using a tool like ffmpeg can help assemble it all together much faster than real time once the frames are ready.
I just learned about Helios and FFrames today—thanks for bringing them up! These tools seem promising for video processing.
Thanks for the reply! What do you mean by losing interactivity?