Event

Event
13:10
-
13:30
Day 1
Open Source video mixing and syncing with real-time control
K.4.601
English
Assembly-Event
<p>As of the 3.10 release, the public domain (Unlicense) media server MistServer (https://mistserver.org) gained a new feature: the ability to mix raw (UYVY pixel format only, for now) video streams, raw audio streams (PCM) and PNG images with resizing, overlapping, aspect ratio keeping and support for non-uniform frame rates between sources. Not only that - but it's even possible to control the configuration in real time without any downtime. This talk shows off what is possible, and explains how we did it in technical detail.</p> <p>Covered topics:</p> <ul> <li>How to efficiently store a multi-frame raw video buffer in shared memory</li> <li>Synchronization handling between multiple sources</li> <li>Handling sources being added or removed without interruptions</li> <li>How we implemented decoding and encoding between raw and encoded formats</li> <li>The user interface that was built to control the mixing in a user-friendly way (though "raw" control through JSON is also possible)</li> </ul>