LiveLab: Camera Tracking Kit for Virtual Audiences

Mo-Sys puts the crowd back into sport with a high- precision motion tracking kit that connects to Unreal Engine and other graphics engines so broadcasters can add live virtual audiences.

This revolutionary approach is sure to bring back the atmosphere to live sport amid covid-19 restrictions. Providing precision, zero-latency tracking for any camera (including ultra-long box lenses for sport), the Mo-Sys camera tracking kit interfaces directly to the Unreal Engine or any broadcast render engine, allowing production companies to add virtual crowds to stands.

“After so many weeks, sports fans are desperate for any action,” said Michael Geissler, CEO of Mo-Sys. “But the frustration will turn to disappointment if the atmosphere of the game falls flat because of empty stands. We have developed a camera tracking kit which any outside broadcast can implement quickly and simply, capable of filling the stands with a virtual, but enthusiastic, crowd.”

Outdoor Camera Tracking

The Mo-Sys camera tracking encoders are quickly mounted onto broadcast standard Vinten Vector heads, with no impact on the camera’s perfect balance and no backlash when panning and tilting. Zoom data is collected either by gear encoders or by a serial data link to digital lenses. The combined tracking data is sent over ethernet to the workstation hosting the augmented reality software.

“We are known for the absolute precision and stability of our camera tracking – that’s why Hollywood relies on our technology,” Geissler added. “In this application, we deliver precise tracking, including compensation for lens distortion, even when a 100:1 lens is zoomed fully.”

Real-time Photorealistic Graphics

Mo-Sys has worked with Epic Games to develop a tight interface to the Unreal Engine, including support for the latest version 4.25 software. The result is that highly photo-realistic augmented reality – such as crowds filling the stands – can be integrated into live production with no limitations and negligible latency. The kit includes the bolt-on encoding kit for Vinten heads and the lens calibration tools.

You are invited to see the technology in action in a Mo-Sys LiveLab webinar, which will also include contributions from Epic Games and Canon. The webinars are on 30 June, at 10.00 BST and repeated at 18.00 BST.