StageLab

At Strawberry Music Festival 2020, we created an AI/ML powered AR experience to enliven the concert like never before.

The system was applied to New Pants’ live stage where certain actions of the artists and audience activated live AR effects to create a joyful interactive concert experience.

Powered by AI/ML, the motion graphics are automatically generated, scale, rotate, and position over the concert camera feed in response to specific objects, poses, or gestures of the artists and audience. Our system incorporated object detection and orientation, face detection, facial landmark detection, pose detection, gesture detection, and crowd plane detection. Everything you see on the live screen is detected and rendered in real-time – no post-production required!