LipSync by Magnum
Join Magnum LipSync Challenge and lip sync to Miley’s Touch on your mobile!
In close collaboration with MullenLowe Profero, we developed the Magnum LipSync Challenge. This challenge was a part of a Magnum marketing campaign – ‘Miley in Layers’, featuring ‘Miley’s Touch’ song, an exclusive cover of the 80’s hit ‘Midas Touch’ by Midnight Star. The campaign attracted users from over the world, including Magnum lovers and Miley’s fans.
Magnum LipSync Challenge is a fun and innovative experience that encourages users to lip sync to Miley’s Touch song. The web app detects how well your lips are syncing with the song. Engaging the users even more by providing a fun GIF of their singing and score rating for them to share!
LipSync experience was first built as a showcase of TensorFlow.js for Google in 2019, and later optimized for desktop browsers as LipSync with YouTube. Since this campaign aimed to capture more users globally, we designed the experience to be played on mobile, via web browsers (no need to download any app). This made the experience easier for target users to access than ever, and thus, helped the campaign to capture a wider range of users.
Here are some major changes we made to achieve the best performance on mobile. First, we optimized the ML pipeline. Since our experience was designed for a single user, we removed the multi-face detection which is unnecessary. We also moved the calculation process into the ML model and upgraded the TensorFlow.js model to the up-to-date version to make the whole experience faster. Other changes are on the front end. We removed some of the effects that consume the device resources, such as the Face polygon effect, and updated the API used for generating GIF files for the users. We also split our code into small modules for even faster development.
The campaign was launched on June 10, 2021. Miley’s fans from around the globe joined our challenge with so much fun and got 4.5 out of 5 on their first try. Try out yours at https://lipsync.magnumicecream.com/ and see if you can get 5 out of 5!
For businesses that would like to integrate your own LipSync experience into your marketing campaign, feel free to reach us for more details at contact@bit.studio.
Tech: AL/ML – Facial Landmarks, Mobile experience, Online experience
GIF provided by the Magnum LipSync Challenge
