LipSync with YouTube

LipSync is an AI-powered challenge that rates how well your lips are syncing with the song. Just use your camera, and sing in your own style. The more your lips sync with the song, the more score you will get.

In collaboration with Google and YouTube, we created a web application that uses TensorFlow.js to detect your facial landmark in real-time. No data will be recorded and the ML model is running in the browser. The app will analyze and calculate your score based on how closely your mouth shapes match with the song lyrics.

Sync your lips with “Dance Monkey” by Tones and I!

Let’s see how well you can LipSync!
https://lipsync.withyoutube.com
COLLABORATION
Google
YouTube
RELEASED
2020
AI/ML
AR
Web App