This project is a Web Application showcasing the Facial Landmark Detection using Tensorflow.js. We developed the Lipsync game for the user to sing along (using only the mouth shape input) and use Machine Learning to detect the mouth shape and calculate the score based on the accuracy of the player’s mouth shape.
“Lipsync” has been showed on the keynote stage and exhibited at Tensorflow World 2019 in Santa Clara, CA.
Try it yourself here! https://lipsync-dev.firebaseapp.com/