Trying out gesture detection while exploring Google’s open machine learning platform TensorFlow. Using Google-provided training sets for face and hand recognition, I’m able to combine exact finger joint shapes with precise facial feature positions to determine if the user is making specific gestures.

Once you allow your webcam, try making different faces and hand signals to see how accurate the detection can be. You’ll see the demo recognize the specific gesture of “SHHH”ing by placing your left-hand pointer finger over your mouth.