Interactive face painter tool drawing colorful ellipses out of your mouth.

Face painter

Can embodied interaction help create more inclusive digital experiences?

In a series of tests with Rudolfo Quintas we focus on the face as interface. The experiments are held with the elderly inhabitants of the Casa do Artista in Lisbon.

The face painter is a web application built with google’s body tracking library mediapipe that I’m designing together with Rudolfo Quintas. Im coding it as a web browser app. I am constantly exploring the possibilities of this machine learning tool and how to apply it to create new forms of embodied interaction.

2023
  • Creative Coding
  • User Experience
  • Programming

Artistic Investigation “O Ato Ciênsivel” by Studio Rudolfo Quintas with support of Portuguese Ministry of Culture - DGArtes

video play button
video play button
video play button
video play button
video play button
video play button
video play button
Colorful drawing result of the face painter.
Colorful drawing result of the face painter.
Prototype of the face painter show the eye and mouth tracking points.
Paper sketches of the face painter user interface.
Colorful drawing result of the face painter.
Prototype of the face painter with white tracking points for all face landmarks.
video play button
Colorful drawing result of the face painter.
Colorful drawing result of the face painter.
Colorful drawing result of the face painter.
Colorful drawing result of the face painter.