"Stop Smile Stroll" is a public installation taking the shape of a playful intervention whilst waiting to cross the road. Citizens are invited to press a button which engages a cammera. A few frames are recorded and analysed displaying messages and custom animations overlayed on facial features depending on the mood/emotion.
This Hirsch & Mann project was built with support from Watershed/Pervasive Media Studio as part of Playable City Bristol
The Computer Vision system used facial landmark detection to overlay real-time animations. An initial prototype used Action Unit estimation for expression recognition, however better results were achieved using a custom trained Convolutional Neural Network using TensorFlow