Child holding Aura controller with green LED panel at SJD Sant Joan de Déu waiting roomHospital waiting room with yellow Aura emotion game displayed on wall-mounted TV screenAura panel with warm amber LED glow and controller beside it, aura tu mapa emocional brandingAura panel with red LED glow on a hospital corridor wall at Hospital Dèu Barcelona, controller on benchHospital corridor with blue Aura emotion game on TV screen, Espai de joc Pediatria signHands holding the Aura controller with the panel above showing multicolour RGB LEDsChild holding Aura controller with green LED panel at SJD Sant Joan de Déu waiting roomHospital waiting room with yellow Aura emotion game displayed on wall-mounted TV screenAura panel with warm amber LED glow and controller beside it, aura tu mapa emocional brandingAura panel with red LED glow on a hospital corridor wall at Hospital Dèu Barcelona, controller on benchHospital corridor with blue Aura emotion game on TV screen, Espai de joc Pediatria signHands holding the Aura controller with the panel above showing multicolour RGB LEDsChild holding Aura controller with green LED panel at SJD Sant Joan de Déu waiting roomHospital waiting room with yellow Aura emotion game displayed on wall-mounted TV screenAura panel with warm amber LED glow and controller beside it, aura tu mapa emocional brandingAura panel with red LED glow on a hospital corridor wall at Hospital Dèu Barcelona, controller on benchHospital corridor with blue Aura emotion game on TV screen, Espai de joc Pediatria signHands holding the Aura controller with the panel above showing multicolour RGB LEDs

Aura

Face Tracking, Emotions, Data Visualisation

Year2023ByBerta Ferrer and Alba MartínezIn collaboration withHospital Sant Joan de Déu

Aura is a project designed to analyse and visualise the emotions of pre-adolescent long-stay patients at Sant Joan de Déu Hospital. Using facial recognition technology and a physical interface, the system records the frequency and intensity of four basic emotions: joy, sadness, fear and anger. Each emotion is represented by a specific colour: yellow, blue, red and green, respectively.

Based on this data, Aura creates an emotional map through LED lights, offering a clear and accessible representation of the patient's emotional state. This visualisation can help patients recognise how they are feeling while also supporting medical staff in understanding their emotional development.

The project also includes an exploratory video game that encourages users to discover and understand the main emotions and their different nuances. The experience is divided into four abstract worlds built through colours, shapes and sounds, with each world representing a basic emotion.

Throughout the journey, players encounter questions and situations that encourage reflection and introspection. In this way, Aura combines technology, interactive design and emotional learning to transform entertainment into a tool for self-awareness, communication and support within the hospital environment.

Aura acrylic panel with emotion graph, LEDs and a game controller

Aura

Face Tracking, Emotions, Data Visualisation

Aura

Face Tracking, Emotions, Data Visualisation

Year2023ByBerta Ferrer and Alba MartínezIn collaboration withHospital Sant Joan de Déu

Aura is a project designed to analyse and visualise the emotions of pre-adolescent long-stay patients at Sant Joan de Déu Hospital. Using facial recognition technology and a physical interface, the system records the frequency and intensity of four basic emotions: joy, sadness, fear and anger. Each emotion is represented by a specific colour: yellow, blue, red and green, respectively.

Based on this data, Aura creates an emotional map through LED lights, offering a clear and accessible representation of the patient's emotional state. This visualisation can help patients recognise how they are feeling while also supporting medical staff in understanding their emotional development.

The project also includes an exploratory video game that encourages users to discover and understand the main emotions and their different nuances. The experience is divided into four abstract worlds built through colours, shapes and sounds, with each world representing a basic emotion.

Throughout the journey, players encounter questions and situations that encourage reflection and introspection. In this way, Aura combines technology, interactive design and emotional learning to transform entertainment into a tool for self-awareness, communication and support within the hospital environment.

Child holding Aura controller with green LED panel at SJD Sant Joan de Déu waiting roomHospital waiting room with yellow Aura emotion game displayed on wall-mounted TV screenAura panel with warm amber LED glow and controller beside it, aura tu mapa emocional brandingAura panel with red LED glow on a hospital corridor wall at Hospital Dèu Barcelona, controller on benchHospital corridor with blue Aura emotion game on TV screen, Espai de joc Pediatria signHands holding the Aura controller with the panel above showing multicolour RGB LEDs