DESIGN NAME: Emomask
PRIMARY FUNCTION: Cultural and Creative Toys
INSPIRATION: Sichuan Opera Face Changing is China's Intangible Cultural Heritage, and it's about turning abstract emotions and psychological states into concrete images - faces. Existing face-changing toys lack emotional changes and subtle facial expressions that are crucial in traditional face-changing. This design aims to overcome these limitations by creating a dynamic toy that can switch masks based on real emotions, capturing the essence of Sichuan Opera Face Changing.
UNIQUE PROPERTIES / PROJECT DESCRIPTION: This is a Sichuan Opera Face Changing toy employed facial emotion recognition. It uses the FER2013 dataset with the Keras framework to train a facial expression recognition model, and inputs recognition results into a digital mask integrated with thousands of LEDs, so as to switch faces with different emotions in real time according to the user's facial expressions. Compared with existing face-changing toys, it enhances the richness of face-changing types and the fun of face-changing switching.
OPERATION / FLOW / INTERACTION: Wake up the device after power on, press the button to start recognising, within five seconds the user will make an expression, after five seconds rotate and lift the mask, the device will display the corresponding emotion of the face, after 5 seconds, the mask will rotate in the opposite and return to the position. Repeat the above operation to identify different emotions and display the corresponding different faces, realising the digital presentation of Sichuan Opera Face Changing.
PROJECT DURATION AND LOCATION: The project commenced on September 15, 2023, in Ningbo, and concluded on January 9, 2024, also in Ningbo. It was then exhibited at Zhejiang University in January 2024.
FITS BEST INTO CATEGORY: Toys, Games and Hobby Products Design
|
PRODUCTION / REALIZATION TECHNOLOGY: A CNN emotion recognition algorithm enables real-time detection of the user's facial expressions. Expression labels are sent to the digital mask via serial communication, triggering face changes controlled by a control board. Generative AI technology is employed to create facial masks with different emotions, illuminated by thousands of RGB light beads in the digital mask. The physical product is produced in parts using 3D printing and assembled accordingly.
SPECIFICATIONS / TECHNICAL PROPERTIES: 245mm (Length) x 220mm (Width) x 300mm (Height)
TAGS: Cultural and creative toy, Sichuan opera face changing, Emotional recognition, Electronic mask, Intangible cultural heritage preservation, Digital technology
RESEARCH ABSTRACT: Research Type: Product design and tech development.
Objective: Addressing limitations in variety and engagement with existing Sichuan Opera Face Changing products.
Method: Used deep learning, particularly a CNN model trained on FER2013 dataset.
Data & Tools: Utilized FER2013 facial expression database for machine learning training.
Results & Impact: Enables real-time switch between opera masks, enriching Sichuan Opera Face Changing toys.
Real-life Impact: Expands cultural market, enhances product appeal, and promotes intangible cultural heritage, fostering appreciation for traditional Chinese culture.
CHALLENGE: In developing the interactive Sichuan Opera Face Changing device, key creative challenges included merging traditional art with modern facial emotion recognition tech. Balancing respect for heritage while appealing to young consumers' tastes was an intrinsic factor. Externally, legal constraints regarding IP use in cultural relics, integrating thousands of RGB LEDs for detailed mask rendering, and leveraging FER2013 dataset for accurate real-time emotion detection were addressed. Additionally, overcoming servo-motor precision control and ensuring structural stability and durability were crucial.
ADDED DATE: 2024-03-05 09:38:47
TEAM MEMBERS (8) : Leijing Zhou, Wei Cao, Shaolong Chai, Yang Mao, Wang Ying, Jing'ao Zhang, Xin Zhao and Bo Wu
IMAGE CREDITS: Zhejiang University, 2024
|