DESIGN NAME: Esync
PRIMARY FUNCTION: AR Glasses
INSPIRATION: People with disabling hearing loss face limitations in accessing auditory cues, resulting in lower emotional cognition compared to hearing individuals. This lack of emotional understanding can lead to misunderstandings in social interactions and difficulties in conveying true emotions and attitudes. Consequently, it may cause offense or awkwardness, leading to misunderstandings and inconvenience.
UNIQUE PROPERTIES / PROJECT DESCRIPTION: E-sync, AR smart glasses for the hearing impaired, aims to improve emotion recognition and expression in interpersonal communication. E-sync uses AI hardware to analyze speech and gestures, generating visual and auditory feedback through AR technology. It adapts to social contexts and emotional signals, enhancing communication for the hearing impaired and reducing misunderstandings.
OPERATION / FLOW / INTERACTION: E-sync utilizes AI to analyze the speech information of the hearing population, generating visual information, which is then presented to the user through augmented reality technology on the lenses of the glasses. Additionally, the product scans sign language gestures through cameras and translates them into corresponding phrases. Based on the user's social occasions and physiological signals related to personal emotions, AI processes and outputs complete sentences through the speaker.
PROJECT DURATION AND LOCATION: The project started in January 2024 in Beijing and finished in March 2024 in Beijing.
|
PRODUCTION / REALIZATION TECHNOLOGY: The introduction of AI technology into E-sync enhances face-to-face communication for the hearing-impaired. It recognizes speech content and emotional cues, converting them into text and tactile feedback. Users can respond using sign language, which the device converts into suitable speech based on gesture recognition. This closed-loop communication process, aided by AI hardware, reduces misunderstandings, and improves social interactions.
SPECIFICATIONS / TECHNICAL PROPERTIES: 150mm x 155mm x 38mm
E-sync's unique lens storage design adds convenience and protection, while its elegant color scheme and material combination enhance comfort and style, making it both functional and fashionable. Moreover, the accompanying app E-connect, allows for real-time language processing adjustments, ensuring convenient usage.
TAGS: AR glasses, Hearing-impaired people, Emotional expression, AI Hardware, Smart Wearable Technology
RESEARCH ABSTRACT: 60.5M+ individuals with severe to total hearing loss struggle with conventional aids, limiting access to info & effective communication. Current assistive devices mainly convert speech-to-text, ignoring the depth of understanding and emotional conveyance crucial in social interactions. This barrier exacerbates isolation, discrimination, and mental health concerns in a hearing-centric society.
CHALLENGE: We extensively considered the shape and size of the product during the design process, exploring options like smartphones and smartwatches, but ultimately choosing glasses as the most convenient option. We also considered privacy concerns during communication between individuals with hearing loss and hearing individuals, addressing these issues in our design of aesthetics and functionalities.
ADDED DATE: 2024-03-24 16:58:38
TEAM MEMBERS (4) : Yiyu Qi, Wenfei Li, Yihuan Ma and Wenbing Du
IMAGE CREDITS: Esync Design Team, 2023.
|