Case Study

Case Study

Case Study

AI Wearable for Speech Assistance

AI Wearable for Speech Assistance

AI Wearable for Speech Assistance

Overview

Overview

Users with Complex Communication Needs (CCNs) often have disabilities that severely limit their ability to communicate with others using speech alone. To work around their unique difficulties, users with CCNs turn to Augmentative and Assistive Communication (AAC) devices to improve their quality of life in functional and social aspects. In this project, I design an AAC system that borrows the power of AI and wearable technology to allow for more effective and autonomous communication.

AI Integration

AI Integration

UI Design

UI Design

System Design

System Design

Prototyping

Prototyping

Designing a More Effective Augmentative and Assistive Communication System

There are several cons to existing Augmentative and Assistive Communication (AAC) devices in the market:

  • Form factor is bulky and not ideal for carrying around outside

  • Limited expression is possible with manual input

  • Interacting with the device makes the user's disability blatantly perceptible

There are several cons to existing Augmentative and Assistive Communication (AAC) devices in the market:

  • Form factor is bulky and not ideal for carrying around outside

  • Limited expression is possible with manual input

  • Interacting with the device makes the user's disability blatantly perceptible

Literature Review on AAC Devices

Insight 1

Insight 2

Insight 2

Insight 3

Insight 3

Insight 2

Insight 1

Stigma from the visibility of a disability is linked to the abandonment of Augmentative and Alternative Communication (AAC) devices.

The device should be invisible until the user wants to make it visible.

AAC devices allow people with Complex Communication Needs (CCNs) to participate in conversations, which in turn builds confidence and autonomy.

Interacting with the device should grow the users’ confidence and independence.

AAC devices can be limiting when they’re made up of a pre-configured set of communicative phrases, but could be more usable if made adaptable to the user and the context of the interaction.

The device should be smart and adaptable, so that the users can communicate more effectively and expressedly.

Problem Statement

How might we support adults with Complex Communication Needs (CCNs) to participate in interactions autonomously through communication that is adaptable to the user and the context of the interaction?

How might we support adults with Complex Communication Needs (CCNs) to participate in interactions autonomously through communication that is adaptable to the user and the context of the interaction?

Understanding the User

Empathy Map

Using information from the literature review, I created an empathy map to visualize what I understood about the real experiences of people with Complex Communication Needs.

Using information from the literature review, I created an empathy map to visualize what I understood about the real experiences of people with Complex Communication Needs.

Using information from the literature review, I created an empathy map to visualize what I understood about the real experiences of people with Complex Communication Needs.

20%

Empathy Map for People with Complex Communication Needs (CCNs)

Jobs-to-be-Done

I used the Jobs-to-be-Done framework to break down customer needs and make sure the final product would align with the goals of the customer.

I used the Jobs-to-be-Done framework to break down customer needs and make sure the final product would align with the goals of the customer.

15%

JTBD for People with Complex Communication Needs (CCNs)

Storyboarding

During the ideation phase, I created a storyboard to visualize how a wearable device with AI driven communication would work in a real-life scenario.

30%

Low Fidelity Storyboard Demonstrating AyaSpeak's Functionality

Final Solution

Watch Screen UI

Watch Screen UI

Overview of Functionality

Mobile UI Breakdown

Mobile UI Breakdown

Overview of Functionality

Next Up

Next Up

Next Up

Create and maintain 3D experiences
across physical and digital spaces.

Create and maintain 3D experiences
across physical and digital spaces.

Create and maintain 3D experiences across physical and digital spaces.

Mobile Development

Mobile Development

Generative Research

Generative Research

Usability Testing

Usability Testing

Prototyping

Prototyping

Create a free website with Framer, the website builder loved by startups, designers and agencies.