top of page

PECS App - SY Project

October 8, 2025 
"Speak With Pictures"
is now available on the App Store.

App store - iphone
 
appstore_speakwithpictures_iphone
App demo movie
 

​

The UI/UX design of "Speak with Pictures App" was created by Sarah Yoo, using Photoshop, Procreate, and Figma.

Each visual element was thoughtfully refined to create a clear, warm, and engaging user experience.

​

The app took about one month to develop and is available for both iPhone and iPad.

Speak With Pictures originally launched with 184 picture cards, later expanded to 204 cards, and continues to grow. New cards are added whenever new ideas come to mind, and future app updates will include even more visual vocabulary for users.

​

While the initial release focuses on the core communication features, the reward screen, statistics dashboard, and settings page—originally planned as part of the full vision—are still in development and will be added in a future update.

​

We sincerely hope that Speak With Pictures, now available for free, will bring comfort, understanding, and meaningful support to families of individuals with autism around the world.

​

Please note that the current app may not exactly match the original Figma design and development prototype, but we plan to gradually implement these updates in future versions.

Visual Design : Speak With Pictures

speakwithpictures_app1
speakwithpictures_app2
speakwithpictures_app3
speakwithpictures_app4

PECS App (Project poroposal)

Title

​

Designing a Simplified PECS-Based Mobile Application for Low-Functioning Children with Autism Spectrum Disorder

​

Abstract

​

Most existing Picture Exchange Communication System (PECS) applications are designed with high-functioning children with autism in mind.

While these applications provide valuable communication support, they are often too complex, visually overstimulating, and cognitively demanding for children with autism spectrum disorder (ASD) who also present with intellectual disabilities.

As a result, low-functioning children tend not to use existing PECS apps because they are difficult to navigate and understand.This project proposes the development of a simplified and accessible mobile application tailored specifically for low-functioning children with ASD.

The proposed app limits vocabulary to essential daily-life terms, incorporates gamified elements to enhance engagement, provides a statistics feature to track frequently used cards, and includes category optimization in the menu to make commonly used words easy to find. Users can also adjust color saturation to about 75% in the settings menu for visual comfort.

 

Introduction

 

Communication barriers are among the most persistent challenges for children with autism spectrum disorder (ASD), particularly for those who are low-functioning and have co-occurring intellectual disabilities.

Although the PECS framework has been widely adopted as an effective intervention, most digital PECS applications are primarily developed for high-functioning children, which results in low-functioning users rarely using them.

These children often experience significant difficulties with reading comprehension, sensory regulation, and cognitive processing, making existing tools hard to use. This project seeks to address this gap by creating a simplified and inclusive communication tool designed to reduce sensory overload and cognitive effort while improving accessibility.

 

Review

 

Research has consistently shown the effectiveness of PECS in improving communication outcomes for autistic children (Bondy & Frost, 2001).

Visual-based communication offers a clear way for children to express their needs.

However, most digital PECS applications assume literacy or higher cognitive skills, which can be a barrier for low-functioning users.

 

Smith et al. (2018) identified several usability challenges in current PECS apps, such as cluttered interfaces, text-based instructions, and overstimulating visuals.

These design choices can overwhelm low-functioning children who require simpler layouts and minimal distractions. There remains a clear need for digital tools that are accessible and enjoyable for children with more significant developmental challenges.

 

Problem Statement

 

Current PECS applications present several challenges for low-functioning children with autism:

 

- Interface Complexity  (Too many symbols on one screen)

 

- Textual Prompts  (instructions like “click twice” assume reading ability)

 

- Sensory Overload  (Bright, saturated colors can be overwhelming)

 

- Accessibility  (Many existing apps are difficult for children to use)

 

Project Objective

 

This project aims to develop a minimalist, free PECS application that addresses these challenges by:

 

- Presenting only essential daily-life words 

​

- Using clear pictograms without text-based prompts

 

- Incorporating a gamified reward system, where touching a PECS card increases the number of fish in the reward screen, accompanied by ocean waves and water sounds

​

- Providing a color adjustment option in the settings menu, allowing users to reduce color saturation to about 75%

​

- Offering statistics functionality, so parents can see which cards are used most frequently

 

- Adding optimized category menus, so commonly used words are easily accessible and children can find cards more quickly

 

- Making the app freely available for download on the App Store

 

Methodology (Proposed)

​

The design approach focused on simplicity, clarity, and user comfort.Prototype development emphasized minimal visual clutter, consistent layouts, and gentle color tones.

Interactive feedback through the fish reward system was implemented to provide a positive reinforcement experience for repeated card usage.

 

Expected Outcomes

 

- Enhanced accessibility for children with severe autism and intellectual disabilities

 

- Reduced cognitive and sensory demandsIncreased motivation and engagement through interactive feedback

 

- Improved efficiency in card selection through optimized category menus

 

- Greater independence and social participation among low-functioning children with ASD

 

Conclusion

 

Most PECS applications are not well-suited for low-functioning children with autism and intellectual disabilities.

By simplifying interface design, reducing overstimulation, providing adjustable visual options, and adding features like reward systems, usage statistics, and optimized categories, this project proposes a more inclusive communication tool.

These features aim to make communication easier, more engaging, and supportive of independence for children with ASD.

© 2025 by Sarah Yoo. Powered and secured by Wix

bottom of page