Live Caption AI – Designing Real-Time Accessibility for the Deaf & Hard of Hearing
As Director of UX and Product Design, I conceived, designed, and launched Live Caption, an app that brings real-time transcription and accessibility to individuals with hearing loss. Initially released for Android (2011) and iOS (2014), Live Caption has evolved into Live Caption AI (2024), leveraging advanced speech recognition and web-streaming technology. Today, it empowers thousands worldwide, helping bridge communication gaps across conversations, classrooms, events, and workplaces.
Role
Founder, Director of UX & Product Design
Platform
iOS, Android, Web Streaming
Timeline
Android (2011), iOS (2014),
AI Relaunch (2024)
Team
Solo founder + iOS developer collaboration
“Live Caption AI reintegrates marginalized communities into the conversation—empowering users to connect, work, and thrive without hearing as a prerequisite.”
Before (Challenge) → After (Solution)
1 in 5 Americans face hearing loss, leading to isolation, workplace barriers, and limited access to live conversations and events. → Designed Live Caption AI: a real-time captioning app that streams spoken words to text, enabling inclusivity and connection.
Closed captioning was limited to television and select platforms, with few accessible solutions for in-person or live scenarios. → Delivered mobile and web-based tools allowing captions for conversations, lectures, workplaces, and gatherings.
Expensive transcription services restricted participation in meetings and education for many individuals. → Provided an affordable, on-demand solution for individuals and organizations to support accessibility and compliance.
How We Got There
Designed and launched Live Caption (2011, Android): Leveraged early mobile frameworks like Google App Inventor to develop real-time speech-to-text transcription on limited budgets.
Iterated based on user feedback: Partnered with an iOS developer in 2014 to rebuild for iOS and expand functionality.
Launched Live Caption AI (2024): Introduced advanced ASR (automatic speech recognition) and web-streaming captions for public speakers, educators, and religious leaders.
Embraced lean UX and rapid prototyping: Focused on simple, intuitive flows for an audience often overlooked by mainstream tech.
Features
Real-Time Captioning: Converts speech to text instantly for face-to-face and online conversations.
Live Streaming Feature: Broadcast captions to multiple devices via a unique URL for classrooms, events, and worship services.
Simple UI Design: Prioritizes clarity and speed for users with diverse accessibility needs.
Seen on Film
Featured in the critically acclaimed film Sound of Metal, which went on to win multiple awards at the Oscars. Highlighting its utility in highly difficult situations.
Impact
Result → Outcome
Android launch (2011) & iOS launch (2014) → Gained global traction and thousands of paying users with minimal promotion.
Featured in Oscar-winning film Sound of Metal (2020) → Elevated awareness of accessibility tech for the deaf and hard of hearing community.
Live Caption AI release (2024) → Introduced advanced AI features and web streaming, enabling accessibility for events and groups.
Customer Feedback:
"With your app, you've made a difference in my life. I was born hearing. I've lost the majority of it after 23 years.... I'm now legally deaf and have been for about five years. I know some sign, but it’s not a primary language for most...and not even for me. ... Everyday tasks that require interactions with others can just be overwhelming. I just got my first android phone for Christmas, and then I got your app, Live Caption. Clicking your "appreciate" button just isn't enough. You ROCK." – Janet
"Because I am legally deaf, when I attend meetings, my company pays around $100 an hour for me to have real time captioning. One time, we had a two-day meeting and for just the transcription for me, they paid around $2,000. I feel awful asking for it, so I go to 1/10 of the meetings I would attend if I could hear. Your app can make the world more accessible, not just for individuals, but also for businesses, and open the road to employment for individuals with hearing loss or deafness--provide access to education at private universities across the nation who claim they don't have to provide this service."
– Christina
"I am deafened late in life and had no way to communicate with my wife, friends, neighbors, store clerks, and others. This app has given me back a major portion of my life. I can communicate again. The developer has continued to improve the app (he responds to suggestions, problems, accolades). My wife and I communicate using Live Caption totally. ... I highly recommend the app and have found that other hearing impaired persons, Audiologists, and those with whom I use this app are amazed and excited about this technology. Kudos to its developer and to Google Play for making this app and personal captioning available." – Jerry
"My name is Spencer and I am a deaf consultant for British Deaf Foundation. For the last 8 years, I have been looking for a solution where I can speak to people without help from interpreter or a third party agent, as I want to be independent like everyone else. Then I saw your website on Google. I saw the video and bought the product via iTunes for a trial. Eureka!! You have MADE me so happy and I can easily engage with a lot of people."
– Spencer
Design POV
“Accessibility tools should feel effortless and empowering. With Live Caption, I focused on building inclusive, human-centered experiences that give users independence and dignity in every interaction.”
Key Reflection
“This journey reinforced the power of iterative design and user advocacy. Next time, I’d invest earlier in partnerships with accessibility organizations to scale adoption and community feedback.”