What’s New in Google Accessibility | Episode 13 | American Sign Language
Laura Allen details the latest accessibility enhancements across Google products, including new sign language translation, voice-controlled features for Pixel, and Gemini integrations. The episode also highlights collaborative neurodiversity resources from Understood.org and introduces a dedicated community platform for users to connect, share tips, and find support for assistive technologies.
Sign-to-Text is a new feature () that translates American Sign Language (ASL) into written English in real time.
Here is how it works:
- Translation Technology: It uses a specialized model called SL2T that analyzes hand shapes, facial expressions, and body movements ().
- Versatility: The feature supports both one-handed and two-handed signing ().
- Usability: You can use it anywhere you would normally type with Gboard—such as searching the web, prompting Gemini, drafting documents, or having conversations via Live Transcribe ().
This feature was developed in partnership with the Deaf and hard of hearing community and is currently available on the Pixel 11 series, with more devices and additional sign languages coming soon ().
In the latest release of What’s New in Google Accessibility (Episode 13), Google introduced Sign to Text, a groundbreaking keyboard feature designed in partnership with the deaf and hard-of-hearing community. This feature allows users to communicate naturally using American Sign Language (ASL) and have it translated into written English in real-time. [1, 2]
Key Accessibility Highlights from Episode 13
- Sign to Text (Gboard): Powered by a multilingual sign language to text translation model (SL2T). It utilizes the device camera to analyze hand shapes, facial expressions (for grammar and tone), and body movements. It supports both one-handed and two-handed signing. [1, 2, 3]
- System-Wide Integration: You can use ASL anywhere you would normally type on a keyboard—such as searching the web, prompting Gemini, drafting messages, or using Live Transcribe for multi-person conversations. [1, 2]
- Device Availability: Sign to Text is currently exclusive to the Pixel 11 series, with plans to support additional sign languages and devices in the near future. [1, 2]
- Other Features Debuted: The episode also introduced Rambler (a concise speech-to-text summarizing tool with TalkBack gestures) and major Gemini upgrades to Guided Frame and Guided Vision for blind and low-vision users. [1]
If you would like, I can give you more details on:
- How the Gemini Guided Vision updates work for blind or low-vision users.
- Steps to find the official American Sign Language (ASL) version of the announcement video.
- The technical capabilities of the SL2T language model.
Let me know what you would like to explore next!