Google Launches Guided Vision for Gemini Live on Android

Google announced the launch of Guided Vision in Gemini Live for compatible Android devices on Oct 01, 2026. This feature provides real-time visual interpretation through a conversational voice interface. It is designed for people who are blind or have low vision, allowing them to share their camera feed to receive audio descriptions of their environment.

The development of Guided Vision involved collaboration with the accessibility community and a partnership with Aira. To train the model for real-world context, Google used tens of thousands of hours of visually interpreted data. More than 1,000 members of the Aira Trusted Tester network tested the system, while Aira specialists worked with Google teams to establish safety guardrails.

When the camera is active, Gemini provides verbal cues to help users center objects or reframe the view. It may ask a user to pan slowly to the right, tilt downward, or step back to get a clearer view. The system supports several specific tasks:

• Reading nutrition labels, appliance dials, and printed menus.
• Locating items such as a dropped earbud or specific spices.
• Identifying colors, patterns, and shapes of clothing.
• Providing overviews of room layouts and unfamiliar spaces.

The tool supports multiple languages and underwent testing in India, Brazil, Singapore, Indonesia, and Japan. Users can access the feature on devices running Android 9 and above. It can be activated through the Gemini app settings or via Android Accessibility shortcuts, such as a two-finger swipe or pressing both volume keys. For those using TalkBack, a three-finger tap opens a menu where Guided Vision can be selected.

Google notes that Guided Vision is an assistive utility and not a medical device or mobility aid. It is not intended for navigation, obstacle detection, or as a replacement for a white cane.