Google Launches New Guided Vision Feature for AI Assistance on Android

Google is rolling out a significant new accessibility feature called Guided Vision, integrated into its Gemini Live experience on compatible Android devices. This innovative tool leverages artificial intelligence to provide real-time audio descriptions of the physical world, simply by pointing a smartphone camera at it. Guided Vision aims to empower users by offering assistance with a range of daily tasks. Key functionalities include the ability to read small or fine print, describe the user's immediate surroundings, identify and locate specific objects, and provide detailed descriptions of items. For instance, a user could point their camera at a medicine bottle to hear its label read aloud, or at a room to get an audio overview of its contents. The feature is primarily designed to support individuals who are blind or have low vision, offering a crucial aid for navigating and interacting with their environment. However, its utility extends to anyone seeking quick, AI-powered assistance in specific scenarios, such as deciphering complex instructions or understanding unfamiliar objects. Google's Guided Vision draws parallels with Apple's existing VoiceOver Live Recognition feature, available on iPhone and Vision Pro, which offers similar capabilities for accessibility. This move by Google underscores a growing industry focus on leveraging advanced AI to enhance accessibility and provide more intuitive interactions with technology for all users. The feature is available through the Gemini app starting today.