September 1, 2026
Google on Tuesday rolled out its latest batch of Android updates
This month’s Android update incorporates Gemini into several refreshed capabilities, but emphasizes practical uses, such as remembering where you put your passport or quickly compiling a list with friends. A new accessibility feature also builds on other tools designed to make Android more useful for more people
Here’s what’s landing on Android devices this month.
Track your important items
Find Hub can be used to keep tabs on your important items that don’t have a tracker tag on them.
Do you have a tendency to forget where you put items such as your passport or a spare key? You can now ask Gemini to
remember where you placed those objects
, and it’ll save their locations in
Find Hub, Google’s tracking app for people, phones and accessories.
Just say something like, “Hey Google, remember in Find Hub that I put my passport in my bedroom drawer.” You can add a photo, too. When it’s time to track down that item, ask Gemini where it is or check your remembered items tab in Find Hub. This can be handy for smaller or everyday items you don’t put a tracker tag on.
This feature is available on devices running Android 16 and up, where Gemini and Find Hub are supported
Guided Vision
Guided Vision can help someone pinpoint where an object is using their phone’s camera and Gemini Live.
By sharing your camera in Gemini Live
, you can get descriptions of your surroundings. Gemini Live is part of the Gemini app, and lets you have a more in-depth, back-and-forth conversation with Google’s AI. The new capability, called
Guided Vision
, can assist with reading fine print on a food label or ordering from a menu in a dimly lit restaurant. It can also help you identify something on your shelf or locate objects around the house. If an object isn’t aligned with the camera, voice feedback will help you reframe to better identify it. This feature can be especially helpful for people who are blind or have low vision. But, as is true with all accessibility features, anyone can benefit.
With Guided Vision, Gemini Live will now provide descriptions of what’s in front of you. In an example, a user shares their camera with Gemini Live and points the camera at a rack of spices. The user asks the assistant to guide them to where the oregano is. Gemini Live then guides the user exactly to where the oregano is located.
The feature could prove to be useful in a number of scenarios in addition to helping you find household items. Say that you’re in a dimly lit restaurant, Guided Vision could help you order from the menu. You could also use it for something like reading the fine print on a food label.
To ensure you use the feature correctly, Google has implemented some guiderails. If your camera isn’t lined up in the right way, you’ll get voice feedback guiding you to reframe, pan across a space, or center an object. Once that’s done, you can start asking all of your questions.
According to Google, Guided Vision will be coming soon to phones running Android 9 and above in countries where Gemini is available. Once it arrives, you will be able to add Guided Vision to your Accessibility shortcuts, you will also be able to launch it directly from the TalkBack menu.
Comments
Updates about Guided Vision
"Hello, I will provide some updated information, directly according to Google's own words. This information comes straight from Google support Help, and I’ll share the link along with the article's key highlights.
Get audio descriptions with guided vision in Gemini Live
Important: This feature is rolling out slowly over time, so you may not have access to it yet.
With guided vision, you can get descriptions and real-time help from Gemini while talking through what's around you. Once enabled, you can share your camera in Gemini Live to get audio guidance on things like reading fine print on food labels, identifying colour differences, ordering from low-lit menus or locating household objects. And if your camera isn't lined up, you get instant voice feedback on how to reframe, guiding you to adjust your camera, pan across a space or centre an object so that you get the answers that you need.
How to use guided vision
Guided vision is a feature available in Gemini Live.
To turn on guided vision in Gemini:
1. On your Android device, open the Gemini mobile app.
2. At the top, tap your profile picture or initial Settings. .
3. Turn Use guided vision
• If you turn Use guided vision in Live on, on the on-screen notification, you can tap Start Live to begin a Live chat.
Once guided vision is turned on, you can start a guided vision session when you go live and share your device's camera.
To end a guided vision session, tap End Live session .
Set quick access to guided vision
You can quickly start guided vision with shortcut options on your device.
Set the shortcuts to open Live with camera
You can add an accessibility shortcut to enable guided vision quickly.
To set guided vision as an accessibility shortcut:
1. Open your device’s Settings app.
2. Tap Accessibility, Under 'Vision assistance', tap Guided vision. .
3. Under 'Options', make sure that Guided vision shortcut is turned on.
4. Tap Guided vision shortcut to open the shortcut options. You can choose:
• Accessibility button to tap the floating button to start guided vision.
• Accessibility gesture to swipe up from the bottom of your phone screen with two fingers to start guided vision.
• Volume keys to press and hold both volume keys to start guided vision.
Set TalkBack to start Live with camera
You can start Gemini Live with TalkBack, , the screen reader for Android. To set up guided vision with TalkBack:
1. Make sure that TalkBack is up to date.
2. While TalkBack is enabled, tap on screen with three fingers to bring up the TalkBack menu.
3. Choose Guided vision
What you can do with guided vision
• Read or translate text: Get audio descriptions of text like small labels, complex signs, menu descriptions, appliance displays or any text in your environment.
• Identify objects: Get audio guidance to identify and find the position of objects around you. For example, you can ask for help finding pepper in a spice cabinet.
• Describe objects: Get help understanding things like colour, shape and pattern of items. For example, you can ask if the colour or pattern of a shirt goes with a pair of trousers.
• Understand your surroundings: Get audio descriptions of what's around you. For example, you can ask for help finding where an earbud fell or get a description of a room's layout.
Limitations and warnings
Guided vision can make mistakes. It's not intended as a medical device, mobility aid or substitute for safe-travel guides. Don't use it for navigation or obstacle detection. You're solely responsible for your health and safety.