Availability of AI audio description for videos on Pixel devices
By Clayton Jacobs…, 24 December, 2024
Forum
Android
I don't know how many pixel users are aware of this feature, but this is especially useful in the YouTube app. If you touch the video player while the video is playing, you will get an AI description of what is being displayed on the screen.
Since Google officially hasn't announced any specific feature around Youtube Audio descriptions, I am guessing that this is the normal Talkback image description feature, and would work on any modern smartphone with updated OS and Talkback version, I don't know what are the latest numbers.
However, since the Gemini powered descriptions open up a popup to show descriptions, I am again guessing it's not using Gemini.
On my Moto Edge 50 Neo, with everything updated, when I tap on the video screen, Talkback announces: "Video player, double-tap to show video controls". By default, no descriptions for me. I've assigned a 3 finger single tap gesture to generate Gemini descriptions, which does work, but introduces a popup as previously suggested. For next seen, I have to close the popup by doing a back gesture and doing a 3 finger tap once again.
I would apreciate if you can do a screen-record of the way it's working on your pixel, upload it to Dropbox/GoogleDrive, and share the link for our understanding. Do be mindful about your privacy while doing so.
Meanwhile, I'll reach out to a pixel owner friend to test it out locally.
If what you said is indeed true, I am super intrigued about this feature.
Automatic description of video reading from Talkback on Pixel devices, depends on the video in question. Thus, hit and miss. As I use a Samsung, I myself can't test the feature myself.
Now that I bring up Samsung & YouTube, the Summary feature of Galaxy AI will summarize YouTube videos if watching via its web site.
Tell me if I have this right ...
Pixel's can give an AI driven audio description on certain YouTube videos played on the YouTube application, and Samsung's AI can generate video summaries if YouTube videos are played on the YouTube.com site?
This gives me a lot to think about. I am still leaning towards a Pixel for my next upgrade,but I keep learning just a little more about Samsung's here and there, that peak my curiosity. 🙂
I stick with Samsung devices because:
1. Bixby on my S23+ (though is also available on the higher spec Samsung Alpha devices).
and
2. Being able to have multiple screen readers I can switch to.
If you're wanting to do Passive Income apps, and/or video editing like with an app called InShot Video Editor & Video Maker
(which is screen reader friendly by the way), Samsung was meant for this kinda stuff. Not saying that the pixel can't do it, haven't heard anyone demo said app on a pixel 9.
I got so excited when I saw this post today! I know this post has been here for a while—I can see the date it was posted—but I just saw it now for some reason, and it made me really happy. I tried to test it on my Pixel phone, but the excitement quickly went away because I don’t have that feature, and I have no idea what you’re talking about. Could you please do a demo? I have a Pixel 9 Pro and can’t seem to find that option anywhere. 🙃
Comments
Define: "Touch the video player"
is this with, or without talkback or any other screen reader?
In response to Brian
Yes, this is with TalkBack + all it requires is a single tap on the video player screen
Some burning questions!
Since Google officially hasn't announced any specific feature around Youtube Audio descriptions, I am guessing that this is the normal Talkback image description feature, and would work on any modern smartphone with updated OS and Talkback version, I don't know what are the latest numbers.
However, since the Gemini powered descriptions open up a popup to show descriptions, I am again guessing it's not using Gemini.
On my Moto Edge 50 Neo, with everything updated, when I tap on the video screen, Talkback announces: "Video player, double-tap to show video controls". By default, no descriptions for me. I've assigned a 3 finger single tap gesture to generate Gemini descriptions, which does work, but introduces a popup as previously suggested. For next seen, I have to close the popup by doing a back gesture and doing a 3 finger tap once again.
I would apreciate if you can do a screen-record of the way it's working on your pixel, upload it to Dropbox/GoogleDrive, and share the link for our understanding. Do be mindful about your privacy while doing so.
Meanwhile, I'll reach out to a pixel owner friend to test it out locally.
If what you said is indeed true, I am super intrigued about this feature.
I second this
I would love to listen to a demonstration of this feature in action. 🙂
Yeah, I'd love to hear a…
Yeah, I'd love to hear a demo of this. Sounds like someone is just doing the AI description command.
On Behalf Of Clayton
Automatic description of video reading from Talkback on Pixel devices, depends on the video in question. Thus, hit and miss. As I use a Samsung, I myself can't test the feature myself.
Now that I bring up Samsung & YouTube, the Summary feature of Galaxy AI will summarize YouTube videos if watching via its web site.
Seeking clarification
Tell me if I have this right ...
Pixel's can give an AI driven audio description on certain YouTube videos played on the YouTube application, and Samsung's AI can generate video summaries if YouTube videos are played on the YouTube.com site?
@Brian
Yep? You nailed it!
Interesting
This gives me a lot to think about. I am still leaning towards a Pixel for my next upgrade,but I keep learning just a little more about Samsung's here and there, that peak my curiosity. 🙂
Shall Go More Indepth In Future But...
PiccyBot Android
Note that you can always use my app PiccyBot for AI video descriptions. It's available for almost all Android devices.
I can’t find that feature
I got so excited when I saw this post today! I know this post has been here for a while—I can see the date it was posted—but I just saw it now for some reason, and it made me really happy. I tried to test it on my Pixel phone, but the excitement quickly went away because I don’t have that feature, and I have no idea what you’re talking about. Could you please do a demo? I have a Pixel 9 Pro and can’t seem to find that option anywhere. 🙃