Those of you who have watched the live stream, do come over and let's talk about how incredible the demo seemed. And also about how much of it would translate into actual usable stuff. And also what this means for accessibility and Assistive AI if I may. And those of you who haven't, do go watch the stream. it's incredible! (in all caps)
Comments
Bryan.
Yep for identifying a ride share I think this would work perfectly. You could look in the app and find out itās a gray Prius because itās always a gray or black Prius with JHK as the last 3 digits of the license plate then just tell the AI to look out for that and let you know when its here. Then ask it exactly where it pulled up and anything else youād like to know. Are you looking at the back or front of the car. Anything thatās helpful.I also filmed a scene where I was using the AI to have what was passing the window described and it did that really well too. Obviously you have to keep asking whatās out there now to make it refresh and stop describing what its describing from the last time you asked or you could ask it to tell you when it sees a landmark or something. Just let your imagination go but remember itās an LLM so will hallucinate at times and obvious network requirements etc. just be realistic and this is every bit as incredible as it appears you big flirt. lol.
Brad.
Lottie was mocking me for taking jobs away from pretty girls on YouTube. Iām clearly not a pretty girl so what right do I have to take up peoples time on YouTube. Just to explain her joke. I carried it on by saying pretty boys have to work too then Bryan amped up the temperature by thinking I have a nice accent. He should come here, thereās millions of people he could take his pick from. lol. There was a funny comment on the YouTube video, someone said I sound like the My money donāt jiggle jiggle guy which is Louis Theroux.
Oh, thanks.
I know I've said it before but I can't wait to get this in a map form, perhaps in something like voice vista, I don't know what it would look like but I'm excited.
It would be costly I assume but totally worth it.
Link to full length video.
Iām not sure if this video has content in it that isnāt in the open AI video. I think it has a little but not much. https://x.com/gdb/status/1790195202214572399?s=46
Andy, your demo, was thisā¦
Andy, your demo, was this with be my eyes or the chat gpt app?
Olly.
This was the Chat GPT app. Open AI sent a representative with the new model on her phone which I used.
I have an issue.
I've just created a new account to test chat gpt4o, i don't think i've got it yet but that's not my issue.
I can't speak to chat gpt, I've downloaded the IOS version, gone into menu then you're meant to go to new features and voices or something like that but for the life of me I can't fine it, can someone help?
Yes it reads out with voiceover but I've noticed alex clips when reading the responses.
Brad.
Iām pretty certain you donāt get voice input and speech with the free version, you might get 4o but not with the extras. I used to have a plus account and had voice input and speech but now I have a free account and those options are gone.
@Andy
just to clarify, what are all the things we are likely to get with the free account as part of 4o? I've got a paid account, but just asking.
Ah.
Yeah, I thought that might be the case.
So I'd need to pay if I wanted to use the seeing version of chat gpt with the voices, that makes sense, I'll delete this account then as it won't have any use for me.
Man, this will be the third account I remove from this survice, i'm surprised they let me make them, oh well, I don't mind; this stuff will come to an app soon that isn't gpt.
@Gokul
Here's a webpage snipet: What features are available today from GPT-4o?
For now what youāll get when you sign in to ChatGPT is access to the chat version of GPT-4o, not any of the more advanced voice or video functionality as that is āgradually rolling outā over the coming weeks starting with Plus and Team accounts.
So yeah for me, I think I'll delete my account and wait for it to come to apps.
Gokul
As Brad said, you just get the text box and the ability to use the 4O AI. You are also rate limited to 1/5 of a paid account if you switched to a free account.
Some more videos with this model and vision
Hello Andy. Can you record more videos with this model about some other use cases? Like from everydaylife?
Deniz Sincar
Sorry but I canāt. I only had the magical phone for a day. I donāt have access to this version anymore. As soon as I do though Iād be happy to.
That's awesome. It's amazingā¦
That's awesome. It's amazing that they are so interested in the accessibility aspect of this technology. I know it also helps with their image, though I do like to think there is a genuine desire to change people's lives for the better too.
if i pay
how long is "roling out over the coming weeks" i'd have thought it would be out now for paid subscribers using chat gpt
I canāt even
I am so impatient, waiting for this!
The mac app has only beenā¦
The mac app has only been released to a few people now too.
I wonder if they've announced early to beat google to the punch and are still ramping up server capacity/crossing them over to the new engine. It does seem rather vital timing.
Oh boyyyy iām just gonna leave this here.
https://youtu.be/wfAYBdaGVxs?si=iOJUSYXg-TQdtBpS
Steven.
Iām so calling mine Samantha. Along with about a billion other people. Wow, I didnāt think to try and make her laugh. I wish I had.
Damn!
the way she laughs. Slightly spooky!
I just hope the expressiveā¦
I just hope the expressive/emotive voice can be easily toned down, as I'd imagine, for me at least, that the experience of interacting with an AI tool that mimics human social and emotional behaviors could become quite fatiguing over time. The fatigue may be especially profound when attempting to complete basic or mundane tasks, which is my primary use case for voice assistants at this point.
Down the rabbit hole I go
https://youtu.be/MirzFk_DSiI?si=N4BnjMqFDZvHFb83
Where can I find it?
I have a voice mode in my Chat GPT Plus, but I don't seem to have this magic vision thing.
Also, when I use the voice mode, it appears to hear the TV and any other voices around me, and responds to those.
My last issue is that when I finish any kind of voice chat, it goes into a rating screen, and there's no way out except to kill the app and restart. I must be doing something wrong.
Karen
If they add a sexy Australian female voice, i will be sold.
Fact. š
Louise
It seems I donāt have the voice mode anymore, even though Iām on premium. Interesting. Hopefully theyāre updating my account?
The expressiveness is great!
The voice still sounds... I don't know the word, tinny isn't it but ther's a buzz there, if they can get rid of that that would be amazing!
I'm sure for those that want it you'll be able to tone it down, you'll probably have to explain that you'd like it to tell you stuff with limited emotion, but don't sound bored.
I'm looking forward to this in an app.
I had a chat gpt account... or 3, but deleted them as I didn't think I'd use them that much so hope this comes to a navigation app in the future.
Oh by the way, I really don't like open AIs policy where once you've deleted an account you actually can't use the same email address to sign up again in the future, something feels illegal there but i'm sure it's not. It is, however, frustrating.
@ Lottie
I told you I went down the rabbit hole lol.
RE: Stephen
Same here: premium and no voice mode anymore.
Yeah, she's still a bit tooā¦
Yeah, she's still a bit too verbose for my liking and the laughter, well, that's just creepy. We've evolved over millions of years to notice things that are out of place and this is probably why such things are fatiguing. I've mentioned it else where, but once we've adapted to a screen reader voice we don't actually hear the voice, we just hear the information it is parsing. It's the equivalent to going nose blind and so I wonder if it will happen here. I certainly hope we aren't stuck with US voices. I hear enough of those throughout my day. Not that I actively dislike the US accent, or the range of them I should say, but for it to be a realistic interaction it needs to be with someone from our own culture.
I'm very excited to see what Apple is going to do with this next month, should the rumours of the open AI/apple hook up is true. siri will have to have this tech or, again, it will fall behind. Google demoed something very similar yesterday and, uh oh! They have a pair of prototype glasses in the works too, though it being google, I doubt they'll be around for long.
Louise
If you're doing something wrong, I too am making the same mistake. It's the same situation with me.
Is there any way to get this premium mode for paid subscribers? or do we wait?
You just need to wait.
You youngens, no patience. Why back in my day...
RE: I still have Voice Mode
Indeed, I yesterday updated my ChatGPT app and now I have no "voice mode" available.
voice mode is back but lay-out of app is more accessible
Hi,
The voice mode is back but since I speak Dutch, I notice that the name of the buttons like "voice mode" and "send" are now translated into Dutch... Also the interface of the chat window is more accessible in general.
to Andy
Wow, that's quite an impressive demo! Thank you for sharing it with us! Do you know, by chance, if the Be My Eyes app will support this through some kind of text output? I have no issue speaking into my phone if I must, but being able to here the speech is another story. Again, thanks for sharing this with the AppleVis community! I also understand if you may not have noticed, it's an entirely different consideration and use case from what you were doing, but I thought I'd ask.
When do you think this will be available to plus subscribers
When do you think this, more specifically the voice chat feature will be available 2 plus subscribers. I myself do not have an account but would seriously consider subscribing to the Plus model
Scott Davert
Hi Scott, you are very welcome As for the UI, nothing has yet been discussed as the API still isnāt available. In the coming days and weeks I may be asking for ideas and wishes that the community would like considered in the design of the new UI as I think its important to have blind peoples voices heard as a product for blind people is being designed.
SSWFTW
Hi, Open AI said it will be rolling out in the next few weeks to plus subscribers. I havenāt got it yet and as far as I know, nobody else has either.
API availability
In the email yesterday, it said a small group of trusted partners would be getting access first.
I hope and assume be my eyes is one of these partners?
This thing really does have me so excited!
Seeing AI
Yeah, this is truly incredible technologies. Our team is hard at work seeing how we can bring this to the community, and how to make the experience even better! š
Omg!
The weight is killing me!
I felt this so much!
If it helps any (which I know it doesn't), you're not alone in this.
I want so badly to have access to this!
I read an interestingā¦
I read an interesting article pointing out how the examples given were very much like Scarlet Johanson's role in Her and that the AI was almost flirtatious and, I'm paraphrasing, coded by a horny twelve year old boy.
I don't think we really notice it much but most AIs tend toward being female, mostly developed by nerds who may, or may not, be completely socially adjusted to the world... Don't quote me on that. The danger, or so it is said, is it is reinforcing the falacy that women should be subserviant, say yes, be at our beckon call.
I was wondering what others might think on this subject, espeically women. Is it a problem, now AI is becoming emotive? Would people use an AI that only has a non-binary voice? Is sexing the AI a good idea or should we be trying to display such things as they are, artificial mimics of human nature?
Donāt think this is really appropriate
How about we just call it AI. No need to make a mountain out of molehills. What are we trying to do, cancel open AI? Omg.
Not only that,
not only that, but you can also change the voices on any sort of Text to Speech. You know what, this conversation is getting ridiculous. Iām out of it. š š¤£
Well that was a whirlwindā¦
Well that was a whirlwind...
Fair enough. this isn't really the place for it. I just wondered what peoples thoughts were. My bad. sexy AIs for all!
Reminder: Respectful and Inclusive Discussions
We would like to remind everyone of our commitment to maintaining an inclusive and welcoming environment for all members. A recent comment in this discussion has been removed as it did not adhere to our community guidelines, which emphasize respect and inclusivity.
In addition, a couple of other comments have also been removed to prevent the discussion from being taken in an undesirable direction. Although not breaching the guidelines themselves, these comments had the potential to trigger responses similar to the one that did breach our guidelines.
We encourage all members to contribute thoughtfully and ensure that their comments do not alienate or marginalize any individuals within our community.
Thank you for your cooperation and understanding.
AI learns, don't forget
Whatever the oncoming AI in your device might be and do, it will be more and do better over time, based on what you do and on what you instruct it to do. AI learns. Your own AI probably won't tell you what it learns, but you will be able to tell based on what your own device's AI does.
Down the road a ways, I wonder how many people will still be alive.
Wow. So amazing
Thats truly awesome stuff. Life-changing for so many of us. I will no longer have to feel if my dog is sitting or not, I would be able to walk around the shops and look at shop prices, etc. I donāt even care if I have to pay for it, it would be worthwhile
This would be an AI I'd not mind paying for.
I don't mind paying for this on Seeing AI, I'll see how it works on BeMyEyes and I might decide to pay for it there too.