Voistant: a new AI powered voice assistant

Hi Martijn,
I just installed your Voistant app. I managed to register, but it didn't seem to hear any of my commands at all. I wasn't given any instructions about how to configure my microphone, so I assume my microphone was working by default? I don't know if it was or wasn't. Usually my microphone just works when I use it for Google Meet or Microsoft Teams, but even if it doesn't work for whatever reason, I can go and configure it. I opened a webpage, and told Voistant to solve a Captcha, but it didn't hear anything I said. When I tried speaking after the beep, it kept saying, 'something went wrong'. I much prefer being able to type to things instead of speaking anyway, but that's a personal preference thing maybe. Also, when it reads the commands or instructions, I'd love it to use my screen reader voice, and not Sapi 5. But anyway, it doesn't pick up my microphone at all. I'd love to try it out but can't. I should point out that after registering, it gave me a brief description of my screen. It told me there were desktop icons, but not what they were, but I didn't question it further because I wanted to see if it could solve a Captcha. I'm on Windows 11, the latest version. I much prefer what Guide AI Assistant for Windows is doing, yes it's only text input for the moment, but I like being able to type much more than speaking to things. I don't know if you've seen that, but if your assistant could provide a way to type and speak, and a way to configure the microphone, that could be a promising competitor. Check out Guide.
https://www.guideinteraction.com/
That's the sort of thing I'd use and do use.

It can't be just click here and there. I would be only interested in a solution like this if it had capability to perform complex actions.
For example, navigate to Amazon, find me highest rated lavender perfume under $50, purchase and use my default payment method and address.

Hi,
Yes, Guide AI can do some of this, it bought something from Amazon when I was signed in. It clicked on the correct product and the 'buy' button. But at the moment I can't test this Voistant app since it doesn't even pick up my microphone, or hear when I speak to it.

Hi Martijn,
I tried to log back in again, but it said my email address wasn't recognised. Was I supposed to get a confirmation email? I didn't receive one, and I checked my junk folder too. But when I tried registering again, it just logged me in, with my settings I'd saved like the interrupt key as the CTRL key. The things I can type in the terminal are 1 or 2 for registering and logging in. There is no edit field visible, I can just type, either 1 or 2, but no edit field. After logging in or registering, the microphone finally works, and it's just now heard me. I just asked it to describe my screen, and it described this page. I tried asking it to describe a Captcha, to tell me the letters or numbers, but it said it couldn't solve Captchas or something. I'd rather have the option of switching between some sort of voice mode and text mode. For example, I want to be able to navigate through my commands and the assistant's answers without it reading everything out in the SAPI 5 voice. If I try to type a question in the terminal window like, 'describe my screen,' I don't know if anything is being typed or not, and when I press Enter nothing happens. NVDA doesn't announce letters like it usually does, and there just seems to be a blank Window, not an edit field like NVDA would usually announce. If you haven't tested this with NVDA, I'd strongly recommend you do so, because then you'll know what I'm talking about.
Thanks.

I have a question. Is this a matter of computing power, or is it specifically an issue with the mobile platform? I’m only wondering why you didn’t start with mobile first, since you already have a big fan base here, and then later transition to computer. It seems like most people would be using these tools on their phone rather than on a computer, but I could be totally wrong about that. I’m really wondering why we don’t have these products available yet for the iPhone.

Hi Winter Roses,
I use Guide AI Assistant on Windows, primarily to solve Captchas, and I've used it in the past to get passed inaccessible cookie banners, and to describe screens, and help me navigate more difficult websites. So yes, this sort of thing is definitely useful to have on a computer. In fact, I keep Guide around now in case I come up against something inaccessible like a website or app. But this Voistant app can't seem to solve Captchas at the moment. The idea of these types of apps is to use your mouse to click on things that aren't accessible with a screen reader, like buttons and so on. For a better idea of this sort of thing, see my thread about the Guide AI Assistant I created a few months back on here.
https://www.applevis.com/forum/windows/guide-ai-assistant-people-who-are-blind-or-low-vision
As for why this sort of thing isn't available for an iPhone, Apple is funny about letting apps control your phone and sharing screens etc.. I think Android is probably more open to this sort of thing.
And also for Windows, there's the Viewpoint assistant, an app that brings inaccessible buttons and links into focus so you can click on them with your keyboard.
https://viewpoint.nibblenerds.com/

But like Tara mentioned, I'd prefer a way to input text rather than speak to it all the time, for example, in say, an office setting.

I think any user agent that can do things efficiently could be useful. As long as it has way to also type ut instructions as well as speech. I’d pay for a subscription if it worked well.

hi! can not login again and i receive error!

after i enter otp i got error from lib connection line 198

Hi, when can we expect a Mac version to be available? I'm a Mac user, and I would like to test it once it becomes available.