The New BSI is Nothing Short of Game Changing...

By Ollie, 10 June, 2024

Forum
Apple Beta Releases

Hi,

Just got the IOS 18 beta on my iPad mini 6th generation and it's utterly awesome. It's turned this little device into a all in one brail computer. I'll try to explain but it's late and I'm very tired...

You start BSI with a double tap, one finger on either side of the screen. There are two modes, command mode which I'll come to, and brail mode which can be used to search anything on the screen, much like finding apps in the old version of IOS but this is system wide now.

The command mode is what is so amazing. You switch between the two with a three finger swipe but when in command mode you have all the controls you would have on a six dot input device such as progressing with dot 4, going back with dot 1, select with dot 3 and 6, magic tap with 1 5 and 6, volume up with 3 4 and 5, volume down with 1 2 and 6, and so on. It's bonkers good and makes navigating the interface a doddle.

I've not tried it for text editing yet, but even if it isn't so good i there, this is a huge update and completely changes how we can interact with our devices.

I'm rare to say this, but spot on apple, this is amazing.

Options

Your Feedback is Important to Improving Accessibility on Apple platforms

Don't assume that Apple is aware of a bug or that your report won't make a difference - submitting bug reports directly to the company helps them reproduce and resolve the issue faster. Your report may provide crucial information. The more reports they receive, the higher the priority they give to fixing the bug.

If you're using a beta version, use the Feedback Assistant on your device to submit feedback and bug reports. If you're using a public release, follow the instructions on this page.

Comments

By PaulMartz on Wednesday, July 10, 2024 - 21:07

This is as much fun as my Humanware Brailliant and requires half the hardware.

I have a question about using the find feature. I'm unsure how to select an item from the list of search results.

For example, let's say I want to quickly find the Messages app. I do a 3-finger swipe until I'm in BSI mode. Then I enter M plus E, which gives me a list of everything with that pair of letters in it. Next, I 1-finger swipe up and down through the list until I find Messages. But how, then, do I select it?

I don't press dots 3, 6, because I'm not in BSC mode. I tried a 2-finger swipe right for Enter, and that opens the app, but it also turns off BSI.

Any ideas?

By Teresa on Wednesday, July 10, 2024 - 21:07

Two-finger-swipe right for enter in Braille entry mode.

By Ollie on Wednesday, July 10, 2024 - 21:07

Re dropping out of BSI when app selected...

Have a look in the settings > accessibility > voiceover > brail > brail screen input settings. There is a toggle to keep BSI on after entry. The way it should work is, once you've input your brail and opened the app it should drop back into brail command input where you can navigate around the screen using the brail keyboard but then to search again you have to do the three finger swipe left or right to put it back in brail screen input mode. I'm hoping that's the setting you're looking for.

Yeah, I can see a lot of blind users getting iPad minis now. It doesn't have the tactile feedback of a hardware keyboard but it is far more powerful than any brail note taker on the market.

Funnily enough, I'm not finding a great use for it on the iPhone though. I think the screen is small enough that flicking and touching feel faster. Maybe it is something I could get used to, but it might also be having to physically move between screen away and screen facing between modes that is the friction point. Also, I'm encountering a bug with switching between brail keyboard and brail commander with the three finger swipe on iPhone, so I've not given it as much of a chance.

By kool_turk on Wednesday, July 10, 2024 - 21:07

I don't understand what you're trying to do. You say you go into Braille Screen Input then start typing the letters of the app you're looking for - I'll use Messages as an example. As you type out the name of the app, with each letter, the list narrows down until you eventually get to the app you want. If you do a two-finger swipe right, you're going to open the app. That's how it works. Swiping up and down cycles through a list of apps, and the more you type, that list gets smaller. I don't know about iOS 18, since I'm not using the beta. I'll wait for the official release before I jump onto that bandwagon. That's how normal BSI works; Commander is different, based on an audio demo I heard - it lets you do way more.

By Ollie on Wednesday, July 10, 2024 - 21:07

This is correct, and how BSI works on the homescreen. What they were asking was how to remain in brail mode after the search and opening of the app is done, which is what I've outlined in my previous post. The question is specific to the IOS 18 beta, so unless you have it installed, you won't have the function outlined.

By PaulMartz on Wednesday, July 10, 2024 - 21:07

I think we're all on the same page. I go to text entry mode, I type a few letters, I swipe down to the app I want. Then I do the 2-finger swipe right. That does open the app. That part all works.

I would expect it to also switch me out of text entry and into command mode. If it did that, I would be happy.

What it's actually doing is turning off BSI entirely, and I need to perform the 2-finger double tap on either side of the screen to turn it back on. That seems wrong

I'll try to play with that setting later, thanks Ollie. Got some chores to take care of first, though.

By Ayub Abraham Flores on Wednesday, July 10, 2024 - 21:07

This feature is amazing. It's like having a Braille Display right on your screen. My only suggestion is is it possible to assign our own commands to Braille Screen Input? For example, if I want to perform a long press is there a way to do this using the new Braille Screen feature using command mode?

By Ollie on Wednesday, July 10, 2024 - 21:07

There isn't. I've requested it in feedback though as we're also lacking a means of moving between containers. The standard command uses dots 7 and 8 which we don't have access to in brail screen command mode, it only being six dot. I'd suggest you make a similar request on feedback.

It's really quite copacetic, it's not without a few areas that might be improved.

By Justin Harris on Wednesday, July 10, 2024 - 21:07

The more I read about this, the more I start to question my switch to Android. Some of this sounds super cool! I don't know how much I would or would not use Braille command mode, because I am very comfortable swiping and flicking, especially on a small screen, but man, having it auto switch to BSI when in a text field, that's pretty nice. Android already does it, but in Android, switching back and forth between languages and grade levels takes a few more steps.

By Holy Diver on Wednesday, July 10, 2024 - 21:07

Justin,
I just got the beta on my SE today and this is indeed a useful new feature. I wouldn't call it game changing for me though, it's another way to do the things I'm already doing on the screen. I don't know if there is a way to turn on single letter quick nav for BSI, that would elevate this from useful to game changing for me maybe but I don't see any way to emulate dots 7 and 8. I need to test it out more but for me this makes BSI on iOS a little more useful than android assuming it's stable and such. It's not a dealbreaker for me in its current form though, we need the full eight dots.

By Justin Harris on Wednesday, July 10, 2024 - 21:07

Gotcha. I don't know how much I would really use the command stuff, but between these innovations, plus some apps just being better on iOS, (looking at you facebook, youtube, Goodmaps Outdoors and Chime mobile banking) I am kinda thinking about seeing what I can do next month. Any idea what phones are compatible with iOS 18? I don't want to get locked in to a payment plan, and the SE is a bit small for my liking, but I could make it work if that's all I can afford. I also have the Galaxy Watch 5 Pro which is not technically compatible, but with an app called Merge, it can be made to kinda work with iOS, which is good because I like the look of the galaxy watch better, and don't use it for much more than just a talking watch and stopwatch. It does fitness tracking too, but pretty sure that won't sync up. Oh well. But iOS 18 sounds like it's gunna be super awesome.

By Holy Diver on Wednesday, July 10, 2024 - 21:07

Yeah facebook on android just took a massive accessibility nose dive, I think I get it. I’ve decided for myself I really need a foot in both camps to minimize inaccessible apps, it feels like a crap shoot . As far as immediate workarounds for android facebook I’ve found talkback’s image recognition works a lot better with the screen shown and brightness turned up a bit. It's annoying but it helps. Also another issue with the new iOS BSI is you can't do the space + f command for searching long things and on the web you can't do the BSI item search because it just wants h to move by heading etc. .

By Ollie on Wednesday, July 10, 2024 - 21:07

I've got a cheap android phone to split the difference. An example was using the much maligned sonos app and wanting to turn on loudness on my Roam 2, this worked on android, not on IOS, though that has changed in recent updates.

Yeah, and regarding the new BSI on iPhone, as I say, I'm not convinced it is a gamec hanger there, it is, for me, on the iPad though. It's turned a overblown iPhone into something specific and different. It's a computer with a an almost full operational virtual brail keyboard built in. . I don't know if it would be my only choice, I do like using my Vario Ultra with my iPad and the output and improved input that brings, but it I could certainly use the iPad mini a lot easier for short emails, browsing the internet etc. Casual use, I think is the best use case for the iPad. Chilling on the sofa.

By Mert Ozer on Wednesday, July 10, 2024 - 21:07

Hello folks,
After hearing about the new BSI improvements in iOS 18, I decided to try them out. Although I'm not very familiar with Braille screen input, I've known Braille since I was 6, so I figured I could pick it up quickly.
And, oh my gosh, this new feature is a game-changer for me, just like for many of you. I really appreciate what Apple does with VoiceOver on iOS, but I want to point out a potential bug to make this feature even better.

Steps to reproduce the issue:

1: Open any app where you can navigate in Braille command mode. We'll use the native Notes app for this demonstration, but it could be anything.
2: Activate a text field and start typing using Braille screen input.
3: Type a word, like an email address or your first name, but do not add a space after typing.
4: Activate command mode with the swiping gesture.
5: What you will notice is nothing appears in the text field. If you add a space or deactivate Braille screen input with the pinching gesture, the text will appear.

I believe that after adding a space or exiting Braille input by pinching the screen, the typed text converts to plain text and appears on the screen. But if you don't add a space, the text disappears.
Adding and deleting a space takes just a fraction of a second, but in some fields like phone numbers or emails, you can't add or delete spaces. This workaround saves the day. I think Apple should make the conversion happen not only after adding a space or new line or exiting BSI but also after switching to the command mode. This would prevent issues when editing text in command mode.
Do you guys have the same issue? If so, why not create feedback and send it to Apple?

By aaron ramirez on Wednesday, July 10, 2024 - 21:07

Hi.

The reason this is happening is because the braille you type doesn't get translated to text until you either hit space or exit braille screen input. If you're switching to command mode, you should do a two finger swipe down to force translation of whatever you just typed.

I've submitted feedback suggesting that translation should always be forced when switching to command mode, but as of now it hasn't been added yet.

By Teresa on Wednesday, July 10, 2024 - 21:07

If I'm sending a text message or other messages in chat apps, and I swipe up with three fingers in Braille Entry mode, the text is translated.

By Holy Diver on Wednesday, July 10, 2024 - 21:07

I may have been too dismissive earlier, this is a lot faster than your standard flicky swipe left right dance. I sort of wish they used the left and right swipes for enter and backspace instead of rotor navigation, it's redundant with existing braille commands..but I see the other side there too. More than that though I want the F-chord text search command to work, either that or make the existing item search work better in large documents. Still it works on the Braille display, it should work here and would elevate this from useful to game changer level for me easy.

By Sabrina on Wednesday, July 17, 2024 - 21:07

I lmrc tfis. It is fantastic. I have been using it all day and it is just.. wow! I love it. It took a while but was easy to learn. There are a lot of adjustable things in the settings and that has things I find really useful. And we finally have keyboard clicks now which is great because now I have turned off typing feedback altogether as I only had it to know I was writing.

By Sabrina on Wednesday, July 17, 2024 - 21:07

I actually have tried it with google docs and I think it is great. This did not work before but now that I can move ,ehind lines it is breeze.