Hey Everyone,
I built an accessibility app called EyeGuide Vision, designed to assist visually impaired individuals in navigating their surroundings using just their mobile phones. As you’re aware, the iPhone features Lidar, which is effective in identifying obstacles even in complete darkness. I’ve combined this technology with various other sensors that our phones have to achieve this. Besides turn-based navigation, I’ve included helpful features such as a scene description mode (describes scenes in detail), color detection (identifies colors by just pointing the phone close to them), and money detection (identifies money when you point your phone to currency notes). The app is completely free, works without internet, and is entirely on-device.
My plan for later in the future is to have it integrated into smart wearables like the Meta Raybans and other manufacturers, but not just identify things like Be My Eyes and aira's integration, but to assist in avoiding obstacles while walking in real-time, just like it currently does on the phone version. I’m continually adding features as needed and hope it receives the recognition it deserves and reaches the right audience.
I'd be honored to get as much feedback as I can to make it great and worth your time.
You can check it out on both iOS and Android using the following links.
https://apps.apple.com/app/eyeguide-vision/id6752293641
https://play.google.com/store/apps/details?id=com.eyeguide.app
Comments
Will this only work on the pro models?
Since you mentioned the app uses LIDAR, does that mean it will only work on the Pro models? It sounds interesting and I'd love to give it a go, but I have a 16E.
Reply: Will this only work on the pro models?
It works on all versions of the iPhone even though it was originally designed for those with LiDAR. Only difference is that it might not be as accurate in dimly lit environments. The app would notify you of this anyways If it identifies dimly lit rooms.
All these navigation apps
Hi. A couple of things here. Firstly, I've been in many situations where, if I'd had my phone in my hand, it would probably have been knocked out of my hand. Also, a blind person must have a mobility aid too, technology cannot safely replace a cane or a dog, so that means no spare hands for anything else, like operating crossings, sorting bus tickets and passes or whatever. I've also heard of plenty of situations where people, including blind people, have had phones stolen from their hands in public places, particularly when it's crowded like at bus stops. Also, most journeys, for me at least, involve public transport, and so many of these apps are based around walking only, or walking or driving. Rather than a purely on device app, what I need is something that more accurately does what Wewalk tries to do, as in be a ble to give me turn by turn instructions, plus feedback on my bus or train arrival time and when to get off, all while in my pocket, not using the camera. I need it to be able to tell me what bus is approaching my stop too, and be inteligent enough to recalculate the journey if a different bus than scheduled turns up, that still gets me to the stop I need. Honestly, Google Maps is more help than any of the specialist apps for journeys at this point. I know laniards are a thing, but they are of limited use when it's pouring with rain. I'm saying this to say, I hope you can bring something different to this very crowded field, something that goes beyond the sighted thought that technology can do everything, because, honestly, it can't, I'll always need physical feedback about my environment, whatever technology can add.
Reply: All these navigation apps
Hi David,
I totally hear where you’re coming from, and I appreciate you sharing those concerns with me.
I like to think of the app less as a strict "necessity" and more like a versatile utility belt, it’s there to give you an extra hand whenever you need it. It’s really about those everyday "wins" that make life a little smoother. For example: Being able to instantly tell which shirt is on the bed, exactly how much cash you’re holding or having a tool that can describe a room or identify what’s right in front of you on the fly.
Regarding mobility, if holding a phone feels like a hurdle, a chest strap is a great way to keep your hands free while you move around. The navigation part is there to help you avoid hitting obstacles while giving you suggestions on where to turn while being offline and no device, especially in a world where data is the new currency and privacy was once a thing.
I’m also hard at work ensuring the app plays nicely with the wearables you already own, while developing new, affordable hardware like smart glasses to make the experience even more seamless for everyone.
I'm excited to keep building this with your feedback in mind!
Haptics and points of interest recognition
One thing I have noticed about many apps and devices is they assume hearing (sound) is the optimal medium. This is not always true: some of us are hard of hearing; and for others the environment can still be noisy. Very few apps maximize, or even use, haptics effectively. HapticNav is one I have read about that is exploring this more; though I do not know if it lives up to its hype as I've not had an opportunity to get a route programmed into it via its inaccessible map. An app that is able to combine haptics of the phone, and even better a wearable such as the Apple Watch would be welcome.
One thing I have wondered is if there is a way, perhaps via a machine learning model, to combine GPS or other location info with images from a camera to get more accuracy on points of interest. Many GPS apps have POI features where you can drop a pin. However GPS is often accurate to only about 20 feet (6-7 meters). And of course GPS is useless indoors. As a cane traveller for me this distance can still be a huge problem especially if what I really want is a series of POI to navigate through a largely open area that has no landmarks for the cane. This is a big challenge, but a possible differentiator for the app that can do it. I think Seeing AI and Clue? both have explored images/video for indoor navigation in recalling routes but I do not know if either mastered it. And I do not know of one that has tried outdoors.
I have to say I completely agree with David here
I have to say I completely agree with David here. There’s plenty of times we’re traveling with our phone in our hand would not be safe. I’ve been totally blind since birth and I use a cane and there’s really no technology that can replace your awareness in your skills of your orientation and mobility really can’t be replaced by any technology no matter how good it gets. I also think there’s like almost an overcrowding of these types of apps in charge to differentiate how much better one than the other without having multiple apps on your phone to try to achieve something simple complicated traveling.
I agree with David
I agree with David. There’s really no way that technology can replace mobility skills. I have been totally blind since both and I’m a traveler. I would definitely not be walking around holding my phone in my hand. Totally not safe as far as I’m concerned. There’s also kind of an overcrowding of all these types of apps. Every one of them claims to be so good with navigating people and it’s just hard to know which one to do cause it’s just too many of them. I think I’m not interested in any wearables so that’s another aspect of things. I don’t wear glasses so I wouldn’t wear glasses either.
RE: EyeGuide Vision
Hello. Will this app detect objects that are above the waist? Also, if I am standing in a line, and the person in front of me moves, will this app detect this? Will it be able to provide me directions for a route that I might want to take? And, would it be possible for it to tell me when the Pedestrian signal has changed? Thanks.
couple of suggestions
horizontal and vertical detection should be adjustable, right now, they appear to be identical. horizontal detection range is ideal for now, i.e., maneuver through narrow pathway, vertical detection is obviously too narrow, obstacle placed higher or lower is missed. example, you won't see a bench or yellow police tape.
about the haptic feedback, as far as i can tell, it uses different intensity but the same frequency. intensity can be harder to discern, maybe adding different frequencies would be more helpful.
in settings, i suggest increase the adjustable range for obstacle sensitivity and beep threshold, super helpful for fast movers.
also, "stay awake" should be applied to scene description as well, sometimes you listen to the description and the phone just locked up in the middle, in fact, why not why not stay awake when the app is open?
Android App Feedback
As the play store link to the app was posted here by the developer, I am here to share my thanks.
It's working nicely on my S23 Plus. Also enjoing the interface.
Lidar Android phones have seenm to be experimental, considering many do not exist now (if at all.)
I'm not expecting an app like this to replace something. It's meant to be an extension. for example, gps app alongside this one. works quite well outside by the way.
A couple thoughts
First, I wouldn't try using the app in my hand in crowded locations, but there are many settings where it would be helpful and safe.
Second, the more user programmable apps like this become, the better for the user. For example, having a list of items in app settings with checkboxes to indicate whether the user wants certain things spoken would be good, and the same for haptics.
Third, user defined haptic patterns would be great, since the user knows best what works for that user and what doesn't, such as safety related information in noisy situations.
Fourth, yes, a chest strap works, and so do short pockets with the phone positioned so the camera is exposed. I use polo shirts for this
Fifth, I forgot to check, does the app include a compass that gives information while walking through those large spaces someone mentioned?
Sixth, I also vote for programmable POI. Why not?
Seventh, glasses are definitely a great way to go, especially if the information they report is also programmable.
Ninth, what comes after seventh? I'm not very good in math.
Reply: A couple thoughts
Dear Bruce Harrell, thanks for dropping your thoughts. To answer your questions regarding the compass, it doesn’t but this looks like something I can add moving forward. Same with the user configurable haptics where they can fine tune it.
Reply: Android App feedback
Dear Trenton Matthews, thanks for the feedback. I’m glad you had an amazing experience!
Reply: couple suggestions
Dear Laboheme, thanks for the suggestions! I’ll be adding them to the next build. So excited for all the feedback so far.
New feature Request
First of all, thank you for this excellent application! It's very helpful to me. Could you consider adding a road detection feature? As a blind person, walking on the road can be very difficult. If possible, please add this feature to the application.
Walking with EyeGuide
I've installed EyeGuide on my iPhone 14+. Can you direct me to precise instructions if I want to go for a walk and use EyeGuide to identify overhanging branches or Street level obstacles?
Reply: Walking with EyeGuide
Dear Alexss, using EyeGuide is as easy as holding the phone with the rear camera pointing away from you. it does the scanning of obstacles and people automatically. another suggestion would be to use a chest strap if you need to free your hands.