W.A.R. stands for Wearable Assistive Reality – a device that has eyes to see (a camera), a mind to think with (apps running locally and online services) and a mouth to speak (binaural audio output). Unlike an Augmented Reality device, an Assistive Reality device designed for people with no useful vision doesn’t need a screen. Nor does it need some yet to be developed display technology such as ‘smart lenses’ or neural interfaces.
It would, of course,, suffer from issues around battery life, processing power, connectivity and size.
If you are thinking that the ideal Wearable Assistive Device for a blind person is a pair of glasses, your right or at least you are almost right:
A pair of glasses is a great way to mount a camera that points where the person is looking and a speaker for each ear. This is true for Augmented Reality devices to – with the addition of technology to overlay digital information on the real world. They provide a familiar, socially acceptable way to hold the camera in line with the wearer's gaze. Plus, they have space for speakers that keep awareness of surroundings, which is vital for a visually impaired person. a Wearable Assistive Technology device will include:
1. A head-mounted camera acting as the ‘eyes’ of the system.
2. A smart phone running a range of local services, with access to online services for more complex task – the mind.
3. Stereo speakers to provide spoken information and binaural audio feedback.
It's important that the camera has the ability to capture images and video in diverse lighting conditions for the AI to analyse effectively. Local Services are key for fast, essential tasks: object recognition, text reading, navigation basics. Online Services: Cloud-based AI would enable complex scene description, facial recognition, or accessing detailed information. speech output should be clear and easy to understand in various sound environments. Binaural Audio is crucial - 3D audio cues add another layer of environmental perception for the wearer, improving their understanding of their surroundings.
Beyond Augmented Reality:
W.A.R. shifts away from the visual augmentation model of AR and instead focuses on providing a comprehensive assistive experience tailored to those with visual impairments. This focus opens up exciting possibilities.
The Sensory Triad:
The eyes (camera), mind (apps/AI models), and mouth (audio output system) creates a helpful framework for understanding how a W.A.R devices could function as a surrogate for vision.
Additional Considerations
Design: Discreetness and comfort are paramount. The design should avoid bulkiness and blend seamlessly into everyday life.
User Interface: An intuitive, minimally invasive way for the user to interact is critical. Voice commands and perhaps subtle haptic feedback could be solutions.
Ethics: Careful thought is needed around privacy (for both the user and those recorded by the device), as well as responsible AI development to avoid biases or misinterpretations.
The Future Potential
The concept of W.A.R. is incredibly promising. As battery technology, processing power, and AI capabilities improve, this kind of device could become a truly transformative tool for the visually impaired community. It has the potential to provide Increased Independence: Improved navigation, object recognition, and access to information. Enhanced Social Interaction:
Facial recognition and real-time scene descriptions for social situations. Greater Integration: Empowering users to take part more fully in work, education, and overall experience of the world.
Today
There are currently four or five candidate technologies on my radar: from low-cost Ray-Ban smart glasses from Meta, to the MyEye from Orrcam costing many thousands; the Seleste smart glasses, which are offered on a subscription basis that is more like traditional leasing schemes; to the Envision smart glasses, like the Seleste model, but without the option to subscribe month-by-month.
Comments
Guide Robots
Wrapped in acrylic fur might also be an option. Perhaps, a mobility drone, watching from above, and bothering everyone with the noise.
I'm not completely convinced that glasses are the only way to hold a facially-aligned camera for the AI, but they're probably the most universal and least expensive/intrusive/socially-awkward. Second up might be how people put pens and pencils or other cylindrical objects behind their ears. Perhaps, even ear pods could be fitted with cameras, if they stick out enough. (Na! That's dork-ware.) Jewelry implanted with cameras, perhaps... Just pondering it.
I'd highly recommend staying away from Orcam.
I find them very clunky and they're not for navigation, the OCR is really really fast though so I'll give them that.
Hey Lottie, have you heard of site village, i think they're in Bermingham and London once every year. I can find more info and message you using your profile if you don't know about them?
God I'd love a robot guide dog or something like that.
I'd not have to ware something on my face andI just like the idea.
I'm not an animal person but I've longed for the day something can just walk me to the shop and back, man I'm only 30, I can't wait to see what happens in my life when it comes to tthis stuff.
Something like that
They do have robot birds now, so a guide AI parrot that sits on your shoulder, turns its head when you turn your head, and could also launch for a different view. Anyone remember the old, salty, Swedish sea dog scene in Revenge of the Pink Panther...?
That aside, If Apple devices are now tracking eye movements, something could also track head movements, like proprioception, and the camera/cameras might not have to be worn on the face. A necklace or clothing, perhaps. There was that blind lady in the Star Trek episode, "Is There in Truth No Beauty?" with the Medusan, who had the sensor clothing.
The only good thing about Orcam
Is the invisable watch! If you turn your wrist and look - Orcam announces the time.
Seriously, the idea of a little thing you clip to your own glasses is good, but I spoke to them in 2022 and it hadn't changed since 2018! For something you can upgrade the firmware on, that is criminal. And, it does facial recognition, but only with live people - you can't send it a target list. Whic is kind of ironic really!
Brad, I've not ben to a Sight Village in years, but thanks for letting me know about it.
My payment for Seleste glasses has gone, so I'm all in!
Did you see that video with the dog?
The BD one, talking, taking people around an exhibition? It was so cooool.
There's a trial of robot dogs goig on at Glasgow University - the- only work in doors though.
Remember the UTility/UTool…
Remember the UTility/UTool Although...Brilliant labs do offer a Monocle as welll as glasses!index!
BellaBot
There's a local restaurant that has a BellaBot for waiting tables. Quite cool. If you aren't familiar, it's worth looking up.
Robot guide dog? Great idea. I'll name it Helen Killer.
e funny thing about this post...
I got a note about using performance enhancing technology to write it. the funny thing is...there is no evidence whatsover that anyone commenting has read it.
I mean, Assistive Reality isn't even a real thing. I made it up!
The other day I made a great joke about H P lovecraft and nothing!
I read it.
But didn't really know what to put :)
But yeah, War, did seam a bit of a strange, wassename, anagram? Word thing that has letters that means other word things that start with those letters all add up so the first word thing makes sense, yeah; that.
I'm so good At Englishing ain't i?
Strange...
I thought I read it. It sounded like futurist speculation, and so just kept going with the speculation.
I wouldn't mind having a robotic, guide Cthulhu. May we be among the first eaten!
I wonder if the talking dog could also read things for me, and if they have more dog-like-sounding voices.
The future is arriving on Wednesday
The first of the candidate technologies I mentioned in my article above (Meta Ray-Ban smart glassses) will be with me next week.
For anyone interested, a link to the title page of my trilogy of post about wearable technology and the blind follows. part two is fiction:
https://charli.info/2024/02/23/harmony-in-technology.html
audio cues
A point to add here: one important thing any future wearable device of the kind we're talking here should take care is to make the audio output as less invasive as possible. I mean, blind people, especially those who were born blind or who've had no/little vision for a long time instinctively use a lot of auditory things even without conscious knowledge to make sense of their surroundings. My problem with any device having a speech output, especially in an outdoor environment/when you're dealing with a lot of people etc is that having speakers/headphones etc takes away from that ability. The way to go therefore would be to have bone conduction integrated/increased dependence on tactile feedback for certain things/ an optimum combination of using the different senses so that the ears are left relatively free to pick up cues from the surroundings.
Worth being a blog post...
Just my thought, but... Why didn't you create a blog post on this instead?
Thanks!
Dominique?
Have you any suggestions for what you would like it/me to say? I'd be happy to write more, with a little encouragement. I'm afraid the only encouragement I've had so far, is not to waste any more of my time on this subject.
Time talkng about it here that is. IRL I have Meta Ray-Ban glasses arriving this week and am a Seleste customer to.
riobotic guide dog or other robotic assistants
As others have said, I'd happily look into getting a robotic guide dog if they ever become available. I'm also hearing rumors of human shaped robots that might be able to read mail, provide mobility assistance, and maybe even do basic house cleaning. I seriusly doubt that such robots will become affordible in my lifetime, but it's fun to imagine, and the future looks very promising.
Hey Lottie
I wanted to pipe in and say thank you for sharing your thoughts on this. I think we're at an exciting time where technology could be poised to make a leap like when iPhones came out with Voiceover built in. AI has so much potential, and I appreciate when people take the time to share well considered thoughts.
I hope this ccounters anyone who was rude enough to tell you that sharing your ideas and point of view with our community is a waste of time. A well considered and interesting point of view is never a waste of time.
Thank you Louise
It is great to hear you think I'm adding something to what, we've all seen, is the hot topic of the week/mlnth/year? I'm with you, we are at or almost at the point were assistive technology stop being mobile and becomes wearable!
I've been waiting for this for years. That's why I am so excited!
To excited if I am honest - I've got Meta Ray-ban glasses coming this week and the Seleste within the month.
I have to stop, I'l run out of money!
Lottie
XOXO
I can't wait to see what you think of the Meta Glasses
I want Meta glasses too. I ordered Seleste, but might just have to get both. LOL
close, but no cigar
There are now products that are closer than ever to my vision, but they all have flaws, fatal flaws in most cases. I am starting to wonder if it is me? But no, I know that is just self doubt creeping in. it is frustrating, I could put the perfect device together now, from bit of 3 or 4 existing products...if it was possible.
I know it was a joke, but AirFrames with a dev kit is what is needed to make my dream a reality - in the absence of that, it is time to start making compromises.
Why I don't do reviews
I follow the Verge and they won't review unreleased features. they believe you shouldn't review a product on promise...if it is going to be fixed later, then they will review it later. That is, in my opinion, the best way to review a product and it is hard with this sort of technology.
Feelings come into play, our own and those of the people making the products, who we might even know! Everyone has different circumstances, money means different things to different people, depending on how much you have.
A review needs to take into account the needs of most people, most of the time. I have two products next to me at all times at the moment - the Meta Ray-Ban smart glasses and the Seleste smart glasses. I have bought the Meta glasses outright, but I need to decide if I m goign to keep the others and pay a $50 a month subscription. I don't know what I am goign to do yet, but it will be my own choice, for me, I don't think I will be able to advise other individuals on there choice - but I will be able to suggest what most people should do, most of the time!
I look forward to your reviews.
I understand what you mean and totally agree with your comments. I think we are very close to the excellent product. Still, I look forward to your comparison at the right time for you.
Speakers for binaural/3-D audio?
Headphones should yield far more satisfactory results.