Amazing! I Can Read!

One small step for me. One giant step for the visually impaired.

We went out to eat with friends, and for the first time in five years, I was able to read the menu.

Amazing!

the restaurant menu

How? By using the META RayBan glasses. That was in early December and since then, I have been learning how to use them.  Here is a summary.

The glasses use a camera built into the frame that connects to META artificial intelligence from the internet via my iPhone. With the glasses on, I picked up the menu and commanded, “Hey META, what am I looking at?” I heard a camera shutter click and  three seconds later, “You are looking at a menu from a restaurant or cafe. It appears to be a brunch menu, with various food and drink options listed.” (See the full AI exchange below.)

Fantastic!

As I understand it, the camera takes a picture, sends it to META.AI, who processes the data and reports a summary of that image.

Wonderful!

It has taken me time, but I have learned some prompts to use to proceed past summary and have it “read” to me. I have also learned there are limitations as to stability, connectivity, and how much it can process. But when it is working, I can listen to music, take photos, videos, send text messages and make phone calls, as well as search the internet, all hands free.

Me taking a photo with my Ray-Ban glasses

I take it to museums to read the wall text. I use it to read package labels and some mail. I take it with me when shopping, where it explains the labels.

But there’s more. META has also partnered with Be My Eyes.  This is a free app that uses the phone to call a volunteer who assists me based on whet they see from my camera. I used it for the first time last week at Trader Joe’s when I had four items I could not find. The speakers are built into the frame and sit right above each ear. The quality is excellent and surprisingly private. 

Fantastic

All of these features result in a HUGE advancement in accessibility for me and the VIP community.

And this is just the beginning.

EUREKA!

My AI sessions are recorded on my iPhone META View app.  (Screenshot below You can’t read the screenshot? Okay, here is a recording made with Voice Over.)

.

cafe menu
Screenshot of the MetaView app settings page.

.


.

2 Responses

Leave a Reply