Skip to main content

Seeing AI app to ‘narrate the world to blind people’ gets handwriting recognition and more

I was really impressed when Microsoft launched its iPhone-only Seeing AI app designed to ‘narrate the world’ to blind and visually impaired people. The app uses AI to recognize what it is seeing, and turn that into an audio description …

Version 1 already had some amazing capabilities, including recognizing friends, guessing the emotions of people from their facial expressions, reading printed text and identifying products from their bar-codes. But version 2 adds four new capabilities.

  • Color recognition: Getting dressed in the morning just got easier with this new feature, which describes the color of objects, like garments in your closet.
  • Currency recognition: Seeing AI can now recognize the currency of US dollars, Canadian dollars, British Pounds and Euros. Checking how much change is in your pocket or leaving a cash tip at a restaurant is much easier.
  • Musical light detector: The app alerts you with a corresponding audible tone when you aim the phone’s camera at light in the environment. A newly convenient tool so you don’t have to touch hot bulbs to know that a light is switched off, or the battery pack’s LED is on.
  • Handwriting recognition: Expanding on the ability of the app to read printed text, such as on menus or signs, the newly improved ability to read handwriting means you can read personal notes in a greeting card, as well as printed stylized text not usually readable by optical character recognition.

Microsoft says that the app has so far seen more than 100,000 downloads and helped with three million tasks. The company gave an example of how it’s helped one user.

Cameron Roles, a university lecturer at the Australian National University College of Law, believes there’s never been a better time in history to be a blind person.

“I absolutely love Seeing AI. If my children hand me a note from school or if I pick up a book, I can use Seeing AI to quickly capture that text and just give me a very brief instant overview of what’s on the document,” said Roles of the important capability the app has for reading text and handwriting. “I can quickly be right on top of it.”

Seeing AI, which is currently iOS-only, is a free download from the App Store.

FTC: We use income earning auto affiliate links. More.

You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

Comments

Author

Avatar for Ben Lovejoy Ben Lovejoy

Ben Lovejoy is a British technology writer and EU Editor for 9to5Mac. He’s known for his op-eds and diary pieces, exploring his experience of Apple products over time, for a more rounded review. He also writes fiction, with two technothriller novels, a couple of SF shorts and a rom-com!


Ben Lovejoy's favorite gear