Facebook has announced the launch of ‘automatic alternative text' to help blind people ‘see' Facebook.
“While visual content provides a fun and expressive way for people to communicate online, consuming and creating it poses challenges for people who are blind or severely visually impaired,” says Shaomei Wu, software engineer and Hermes Pique, software engineer on iOS and Jeffrey Wieland, head of accessibility at Facebook in a company blog post.
“With more than 39 million people who are blind, and over 246 million who have a severe visual impairment, many people may feel excluded from the conversation around photos on Facebook. We want to build technology that helps the blind community experience Facebook the same way others enjoy it,” they explain.
Automatic alternative text, or automatic alt text, generates a description of a photo using advancements in object recognition technology. People using screen readers on iOS devices will hear a list of items a photo may contain as they swipe past photos on Facebook.
Before today, people using screen readers would only hear the name of the person who shared the photo, followed by the term “photo” when they came upon an image in News Feed.
“Now we can offer a richer description of what's in a photo thanks to automatic alt text. For instance, someone could now hear, “Image may contain three people, smiling, outdoors,” the company says.
The features is possible because of Facebook's object recognition technology, which is based on a neural network that has billions of parameters and is trained with millions of examples. Each advancement in object recognition technology means that the Facebook Accessibility team will be able to make technology even more accessible for more people.
“When people are connected, they can achieve extraordinary things as individuals and as a community — and when everyone is connected, we all benefit.
Automatic alt text will launch first on iOS screen readers set to English. The functionality will be made available in other languages and on other platforms later, the social media giant says.
“While this technology is still nascent, tapping its current capabilities to describe photos is an important step toward providing our visually impaired community the same benefits and enjoyment that everyone else gets from photos.