Home / Knowledge / News / Apparel/Garments / Taobao unveils tech to help sight impaired shoppers

Taobao unveils tech to help sight impaired shoppers

Feb '19
Courtesy: Alizilla
Courtesy: Alizilla
Taobao, China’s largest online marketplace, has unveiled technologies to make shopping more accessible to blind and partially sighted. These technologies help navigate the site designed specifically for this population. One such technology is Optical Character Recognition, which is an artificial intelligence-driven feature that reads text written on images.

Optical Character Recognition (OCR) was introduced last October. Before adopting OCR, Taobao’s 300,000 daily active users who are blind or have reduced vision would have used screen-reading software that simply announced “image” as it scanned the page. By early December, OCR was being used to read close to 100 million images per day, Taobao said.

“Images are becoming ever more important in the shopping experience,” said Wang Yongpan, the algorithm specialist that led the OCR upgrade. “A typical product page on the site contains about 40 images, and most product specifications and descriptions are often found within images, rather than typed out in plain text.”

Yongpan noted that while Alibaba has been using OCR for many years in various capacities, the technology’s accuracy in reading images has grown exponentially thanks to advances in machine learning. Now, that accuracy is being put to work for the disabled.

Taobao’s Optical Character Recognition technology helps visually impaired consumers read both the text and images on each page.

For 31-year-old Zheng Rui, who is among the 285 million people worldwide recognised by the World Health Organisation as living with some form of visual impairment, accessibility technology brings more than mere convenience.

“Barrier-free shopping helps us live more independently, with dignity,” he said, adding that shopping at brick-and-mortar stores can be an awkward and troublesome experience for the visually impaired. He gave the example of women buying feminine hygiene products, who might feel embarrassed about seeking help from others, such as male family members or passersby, to pick the right product.

Today, Rui is his family’s chief shopper, procuring everything from household necessities to toys for his 1-year-old child. He can complete all the steps in the buyer’s journey, from searching for the product to payment, in less than a minute.

Making the platform more inclusive, user-friendly and a home for creativity is part of the larger strategy outlined by Taobao President Jiang Fan last May.

“If I had to do one thing this year, that would be to make Taobao simpler and bring [us] back to our original purpose,” Fan said. Alibaba is famously known by its motto, “To make it easy to do business anywhere.”

The OCR launch was driven by the company’s “Barrier-Free Lab,” which started with a handful of employees in 2011 and has since grown to hundreds of volunteers, ranging from programmers to user-experience designers.

Now, similar tools can be seen across Alibaba’s ecosystem, expanding from Taobao to B2C e-commerce site Tmall, payments affiliate Alipay, online delivery platform Ele.me, enterprise chat app Dingtalk, navigation firm Amap, music streaming app Xiami and internet browser UC Web, from desktop to mobile.

Last November, DAMO Academy, the e-commerce giant’s $15 billion global research programme, revealed that it has been working with China’s Tsinghua University to improve the smartphone experience for the blind and partially sighted. Smart Touch, one of their latest innovations, is set to launch later this year. Users pair a specially designed mobile app with a silicone film on top of their phone screen for a new, intelligent interface. The thin film has multiple textured touchscreen buttons that users can feel along the edges of the screen, representing actions such as “Confirm” and “Return to Homepage.” Each button can lead to different destinations depending on the app, such as “My Shopping Cart,” “Tmall Global,” and “Tmall Supermarket” for Mobile Taobao.

Smart Touch also supports an “ear touch” feature, which gives blind and visually impaired users a simple way to listen to text clearly and privately in public, without the need for headphones. It uses a shape-finding algorithm to sense when users hold the phone to their ear and automatically routes the sound output from the loudspeaker to the earpiece speaker. (SV)

Fibre2Fashion News Desk – India

Interviews View All

Riddhika Shah, SS Homme

Riddhika Shah
SS Homme

'Worsted wool is the ideal fabric for menswear'

Sachin Sharma, Gem Enviro Management Pvt Ltd

Sachin Sharma
Gem Enviro Management Pvt Ltd

There are no significant differences between virgin yarn and PET recycled...

Evelyne Cholet, UCMTF

Evelyne Cholet

‘France had a reputation of being big in new ideas, but poor in marketing...

Abhishek Ralli,

Abhishek Ralli

Guide group is a government recognised manufacturing house engaged in the...

Wolfgang Muller,

Wolfgang Muller

Mayer & Cie is a leading global manufacturer of circular knitting...

Fabio Grandis,

Fabio Grandis

Italian company Grandis SRL has been operating in the textile industry for ...

Silke Brand-Kirsch, Schlegel und Partner

Silke Brand-Kirsch
Schlegel und Partner

Silke Brand-Kirsch, executive partner of Schlegel und Partner, a leading...

Kazuaki Yazawa, Purdue University

Kazuaki Yazawa
Purdue University

Scientist <b>Kazuaki Yazawa</b> has developed thermoelectric semiconductor ...

Dave Rousse, INDA

Dave Rousse

INDA, the Association of the Nonwoven Fabrics Industry, serves hundreds of ...

Tony Ward, Tony Ward

Tony Ward
Tony Ward

"You have to truly understand what your client wants, know her needs, what ...

Priya Somaiya, Usha Social Services

Priya Somaiya
Usha Social Services

The Usha Silai label from Usha International is all set for a retail...

Seema Agrawal, Artisan Saga

Seema Agrawal
Artisan Saga

Artisan Saga, founded by Kaushik Rajani and Seema Agrawal, is an online...

Press Release

Press Release

Letter to Editor

Letter to Editor

RSS Feed

RSS Feed

Submit your press release on


Letter To Editor

(Max. 8000 char.)

Search Companies


Leave your Comments

December 2019

Subscribe today and get the latest update on Textiles, Fashion, Apparel and so on.

Advanced Search