Home / Knowledge / News / Apparel/Garments / Taobao unveils tech to help sight impaired shoppers

Taobao unveils tech to help sight impaired shoppers

Feb '19
Courtesy: Alizilla
Courtesy: Alizilla
Taobao, China’s largest online marketplace, has unveiled technologies to make shopping more accessible to blind and partially sighted. These technologies help navigate the site designed specifically for this population. One such technology is Optical Character Recognition, which is an artificial intelligence-driven feature that reads text written on images.

Optical Character Recognition (OCR) was introduced last October. Before adopting OCR, Taobao’s 300,000 daily active users who are blind or have reduced vision would have used screen-reading software that simply announced “image” as it scanned the page. By early December, OCR was being used to read close to 100 million images per day, Taobao said.

“Images are becoming ever more important in the shopping experience,” said Wang Yongpan, the algorithm specialist that led the OCR upgrade. “A typical product page on the site contains about 40 images, and most product specifications and descriptions are often found within images, rather than typed out in plain text.”

Yongpan noted that while Alibaba has been using OCR for many years in various capacities, the technology’s accuracy in reading images has grown exponentially thanks to advances in machine learning. Now, that accuracy is being put to work for the disabled.

Taobao’s Optical Character Recognition technology helps visually impaired consumers read both the text and images on each page.

For 31-year-old Zheng Rui, who is among the 285 million people worldwide recognised by the World Health Organisation as living with some form of visual impairment, accessibility technology brings more than mere convenience.

“Barrier-free shopping helps us live more independently, with dignity,” he said, adding that shopping at brick-and-mortar stores can be an awkward and troublesome experience for the visually impaired. He gave the example of women buying feminine hygiene products, who might feel embarrassed about seeking help from others, such as male family members or passersby, to pick the right product.

Today, Rui is his family’s chief shopper, procuring everything from household necessities to toys for his 1-year-old child. He can complete all the steps in the buyer’s journey, from searching for the product to payment, in less than a minute.

Making the platform more inclusive, user-friendly and a home for creativity is part of the larger strategy outlined by Taobao President Jiang Fan last May.

“If I had to do one thing this year, that would be to make Taobao simpler and bring [us] back to our original purpose,” Fan said. Alibaba is famously known by its motto, “To make it easy to do business anywhere.”

The OCR launch was driven by the company’s “Barrier-Free Lab,” which started with a handful of employees in 2011 and has since grown to hundreds of volunteers, ranging from programmers to user-experience designers.

Now, similar tools can be seen across Alibaba’s ecosystem, expanding from Taobao to B2C e-commerce site Tmall, payments affiliate Alipay, online delivery platform Ele.me, enterprise chat app Dingtalk, navigation firm Amap, music streaming app Xiami and internet browser UC Web, from desktop to mobile.

Last November, DAMO Academy, the e-commerce giant’s $15 billion global research programme, revealed that it has been working with China’s Tsinghua University to improve the smartphone experience for the blind and partially sighted. Smart Touch, one of their latest innovations, is set to launch later this year. Users pair a specially designed mobile app with a silicone film on top of their phone screen for a new, intelligent interface. The thin film has multiple textured touchscreen buttons that users can feel along the edges of the screen, representing actions such as “Confirm” and “Return to Homepage.” Each button can lead to different destinations depending on the app, such as “My Shopping Cart,” “Tmall Global,” and “Tmall Supermarket” for Mobile Taobao.

Smart Touch also supports an “ear touch” feature, which gives blind and visually impaired users a simple way to listen to text clearly and privately in public, without the need for headphones. It uses a shape-finding algorithm to sense when users hold the phone to their ear and automatically routes the sound output from the loudspeaker to the earpiece speaker. (SV)

Fibre2Fashion News Desk – India

Must ReadView All

Pic: Shutterstock

Textiles | On 21st Jan 2021

Vietnam's garment-textile sector eyes $39 bn in exports

Vietnam's garment-textile sector has set a target of $39 billion in...

Pic: Shutterstock

Fashion | On 21st Jan 2021

Mila Fashion to open apparel plant in Sri Lanka's Welioya

US-based Mila Fashion, part of the Design Studio Group, recently...

Pic: Citi Trends

Retail | On 21st Jan 2021

Citi Trends to open 100 new stores by fiscal 2023-end

Citi Trends, Inc, a US-based value-priced retailer of fashion...

Interviews View All

Awen Delaval, Samatoa

Awen Delaval

'Natural fibres are appreciated for traditional authenticity'

Amrit Sethia, SOIE

Amrit Sethia

‘The intimatewear category in India is slowly becoming trend-sensitive.’

Saket Garg, Garg Corporation

Saket Garg
Garg Corporation

The biggest challenge is lack of skilled workforce and competition from...

Joachim Maier,

Joachim Maier

Switzerland-based Uster Technologies AG is the leading high technology...

Himanshu Fogla,

Himanshu Fogla

Jumac, pioneers in spinning can manufacturing in India, was founded in...

Zafer Demirel,

Zafer Demirel

Turkey's Canlar Mechatronics is a leading designer and manufacturer of...

Isabel Herranz, European School of Business & innovation

Isabel Herranz
European School of Business & innovation

Cutting-edge ideas like the Internet of Things and artificial intelligence ...

Silverio Baranzano, Fitesa

Silverio Baranzano

Fitesa is a leader in the nonwoven fabrics industry, specialising in...

Kevin Young & Tom Lucas, Web Industries

Kevin Young & Tom Lucas
Web Industries

Web Industries is a precision formatter of nonwoven materials used in baby ...

Niti Singhal, Twee In One

Niti Singhal
Twee In One

Best known for convertible clothing, Indian brand Twee In One by designer...

Judy Frater, Somaiya Kala Vidya

Judy Frater
Somaiya Kala Vidya

Among the many honours showered on Frater, including Fulbright and Ford...

Sanjukta Dutta, Sanjukta's Studio

Sanjukta Dutta
Sanjukta's Studio

<b>Sanjukta Dutta</b> creates unique garments by clubbing prints of...

Press Release

Press Release

Letter to Editor

Letter to Editor

RSS Feed

RSS Feed

Submit your press release on


Letter To Editor

(Max. 8000 char.)

Search Companies


Leave your Comments

January 2021

Subscribe today and get the latest update on Textiles, Fashion, Apparel and so on.

Advanced Search