Home / Knowledge / News / Apparel/Garments / Taobao unveils tech to help sight impaired shoppers

Taobao unveils tech to help sight impaired shoppers

Feb '19
Courtesy: Alizilla
Courtesy: Alizilla
Taobao, China’s largest online marketplace, has unveiled technologies to make shopping more accessible to blind and partially sighted. These technologies help navigate the site designed specifically for this population. One such technology is Optical Character Recognition, which is an artificial intelligence-driven feature that reads text written on images.

Optical Character Recognition (OCR) was introduced last October. Before adopting OCR, Taobao’s 300,000 daily active users who are blind or have reduced vision would have used screen-reading software that simply announced “image” as it scanned the page. By early December, OCR was being used to read close to 100 million images per day, Taobao said.

“Images are becoming ever more important in the shopping experience,” said Wang Yongpan, the algorithm specialist that led the OCR upgrade. “A typical product page on the site contains about 40 images, and most product specifications and descriptions are often found within images, rather than typed out in plain text.”

Yongpan noted that while Alibaba has been using OCR for many years in various capacities, the technology’s accuracy in reading images has grown exponentially thanks to advances in machine learning. Now, that accuracy is being put to work for the disabled.

Taobao’s Optical Character Recognition technology helps visually impaired consumers read both the text and images on each page.

For 31-year-old Zheng Rui, who is among the 285 million people worldwide recognised by the World Health Organisation as living with some form of visual impairment, accessibility technology brings more than mere convenience.

“Barrier-free shopping helps us live more independently, with dignity,” he said, adding that shopping at brick-and-mortar stores can be an awkward and troublesome experience for the visually impaired. He gave the example of women buying feminine hygiene products, who might feel embarrassed about seeking help from others, such as male family members or passersby, to pick the right product.

Today, Rui is his family’s chief shopper, procuring everything from household necessities to toys for his 1-year-old child. He can complete all the steps in the buyer’s journey, from searching for the product to payment, in less than a minute.

Making the platform more inclusive, user-friendly and a home for creativity is part of the larger strategy outlined by Taobao President Jiang Fan last May.

“If I had to do one thing this year, that would be to make Taobao simpler and bring [us] back to our original purpose,” Fan said. Alibaba is famously known by its motto, “To make it easy to do business anywhere.”

The OCR launch was driven by the company’s “Barrier-Free Lab,” which started with a handful of employees in 2011 and has since grown to hundreds of volunteers, ranging from programmers to user-experience designers.

Now, similar tools can be seen across Alibaba’s ecosystem, expanding from Taobao to B2C e-commerce site Tmall, payments affiliate Alipay, online delivery platform Ele.me, enterprise chat app Dingtalk, navigation firm Amap, music streaming app Xiami and internet browser UC Web, from desktop to mobile.

Last November, DAMO Academy, the e-commerce giant’s $15 billion global research programme, revealed that it has been working with China’s Tsinghua University to improve the smartphone experience for the blind and partially sighted. Smart Touch, one of their latest innovations, is set to launch later this year. Users pair a specially designed mobile app with a silicone film on top of their phone screen for a new, intelligent interface. The thin film has multiple textured touchscreen buttons that users can feel along the edges of the screen, representing actions such as “Confirm” and “Return to Homepage.” Each button can lead to different destinations depending on the app, such as “My Shopping Cart,” “Tmall Global,” and “Tmall Supermarket” for Mobile Taobao.

Smart Touch also supports an “ear touch” feature, which gives blind and visually impaired users a simple way to listen to text clearly and privately in public, without the need for headphones. It uses a shape-finding algorithm to sense when users hold the phone to their ear and automatically routes the sound output from the loudspeaker to the earpiece speaker. (SV)

Fibre2Fashion News Desk – India

Must ReadView All

Pic: Shutterstock

Retail | On 1st Dec 2020

British retailer Arcadia enters into administration

UK clothing retail group Arcadia recently entered into administration ...

Pic: Fashion For Good

Textiles | On 1st Dec 2020

Fashion For Good launches Viscose Traceability Project

Fashion for Good, a global initiative to make all fashion good, has...

Pic: European Commission

Textiles | On 1st Dec 2020

Croatian, Belgian, Romanian firms win EUSIC challenge

Snake, a Croatian platform that enables users to wear outfits in...

Interviews View All

Top executives, Textile industry

Top executives
Textile industry

The budget will give major impetus to textile and apparel consumption

Arvind Saraf, Triveni Sarees

Arvind Saraf
Triveni Sarees

e-Commerce is still evolving fast with constant flux and surprises

Top executives, Indian retail players

Top executives
Indian retail players

Walmart's acquisition of Flipkart endorses the humongous opportunities in...

Ashish M Amin,

Ashish M Amin

Premier Looms is a leading provider of cutting-edge machinery and...

Sandip Bhojani, Manthan Patel,

Sandip Bhojani, Manthan Patel

Krypthm Tradelink LLP is a Surat-based manufacturer of westernwear....

Siddhachakra Weaving (Badiya Fashion),

Siddhachakra Weaving (Badiya Fashion)

Ahmedabad-based Siddhachakra Weaving Pvt Ltd was established in 2011 under ...

Dave Rousse, INDA

Dave Rousse

INDA, the Association of the Nonwoven Fabrics Industry, serves hundreds of ...

Ashok Desai, Bombay Textile Research Association

Ashok Desai
Bombay Textile Research Association

Bombay Textile Research Association (BTRA) is a leading name in textile...

Giulio Cesareo, Directa Plus SpA

Giulio Cesareo
Directa Plus SpA

Established in 2005, Direct Plus SpA, is one of the largest producers and...

Bani Batra,

Bani Batra

Bani Batra’s couture wedding collection is inspired by traditional Indian...

Sandeep and Sarah Shaikh Gonsalves, SS Homme

Sandeep and Sarah Shaikh Gonsalves
SS Homme

SS Homme celebrates the craft of traditional tailoring through the bespoke ...

Sneha Arora, Label Sneha Arora

Sneha Arora
Label Sneha Arora

Sneha Arora, an alumnus of National Institute of Fashion Technology,...

Press Release

Press Release

Letter to Editor

Letter to Editor

RSS Feed

RSS Feed

Submit your press release on


Letter To Editor

(Max. 8000 char.)

Search Companies


Leave your Comments

December 2020

Subscribe today and get the latest update on Textiles, Fashion, Apparel and so on.

Advanced Search