Home / Knowledge / News / Apparel/Garments / MPI-IS develops tech to make virtual clothing try-on
MPI-IS develops tech to make virtual clothing try-on
Aug '17
Courtesy: Max Planck Institute for Intelligent Systems (MPI-IS)
Courtesy: Max Planck Institute for Intelligent Systems (MPI-IS)
Researchers at the Max Planck Institute for Intelligent Systems have developed technology to digitally capture clothing on moving people, turn it into a 3D digital form, and dress virtual avatars. This new technology makes virtual clothing try-on practical. Capturing and transferring existing garments to new people simplifies the virtual try-on process.

Traditional virtual clothing try-on involves getting the 2D clothing pattern from the manufacturer, sizing this to a body, and simulating how the clothing drapes on the body. The new technique replaces garment simulation with garment capture. Capturing and transferring existing garments to new people greatly simplifies the process of virtual try-on.

“Our approach is to scan a person wearing the garment, separate the clothing from the person, and then rendering it on top of a new person,” says Dr. Gerard Pons-Moll, research scientist at MPI-IS and principal investigator of the project. “This process captures all the detail present in real clothing, including how it moves, which is hard to replicate with simulation,” says Pons-Moll. The ClothCap (ClothCapture) results exceed the realism of existing approaches.

ClothCap uses 4D movies of people recorded with a unique 4D high-resolution scanner. The system uses 66 cameras and projectors to illuminate the person being scanned. “This scanner captures every wrinkle of clothing at high resolution. It is like having 66 eyes looking at a person from every possible angle.” says Michael Black, director at MPI-IS. “This allows us to study humans in motion like never before.”

Like any movie, you can replay it but you cannot change the actors or their clothing. Instead “ClothCap” computes the body shape and motion under clothing while separating and tracking the garments on the body as it moves. “The software turns the captured scans into separate meshes corresponding to the clothing and the body,” says Dr. Sergi Pujades, postdoctoral researcher at MPI and one of the main authors of this work.

Traditional marker based motion capture record only the skeletal motion; placing hundreds of those markers on the clothing is unpractical and it is not well understood how to map the captured clothing to new characters. ClothCap makes it easy because the clothing is captured in correspondence with the body. “The algorithm literally subtracts the clothing from the recorded subject and adds it to new body to produce a realistic result,” says Gerard Pons-Moll. “It’s like doing arithmetic with people and their clothing, it’s cool!” he continues.

“Motion capture revolutionised the fields of animation, gaming and biomechanics. Much in the same way that motion capture replaced a lot of manual editing of motion from scratch, techniques like ClothCap could replace the way clothed characters are edited and animated digitally,” explains Pons-Moll. This is the first method to capture clothing in motion and animate new characters with it. “Other methods capture people in clothing but nobody could realistically animate new subjects with the captured clothing,” says Sergi Pujades.

ClothCap provides a foundational technology for virtual clothing try-on. “First a retailer needs to scan a professional model in a variety of poses and clothing to create a digital wardrobe of clothing items. Then a user can select an item and visualise how it looks on their virtual avatar,” says Michael Black.

The work has several limitations. For example, cloth wrinkles do not change with body shape and ClothCap does not allow the synthesis of novel motions. The team plans to address such limitations in future work. (SV)

Fibre2Fashion News Desk – India

Must ReadView All

Pic: Shutterstock

Textiles | On 26th Jan 2022

Vietnam-US trade hits $111.56 bn in 2021

Vietnam-US trade hit $111.56 billion in 2021, up by nearly $21...

Pic: Shutterstock

Textiles | On 26th Jan 2022

Turkey using less coal, hydropower; use of renewables, gas up: Ember

The use of coal and water for energy in Turkey reduced in 2021, while ...

Pic: Bangladesh Parliament Secretariat/Facebook

Apparel/Garments | On 26th Jan 2022

Trade Organisation Bill, 2022, introduced in Bangladesh parliament

The Trade Organisation Bill, 2022, aimed at allowing foreign traders...

Interviews View All

Florian Heubrandner, Lenzing AG

Florian Heubrandner
Lenzing AG

Sustainable and eco-friendly fibres remain in the minority

Textile Industry, Head Honchos

Textile Industry
Head Honchos

Increase foreign exchange and create jobs

Textile Industry, Head honchos

Textile Industry
Head honchos

Good tidings expected for textile industry

Dr. Ajay Sahai,

Dr. Ajay Sahai

Set up in 1965 by Ministry of Commerce, Government of India to focus the...

Noemi Sanchez,

Noemi Sanchez

Established since 1846, Evlox is a specialised denim manufacturer with its ...

Ujjval Saraf,

Ujjval Saraf

Founded by Jimmy Lai, Giordano International Ltd, a Hong Kong based...

Dr Anup Rakshit, ITTA

Dr Anup Rakshit

The Indian Technical Textile Association (ITTA) is the only association of ...

Tonny De Beer, PFNonwovens

Tonny De Beer

PFNonwovens (PFN) was established in 2018 by the combination of two...

Johann-Philipp Dilo, Dilo Group

Johann-Philipp Dilo
Dilo Group

German company Dilo Group is one of the leading equipment suppliers of...

Raghavendra Rathore, Label Raghavendra Rathore Jodhpur

Raghavendra Rathore
Label Raghavendra Rathore Jodhpur

Being one of the first designers to use the "Brand India" positioning for...

Anjali Bhaskar, Samatvam

Anjali Bhaskar

Samatvam, a womenswear brand that blends age-old craftsmanship with modern ...

Sunita Shanker, Label Sunita Shanker

Sunita Shanker
Label Sunita Shanker

Inspired by the rich traditional crafts of India, Sunita Shanker’s work is ...

Press Release

Press Release

Letter to Editor

Letter to Editor

RSS Feed

RSS Feed

Submit your press release on


Letter To Editor

(Max. 8000 char.)

Search Companies


Leave your Comments


NITI Aayog
Gokaldas Exports Limited
Sainsbury's Argos Asia Limited
Brandix Lanka Limited
Sateri (Jiujiang) Fiber Co.,Ltd
Gatsby Africa
Deckers Outdoor (Guangzhou) Consultant Co., LTD.
Phong Phu international JSC (PPJ)
Lululemon Athletica Inc
Lenzing Aktiengesellschaft
Groz-Beckert East Asia LLP
Grasim Industries Limited
IKEA of Sweden AB
Eastman Chemical Company
LC Waikiki
Reiter India Private Limited
Under Armour Global Sourcing Ltd
SHAHI Exports Pvt Ltd
Rosset ;& Cia Limited
Hirdaramani International Export Private Limited
Desigual - ABASIC, S.A.
John Varvatos
Tchibo GmbH
Guess Europe Sagl,
Sportmaster Ltd.
IDH – The Sustainable Trade Initiative
Vardhman Textile Ltd
Calvin Klein
Landmark Group
G-Star Raw C.V.
Gloria Jeans
Vianney Textil Hogar S.A. De C.V.
H;&M Hennes ;& Mauritz (Far East) Ltd
Varner AS Retail
Helly Hansen Far East Ltd
Aquarelle Clothing Limited
Chico’ FAS
Alison Hayes Romania
International Textile Manufacturers Federation
Amazon China
Green Fibre
Gap International Sourcing Limited
MAS Active / MAS Kreeda / MAS Bodyline
PVH Corporation
Etam Group Strategy Hong Kong Limited
Tory Burch Hong Kong Ltd
Page Industries Limited (Bangalore)
Rayonese Textile Inc., Division de Culp Inc.
Sportswear Company Spa
OVS Hong Kong Sourcing Ltd.
J ;& P Coats
Recron Polyester from Reliance Industries Limited
Cat Tuong Real Estate Group Joint Stock Company
Midas Clothing Limited
Maceton Limited
Alix Partners
Aramark Uniform ;& Career Apparel, LLC
Lacoste (Wanchai)
T.T. Limited
Restoque S.A.
Benetton Group
Lisa S.P.A.
Bluestem Global Sourcing Limited
Chori Company Limited
Hela Clothing Pvt Ltd
Boardriders Asia Sourcing Limited
Truetzschler India Private Limited
Arvind Limited
The LYCRA Company Singapore  Pte. Ltd
Tommy Hilfiger
KAS Direct Sourcing
C;&A Sourcing International Ltd
Esprit Europe Services GmbH

January 2022

Subscribe today and get the latest update on Textiles, Fashion, Apparel and so on.

Advanced Search