Dress with Style: Learning Style from Joint Deep Embedding of Clothing Styles and Body Shapes

Shintami Chusnul Hidayati, Ting Wei Goh, Ji Sheng Gary Chan, Cheng Chun Hsu, John See, Lai Kuan Wong, Kai Lung Hua, Yu Tsao, Wen Huang Cheng*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Body shape is about proportion, and fashion style is all about dressing those proportions to look their very best. Figuring out the styles to suit a body shape can be a daunting task for many people. It is, therefore, essential to develop a framework for learning the compatibility of body shapes and clothing styles. Though fashion designers and fashion stylists have analyzed the correlation between human body shapes and fashion styles for a long time, this issue did not receive much attention in multimedia science. In this paper, we present a novel style recommender, on the basis of the user's body attributes. The rich amount of fashion styling knowledge from social big data is exploited for this purpose. We first construct a joint embedding of clothing styles and human body measurements with deep multimodal representation learning on a reference dataset that has been sorted to meet the fashion rules. We then discover the relevant semantic features by propagation and selection in clothing style and body shape graphs. Experiments demonstrate the effectiveness of the proposed framework when compared with several baseline methods.

Original languageEnglish
Article number9034172
Pages (from-to)365-377
Number of pages13
JournalIEEE Transactions on Multimedia
Volume23
DOIs
StatePublished - 2021

Keywords

  • clothing style
  • correlation
  • Fashion analysis
  • human body shape
  • recommender system

Fingerprint Dive into the research topics of 'Dress with Style: Learning Style from Joint Deep Embedding of Clothing Styles and Body Shapes'. Together they form a unique fingerprint.

Cite this