Mathematical model gives fashion advice

The creators are IRI researchers Edgar Simo-Serra and Francesc Moreno-Noguer and University of Toronto researchers Sanja Fidler and Raquel Urtasun. The algorithm was presented in the paper "Neuroaesthetics in Fashion: Modeling the Perception of Fashionability" at the 2015 Conference on Computer Vision and Pattern Recognition (CVPR), the world's most important conference in this field, which was held in Boston (USA) in June.

The aim of the work is to build mathematical models that are able to understand the concept of fashion, that is, what makes a particular form of dress fashionable or unfashionable, and based on that, to make recommendations on how to dress.

To do this, the researchers created an Internet fashion dataset of over 144,000 user posts with images and associated information. The new algorithm was then able to predict how fashionable the clothes in the images were by using the "likes" received by each user post.

To build the model, the scientists combined a deep neural network with a conditional random field probabilistic model that can take various factors into account, such as the type of garment, the kind of user and the scene behind the person. The system can predict how fashionable a person looks, and more importantly, give fashion advice to users.

Edgar Simo-Serra and Francesc Moreno-Noguer are researchers at the Institute of Robotics and Industrial Informatics (CSIC-UPC), in Barcelona. Sanja Fidler and Raquel Urtasun are assistant professors at the University of Toronto.