Real-time clothes comparison based on multi-view vision

Wei Zhang, Bo Begole, Maurice Chu, Juan Liu, Nicholas Yee
2008 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras  
In this paper, we present a clothing recognition system that augments clothes recommendation and fashion exploration using the intelligent multi-view vision technology of the Responsive Mirror, an implicitly controlled humancomputer interaction system for clothes fitting rooms. The Responsive Mirror provides shoppers with real-time "self" and "social" clothes comparisons. The system recommends clothing that is "similar" and "different" than the clothing that the person is trying on in the
more » ... . The goal of the research in this paper is to create a recommendation system that uses a definition of "similar" and "different" that matches human perception. We address the social nature of the recognition problem by conducting a user study to identify the salient clothes factors that people use to determine clothes similarity. We describe the computer vision and machine learning techniques employed to recognize the factors that human eyes perceive in term of clothing similarity from frontal-view outfit images. We describe the key components of the motion-tracking and clothes-recognition systems and evaluate their performance by user study and experiments on a simulated clothes fitting image dataset. The approach and results presented here will benefit designers and developers of similar applications in the future.
doi:10.1109/icdsc.2008.4635727 dblp:conf/icdsc/ZhangBCLY08 fatcat:vgd2qcypkjcwbmtq4hpceo56hi