Personalized travel recommendation by mining people attributes from community-contributed photos

An-Jung Cheng, Yan-Ying Chen, Yen-Ta Huang, Winston H. Hsu, Hong-Yuan Mark Liao
2011 Proceedings of the 19th ACM international conference on Multimedia - MM '11  
Leveraging community-contributed data (e.g., blogs, GPS logs, and geo-tagged photos) for travel recommendation is one of the active researches since there are rich contexts and trip activities in such explosively growing data. In this work, we focus on personalized travel recommendation by leveraging the freely available community-contributed photos. We propose to conduct personalized travel recommendation by further considering specific user profiles or attributes (e.g., gender, age, race). In
more » ... stead of mining photo logs only, we argue to leverage the automatically detected people attributes in the photo contents. By information-theoretic measures, we will demonstrate that such people attributes are informative and effective for travel recommendation -especially providing a promising aspect for personalization. We effectively mine the demographics for different locations (or landmarks) and travel paths. A probabilistic Bayesian learning framework which further entails mobile recommendation on the spot is introduced. We experiment on four million photos collected for eight major worldwide cities. The experiments confirm that people attributes are promising and orthogonal to prior works using travel logs only and can further improve prior travel recommendation methods especially in difficult predictions by further leveraging user contexts in mobile devices. Figure 1 : Community-contributed photos are freely available and with rich context information (e.g., geo-tags, time). We can mine the travel patterns for the users by associating their trips with the major landmarks. Meanwhile, we can indirectly mine demographic information (e.g., gender, race, age) from the photos along with the trips by automatically detecting people attributes in the photos. In this example, the width of an arrow denotes the travel frequency between the two locations. The color regions are proportional to the percentages of genders -male (blue) and female (red). Such minded demographic information is promising for personalized travel recommendation and planning; for example, suggesting the best route for Asian travelers in Manhattan or the next location for a family group after visiting Rockfeller Center.
doi:10.1145/2072298.2072311 dblp:conf/mm/ChengCHHL11 fatcat:m7dujy3j3ncizkfnfmchzcreue