Video ChatBot

Yehao Li, Ting Yao, Rui Hu, Tao Mei, Yong Rui
2016 Proceedings of the 2016 ACM on Multimedia Conference - MM '16  
We demonstrate a video chatbot, which can generate humanlevel emotional comments referring to the videos shared by users and trigger a conversation with users. Our video chatbot performs a large-scale similar video search to find visually similar videos w.r.t. a given video using approximate nearest-neighbor search. Then, the comments associated with the searched similar videos are ranked by learning a deep multi-view embedding space for modeling video content, visual sentiment and textual
more » ... nts. The top ranked comments are selected as responses to the given video and trigger the succeeding text-based chat between users and the chatbot. The demonstration is conducted on a newly collected dataset with over 102K videos and 10.6M comments. Moreover, our video chatbot has great potential to increase live social interactions.
doi:10.1145/2964284.2973835 dblp:conf/mm/LiYHMR16 fatcat:3mriisdsrnfn3ideqne5h3n6he