Filters








11,659 Hits in 2.8 sec

Situated and Interactive Multimodal Conversations [article]

Seungwhan Moon, Satwik Kottur, Paul A. Crook, Ankita De, Shivani Poddar, Theodore Levin, David Whitney, Daniel Difranco, Ahmad Beirami, Eunjoon Cho, Rajen Subba, Alborz Geramifard
2020 arXiv   pre-print
Next generation virtual assistants are envisioned to handle multimodal inputs (e.g., vision, memories of previous interactions, in addition to the user's utterances), and perform multimodal actions (e.g  ...  ., displaying a route in addition to generating the system's utterance).  ...  to the data collection platforms, annotation schema development, annotation process, tooling and coordination.  ... 
arXiv:2006.01460v2 fatcat:yfijtft2v5hjjkwg5nv6wvwcey

Discussion of the crossover method of interactive Genetic Algorithm for extracting multiple peaks on Kansei landscape

Misato Tanaka, Tomoyuki Hiroyasu, Mitsunori Miki, Masato Yoshimi, Yasunari Sasaki, Hisatake Yokouchi
2012 The 6th International Conference on Soft Computing and Intelligent Systems, and The 13th International Symposium on Advanced Intelligence Systems  
Therefore, in this study, we discuss using an iGA to generate offspring by estimating and searching multiple peaks.  ...  When searching products a user would want, the recommendation method displays the more favored products by considering this multimodal preference.  ...  By applying these operations to all clusters, the next generation population is generated.  ... 
doi:10.1109/scis-isis.2012.6505288 dblp:conf/scisisis/TanakaHMYSY12 fatcat:4yjn27u6bnhz3dtvpgb2mitla4

Conversational Search (Dagstuhl Seminar 19461)

Avishek Anand, Lawrence Cavedon, Hideo Joho, Mark Sanderson, Benno Stein
2020 Dagstuhl Reports  
, and prototype of Conversational Search.  ...  Systems were invited to share the latest development in the area of Conversational Search and discuss its research agenda and future directions.  ...  Any opinions, findings, and conclusions described here are the authors and do not necessarily reflect those of the sponsors.  ... 
doi:10.4230/dagrep.9.11.34 dblp:journals/dagstuhl-reports/AnandCJSS19 fatcat:ctqyitsfifcbbecio5dnx2i62y

Deep Conversational Recommender Systems: A New Frontier for Goal-Oriented Dialogue Systems [article]

Dai Hoang Tran, Quan Z. Sheng, Wei Emma Zhang, Salma Abdalla Hamad, Munazza Zaib, Nguyen H. Tran, Lina Yao, Nguyen Lu Dang Khoa
2020 arXiv   pre-print
We first analyze the research problems and present key challenges in the development of Deep Conversational Recommender Systems (DCRS), then present the current state of the field taken from the most recent  ...  In recent years, the emerging topics of recommender systems that take advantage of natural language processing techniques have attracted much attention, and one of their applications is the Conversational  ...  Conclusion Conversational recommender systems are a practical application domain for modern online services, and deep conversational recommender systems are the next evolution of CRS.  ... 
arXiv:2004.13245v1 fatcat:byx4zsdshvc5fc3hjs7acoi5li

A TV Program Discovery Dialog System using recommendations

Deepak Ramachandran, Mark Fanty, Ronald Provine, Peter Yeh, William Jarrold, Adwait Ratnaparkhi, Benjamin Douglas
2015 Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue  
The recommender combines evidence for user preferences from multiple modalities such as dialog, user viewing history and activity logs.  ...  We present an end-to-end conversational system for TV program discovery that uniquely combines advanced technologies for NLU, Dialog Management, Knowledge Graph Inference and Personalized Recommendations  ...  Surfacing Recommendations The scores generated by the recommender are used to re-rank the results of any search query performed by the user.  ... 
doi:10.18653/v1/w15-4659 dblp:conf/sigdial/RamachandranFPY15 fatcat:ju6a62relbglbbptgaz4md7ehy

Conversational Search – A Report from Dagstuhl Seminar 19461 [article]

Avishek Anand, Lawrence Cavedon, Matthias Hagen, Hideo Joho, Mark Sanderson, Benno Stein
2020 arXiv   pre-print
, and prototype of Conversational Search.  ...  Systems were invited to share the latest development in the area of Conversational Search and discuss its research agenda and future directions.  ...  Two examples of relevant research are [1] and [2]. On the basis of these results, some specific challenges to the design of conversational search systems are identified.  ... 
arXiv:2005.08658v1 fatcat:ekkylrysezfkfcwkuk5ynrcwki

The VoiceApp System: Speech Technologies to Access the Semantic Web [chapter]

David Griol, José Manuel Molina, Víctor Corrales
2011 Lecture Notes in Computer Science  
whereas Voice Browser provides a fast and effective multimodal interface to the Google web search engine.  ...  All the applications in the system can be accessed multimodally using traditional graphic user interfaces such as keyboard and mouse, and/or by means of voice commands.  ...  conversations.  ... 
doi:10.1007/978-3-642-25274-7_40 fatcat:hv3t6sghyff67ghg4ba32bakri

A Knowledge-Grounded Multimodal Search-Based Conversational Agent [article]

Shubham Agarwal, Ondrej Dusek, Ioannis Konstas, Verena Rieser
2018 arXiv   pre-print
Multimodal search-based dialogue is a challenging new task: It extends visually grounded question answering systems into multi-turn conversations with access to an external database.  ...  We address this new challenge by learning a neural response generation system from the recently released Multimodal Dialogue (MMD) dataset (Saha et al., 2017).  ...  ., Toronto, Canada and the MaDrIgAL EPSRC project (EP/N017536/1). The Titan Xp used for this work was donated by the NVIDIA Corp.  ... 
arXiv:1810.11954v1 fatcat:iwlt52zwxfdd7eelxjjczafcwy

A Knowledge-Grounded Multimodal Search-Based Conversational Agent

Shubham Agarwal, Ondřej Dušek, Ioannis Konstas, Verena Rieser
2018 Proceedings of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI  
Multimodal search-based dialogue is a challenging new task: It extends visually grounded question answering systems into multi-turn conversations with access to an external database.  ...  We address this new challenge by learning a neural response generation system from the recently released Multimodal Dialogue (MMD) dataset (Saha et al., 2017) .  ...  ., Montreal, Canada and the MaDrIgAL EP-SRC project (EP/N017536/1). The Titan Xp used for this work was donated by the NVIDIA Corp.  ... 
doi:10.18653/v1/w18-5709 dblp:conf/emnlp/AgarwalDKR18 fatcat:xxzcf6wfzba45abduwpnsitihi

Current Challenges and Future Directions in Podcast Information Access [article]

Rosie Jones, Hamed Zamani, Markus Schedl, Ching-Wei Chen, Sravana Reddy, Ann Clifton, Jussi Karlgren, Helia Hashemi, Aasish Pappu, Zahra Nazari, Longqi Yang, Oguz Semerci (+2 others)
2021 arXiv   pre-print
The great strides in search and recommendation in research and industry have yet to see impact in the podcast space, where recommendations are still largely driven by word of mouth.  ...  In this perspective paper, we highlight the many differences between podcasts and other media, and discuss our perspective on challenges and future research directions in the domain of podcast information  ...  A very recent approach is trajectory-based podcast recommendation, which models short-term listening behavior of users as trajectory in a podcast graph, and predicts the next shows a user is likely to  ... 
arXiv:2106.09227v1 fatcat:mka3a7h4bbco5eo4c7but6hcbu

Knowledge Graphs and Knowledge Networks: The Story in Brief [article]

Amit Sheth, Swati Padhee, Amelie Gyrard
2020 arXiv   pre-print
The evolution of search engine responses to user queries in the last few years is partly because of the role of KGs such as Google KG.  ...  there is a need to represent the changing nodes, attributes, and edges over time.  ...  Primary reasons for the popularity of KGs in this century are: enabling new generation of applications for (prefacing with "semantic") search, browsing, recommendation, personalization, advertisement,  ... 
arXiv:2003.03623v1 fatcat:zle7g626mzeqrkmobgrr6xtfae

K-12 multimodal assessment and interactive audiences: An exploratory analysis of existing frameworks

Ewa McGrail, Nadia Behizadeh
2017 Assessing Writing: An International Journal  
online composition types that afford the writer the ability to communicate and collaborate with an audience.  ...  We found that multimodal composition is being defined consistently across all frameworks as composition that includes multiple ways of communicating, but the majority of multimodal composition examples  ...  Other searches utilized terms such as "multimodal" and "assess" in conjunction with "writing" or "composition" as general search terms or title searches.  ... 
doi:10.1016/j.asw.2016.06.005 fatcat:dtjs5z2xobhh3fdsevit3shvda

Systematic Review: Where is Current Research on Conversational Analysis?

Cendy Lauren, Tatum Derin
2020 ELSYA : Journal of English Language Studies  
This paper reports the findings and the research gaps grounded from current research articles on conversation analysis (CA).  ...  The practical implication of this systematic review is a collection of research gaps and recommendations that researchers can take note of and tackle in future studies.  ...  The authors extend their gratitude to United Kingdom Gang Out (UKGO) and Unilak-Research Advancement for Intellectual and Scientific Empowerment (U-RAISE) Academy for their part in the discussions during  ... 
doi:10.31849/elsya.v2i2.3879 fatcat:sdjutpxfdncivc5bcx4cledyvy

human perspective scene understanding

Chiori Hori
2021 Zenodo  
Multimodal Fusion Longstanding area of research: The first to fuse multimodal information using attention between modalities in a neural network Attention-Based Multimodal Fusion Attention weights for  ...  Temporal attention Video description capability needs to be embedded within the answer generation models. The boy is writing in the notebook. The boy is drinking from the glass.  ... 
doi:10.5281/zenodo.5077829 fatcat:mop5nd757fbnfex2apbj3rua4i

Design and Implementation of a Semantic Dialogue System for Radiologists [article]

Daniel Sonntag and Martin Huber and Manuel Möller and Alassane Ndiaye and Sonja Zillner and Alexander Cavallaro
2017 arXiv   pre-print
We will describe the clinical workflow and interaction requirements and focus on the design and implementation of a multimodal user interface for patient/image search or annotation and its implementation  ...  search and retrieval architecture which includes the MEDICO server, the triple store, the semantic search API, the medical visualization toolkit MITK, and the speech-based dialogue shell, amongst others  ...  ACKNOWLEDGEMENTS This research has been supported in part by the THESEUS Program which is funded by the German Federal Ministry of Economics and Technology under the grant number 01MQ07016.  ... 
arXiv:1701.07381v1 fatcat:f6ywhufuc5hnjlruhilzyeqh6a
« Previous Showing results 1 — 15 out of 11,659 results