Test Collection for Evaluating Actionable Knowledge Graphs

Roi Blanco, Hideo Joho, Adam Jatowt, Haitao Yu
2017 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval  
Knowledge graphs (KG) can be used to enrich traditional search results by inserting brief answers to directly respond to users' search needs. As the user needs on search engine diversify, the range of needs answered by KB should also be diversified. However, the resources for developing and evaluating KG generation technologies are still limited. In this paper we discuss the NTCIR-13 Actionable Knowledge Graph (AKG) task and its test collections. The task focuses on finding possible actions
more » ... ted to input entities as well as the relevant properties of such actions. The NTCIR-13 AKG test collections include queries, entities, entity types, set of possible actions for entities, and relevant entity attributes. Finally, we discuss future directions for generating and evaluating actionable KGs.
dblp:conf/sigir/BlancoJJY17 fatcat:dtey3sqlefg6dnx5lx7otmbnb4