Discovering meaning on the go in large heterogenous data

Harry Halpin, Fiona McNeill
2013 Artificial Intelligence Review  
The world is increasingly full of data. Organisations, governments and individuals are creating increasingly large data sources, and in many cases making them publicly available. This o↵ers massive potential for interaction and mutual collaboration. But using this data often creates problems. Those creating the data will use their own terminology, structure and formats for the data, meaning that data from one source will be incompatible with data from another source. When presented with a
more » ... unknown data source, it is very di cult to ascribe meaning to the terms of that data source, and to understand what is being conveyed. Much e↵ort has been invested in data interpretation prior to run-time, with large data sources being matched against each other o↵-line. But data is often used dynamically, and so to maximise the value of the data it is necessary to extract meaning from it dynamically. We therefore postulate that an essential competent of utilising the world of data in which we increasingly live is the development of the ability to discover meaning on the go in large, heterogenous data. This paper provides an overview of the current state-of-the-art, reviewing the aims and achievements in di↵erent fields which can be applied to this problem. We take a brief look at cutting edge research in this field, summarising four papers published in the special issue of the AI Review on Discovering Meaning on the go in Large Heterogenous Data, and conclude with our thoughts about where research in this field is going, and what our priorities must be to enable us to move closer to achieving this goal.
doi:10.1007/s10462-012-9377-4 fatcat:zy3swcqdrjbtrdqsjti4mogbmi