Extracting Top-K Insights from Multi-dimensional Data

Bo Tang, Shi Han, Man Lung Yiu, Rui Ding, Dongmei Zhang
2017 Proceedings of the 2017 ACM International Conference on Management of Data - SIGMOD '17  
OLAP tools have been extensively used by enterprises to make better and faster decisions. Nevertheless, they require users to specify group-by attributes and know precisely what they are looking for. This paper takes the first attempt towards automatically extracting top-k insights from multi-dimensional data. This is useful not only for non-expert users, but also reduces the manual effort of data analysts. In particular, we propose the concept of insight which captures interesting observation
more » ... erived from aggregation results in multiple steps (e.g., rank by a dimension, compute the percentage of measure by a dimension). An example insight is: "Brand B's rank (across brands) falls along the year, in terms of the increase in sales". Our problem is to compute the top-k insights by a score function. It poses challenges on (i) the effectiveness of the result and (ii) the efficiency of computation. We propose a meaningful scoring function for insights to address (i). Then, we contribute a computation framework for top-k insights, together with a suite of optimization techniques (i.e., pruning, ordering, specialized cube, and computation sharing) to address (ii). Our experimental study on both real data and synthetic data verifies the effectiveness and efficiency of our proposed solution.
doi:10.1145/3035918.3035922 dblp:conf/sigmod/TangHYDZ17 fatcat:5vfgej2zjveklgihhvs7ifb5vq