High-Performance Computing Applied to Semantic Databases [chapter]

Eric L. Goodman, Edward Jimenez, David Mizell, Sinan al-Saffar, Bob Adolf, David Haglin
2011 Lecture Notes in Computer Science  
To-date, the application of high-performance computing resources to Semantic Web data has largely focused on commodity hardware and distributed memory platforms. In this paper we make the case that more specialized hardware can offer superior scaling and close to an order of magnitude improvement in performance. In particular we examine the Cray XMT. Its key characteristics, a large, global sharedmemory, and processors with a memory-latency tolerant design, offer an environment conducive to
more » ... ramming for the Semantic Web and have engendered results that far surpass current state of the art. We examine three fundamental pieces requisite for a fully functioning semantic database: dictionary encoding, RDFS inference, and query processing. We show scaling up to 512 processors (the largest configuration we had available), and the ability to process 20 billion triples completely in-memory.
doi:10.1007/978-3-642-21064-8_3 fatcat:trvcbdgj6beghkcw6rqnkn5rx4