Data in flight

Julian Hyde
2010 Communications of the ACM  
practice weB AppLiCAtions pRoDUCe data at colossal rates, and those rates compound every year as the Web becomes more central to our lives. other data sources such as environmental monitoring and location-based services are a rapidly expanding part of our day-to-day experience. Even as throughput is increasing, users and business owners expect to see their data with everdecreasing latency. Advances in computer hardware (cheaper memory, cheaper disk, and more processing cores) are helping
more » ... are helping somewhat, but not enough to keep pace with the twin demands of rising throughput and decreasing latency. the technologies for powering Web applications must be fairly straightforward for two reasons: first, because it must be possible to evolve a Web application rapidly and then to deploy it at scale with a minimum of hassle; second, because the people writing Web applications are generalists and are not Data in flight IllustratIon by ryan alexander Julian hyde is chief architect of sQlstream, a streaming query engine. He is also the lead developer of Mondrian, the most popular open source relational olaP engine and a part of the Pentaho open source bI suite. an expert on relational technology, including query optimization and streaming execution, Hyde introduced bitmap indexes into oracle and led development of the broadbase analytic dbMs.
doi:10.1145/1629175.1629195 fatcat:ef3ignxn7nhgti5qwyvryiosx4