ABSTRACT
This section highlights a technique of streaming result sets of data over a chain of pipelined functions that serve as in-memory staged datasets. Dataset staging is used predominantly for in-memory processing, such as applications involving online analytical processing (OLAP) that require ultra-fast processing and delivery of query results or for extract, transform, and load (ETL) processing to populate a data warehouse wherein the target database needs to be fed with data available in an external source or in a different database than the target database that uses the data. It is also employed in OLTP applications that demand rapid response times for highvolume transactions such as high-traffic Web sites-when the data in an OLTP system changes rapidly and thus necessitates near-real-time streaming and/or replication of the same.
