HTAP With Reactive Streaming ETL release_b4yfkpuvkfgefkm66yixlti3cu

by Carl Camilleri, Joseph G. Vella, Vitezslav Nezval

Published in Journal of Cases on Information Technology by IGI Global.

2021   Volume 23, p1-19

Abstract

In database management systems (DBMSs), query workloads can be classified as online transactional processing (OLTP) or online analytical processing (OLAP). These often run within separate DBMSs. In hybrid transactional and analytical processing (HTAP), both workloads may execute within the same DBMS. This article shows that it is possible to run separate OLTP and OLAP DBMSs, and still support timely business decisions from analytical queries running off fresh transactional data. Several setups to manage OLTP and OLAP workloads are analysed. Then, benchmarks on two industry standard DBMSs empirically show that, under an OLTP workload, a row-store DBMS sustains a 1000 times higher throughput than a columnar DBMS, whilst OLAP queries are more than 4 times faster on a columnar DBMS. Finally, a reactive streaming ETL pipeline is implemented which connects these two DBMSs. Separate benchmarks show that OLTP events can be streamed to an OLAP database within a few seconds.
In application/xml+jats format

Archived Files and Locations

application/pdf  2.4 MB
file_tnuc35nwdfbpfn3jb25bfi7kie
www.igi-global.com (publisher)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Year   2021
Language   en ?
Journal Metadata
Not in DOAJ
In Keepers Registry
ISSN-L:  1548-7717
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 87bda86b-03ff-4319-b236-7fad83ba0235
API URL: JSON