Title:
|
STREAMING REAL TIME DATA IN DATA WAREHOUSES FOR JUST-IN-TIME VIEWS MAINTENANCE |
Author(s):
|
Rasha Ismail , Omar H. Karam , Mohamed A. El-sharkawy , Mohamed Said Abdel Wahaab |
ISBN:
|
978-972-8924-97-3 |
Editors:
|
Hans Weghorn and Pedro IsaĆas |
Year:
|
2009 |
Edition:
|
V I, 2 |
Keywords:
|
Real Time Data Warehouse, Materialized Views, Data Streams |
Type:
|
Full Paper |
First Page:
|
101 |
Last Page:
|
108 |
Language:
|
English |
Cover:
|
|
Full Contents:
|
click to dowload
|
Paper Abstract:
|
The rapidly changing of the environment has become a key factor for the success of any company. The competitiveness
of an enterprise is determined by the ability of its executives to deliver exact and just-in-time decisions. Real Time Data
Warehousing (RTDW) meet this high demand of applications for up-to-date information. This paper focuses on feeding
and maintaining real-time data warehouses by joining the continuous update streams with the data warehouse relations.
The Joining Real Time Data Warehouse Algorithm (JRT) was proposed to minimize the delay or latency between the
time heterogeneous operational sources change or update and the time this change is detected by the DW. The JRT
maintains the DW in real time by joining the continuous streams of updates, which arrive from operational sources, with
the DW relations, without buffering these changes, in order to deliver just in time maintenance for the DW relations and
materialized views. The JRT is compared with the Change Data Capture technique (CDC) which is one of the important
techniques used for achieving real time DW. The JRT reduce the latency time over that of the CDC by more than 50 %
and increases the throughput for loading and updating data over that of the CDC by 39 transactions per second. |
|
|
|
|