Expediting analytical databases with columnar approach

作者:

Highlights:

• A novel method for development and use of analytical databases is introduced.

• The method combines columnar database technology with denormalizing data tables for analysis and decision support.

• The method making critical information more readily available and widens the range of feasible queries.

• The efficiencies and advantages of the introduced approach are illustrated by showing two real-world implementations.

摘要

The approaches and discussions given in this paper offer applicable solutions for a number of scenarios taking place in the contemporary world that are dealing with performance issues in development and use of analytical databases for the support of both tactical and strategic decision making. The paper introduces a novel method for expediting the development and use of analytical databases that combines columnar database technology with an approach based on denormalizing data tables for analysis and decision support. This method improves the feasibility and quality of tactical decision making by making critical information more readily available. It also improves the quality of longer term strategic decision making by widening the range of feasible queries against the vast amounts of available information. The advantages include the improvements in the performance of the ETL process (the most common time-consuming bottleneck in most implementations of data warehousing for quality decision support) and in the performance of the individual analytical queries. These improvements in the critical decision support infrastructure are achieved without resulting in insurmountable storage-size increase requirements. The efficiencies and advantages of the introduced approach are illustrated by showing the application in two relevant real-world cases.

论文关键词:Data warehouses,Decision support,Big data,Performance,ETL,Columnar databases

论文评审过程:Received 31 December 2015, Revised 22 December 2016, Accepted 24 December 2016, Available online 6 January 2017, Version of Record 3 March 2017.

论文官网地址:https://doi.org/10.1016/j.dss.2016.12.002