The effect of interactive analytical dashboard features on situation awareness and task performance

作者:

Highlights:

• A what-if analysis positively impacts the task performance

• A what-if analysis is not cost-free and can trigger an out-of-the-loop problem

• Using the SAGAT seems most promising to measure SA in production planning

摘要

In recent years, new types of interactive analytical dashboard features have emerged for operational decision support systems (DSS). Analytical components of such features solve optimization problems hidden from the human eye, whereas interactive components involve the individual in the optimization process via graphical user interfaces (GUIs). Despite their expected value for organizations, little is known about the effectiveness of interactive analytical dashboards in operational DSS or their influences on human cognitive abilities. This paper contributes to the closing of this gap by exploring and empirically testing the effects of interactive analytical dashboard features on situation awareness (SA) and task performance in operational DSS. Using the theoretical lens of SA, we develop hypotheses about the effects of a what-if analysis as an interactive analytical dashboard feature on operational decision-makers' SA and task performance. The resulting research model is studied with a laboratory experiment, including eye-tracking data of 83 participants. Our findings show that although a what-if analysis leads to higher task performance, it may also reduce SA, nourishing a potential out-of-the-loop problem. Thus, designers and users of interactive analytical dashboards have to carefully mitigate these effects in the implementation and application of operational DSS. In this article, we translate our findings into implications for designing dashboards within operational DSS to help practitioners in their efforts to address the danger of the out-of-the-loop syndrome.

论文关键词:Interactive analytical dashboards,What-if analysis,Situation awareness,Out-of-the-loop syndrome,Eye-tracking,Operational decision support systems

论文评审过程:Received 15 August 2019, Revised 12 May 2020, Accepted 12 May 2020, Available online 19 May 2020, Version of Record 29 June 2020.

论文官网地址:https://doi.org/10.1016/j.dss.2020.113322