Shedding light on blind spots – Developing a reference architecture to leverage video data for process mining

作者:

Highlights:

• Extracting event logs from unstructured video files.

• Proposes a reference architecture facilitating the design of video mining systems.

• Bridges the gap between computer vision capabilities and process mining.

• Provides an instantiation indicating the potential of extracted event logs for process mining analysis.

摘要

Process mining is one of the most active research streams in business process management. In recent years, numerous methods have been proposed for analyzing structured process data. In many cases, however, only the digitized parts of processes are directly captured by process-aware information systems, whereas manual activities often leave blind spots in the process analysis. While video data can contain valuable process-related information that is not captured in information systems, a standardized approach to extracting event logs from unstructured video data remains lacking. To solve this problem and facilitate the systematic usage of video data in process mining, we have designed the ViProMiRA, a reference architecture that bridges the gap between computer vision and process mining. The various evaluation activities in our design science research process ensure that the proposed ViProMiRA allows flexible, use case-driven, and context-specific instantiations. Our results also show that a prototypical implementation of the ViProMiRA is capable of automatically extracting more than 70% of the process-relevant events from a real-world video dataset in a supervised learning scenario.

论文关键词:computer vision,process mining,reference architecture,unstructured data

论文评审过程:Received 22 October 2021, Revised 10 March 2022, Accepted 9 April 2022, Available online 22 April 2022, Version of Record 11 May 2022.

论文官网地址:https://doi.org/10.1016/j.dss.2022.113794