Predictive performance modeling for distributed batch processing using black box monitoring and machine learning

作者:

Highlights:

• Comprehensive review of performance prediction in batch processing.

• Approaches for runtime, resource consumption, and wait time prediction.

• Focus on data-driven methods based on non-intrusive black box monitoring.

摘要

•Comprehensive review of performance prediction in batch processing.•Approaches for runtime, resource consumption, and wait time prediction.•Focus on data-driven methods based on non-intrusive black box monitoring.

论文关键词:Distributed computing,Resource management,Machine learning,Black box monitoring

论文评审过程:Received 28 March 2018, Revised 28 December 2018, Accepted 12 January 2019, Available online 22 January 2019, Version of Record 25 January 2019.

论文官网地址:https://doi.org/10.1016/j.is.2019.01.006