A machine learning investigation of factors that contribute to predicting cognitive performance: Difficulty level, reaction time and eye-movements

作者:

Highlights:

• We use machine learning to predict accuracy on cognitively demanding tasks.

• The strongest prediction model is derived when all features and all tasks are considered.

• Reaction time, difficulty level and eye-movements can predict accuracy independently.

• Standard deviation of reaction time is the most important feature.

• Mean fixation and saccade duration SD are top features for the eye-tracking model.

摘要

Predicting accuracy in cognitively challenging tasks has potential applications in education and industry. Task demand has been linked with increases in response time and variations in reaction time and eye-tracking metrics, however, machine learning research has not been used to predict performance on tasks with multiple levels of difficulty. We report data on adult participants who performed tasks of mental attentional capacity with six levels of difficulty and use machine learning methods to predict accuracy scores considering metrics associated with task difficulty, reaction time and eye movements. Results show that machine learning models can robustly predict performance with reaction times and difficulty level being the strongest predictors. Eye-tracking indices can also predict accuracy independently, with the most important features of the model driven by the number of fixations, number of saccades, duration of the current fixation and pupil size. Practical and theoretical implications of the results are discussed.

论文关键词:Eye-tracking,Machine learning,Mental attention,Cognitive demand,Objective difficulty

论文评审过程:Received 15 February 2021, Revised 14 December 2021, Accepted 14 December 2021, Available online 22 December 2021, Version of Record 21 February 2022.

论文官网地址:https://doi.org/10.1016/j.dss.2021.113713