Modeling the interaction between resilience and ability in assessments with allowances for multiple attempts

作者:

Highlights:

• Eventual correctness on multiple-attempt test items depends on persistence, potentially complicating score interpretation. .

• An IRTree model for multiple-attempt items parses out persistence from achievement and, thus, latent resilience from ability. .

• Resilience, found uncorrelated with ability in online homework settings, should not be ignored as a factor in its own right. .

• While some items decrease in difficulty on subsequent tries, most items do not.

• Learners are less likely to reattempt difficult problems following incorrect response.

摘要

•Eventual correctness on multiple-attempt test items depends on persistence, potentially complicating score interpretation. .•An IRTree model for multiple-attempt items parses out persistence from achievement and, thus, latent resilience from ability. .•Resilience, found uncorrelated with ability in online homework settings, should not be ignored as a factor in its own right. .•While some items decrease in difficulty on subsequent tries, most items do not.•Learners are less likely to reattempt difficult problems following incorrect response.

论文关键词:Multiple attempt,Tree-based item response models,Resilience,Persistence,Computer-based assessment,Summative assessment

论文评审过程:Received 10 December 2019, Revised 17 April 2021, Accepted 25 April 2021, Available online 30 April 2021, Version of Record 15 May 2021.

论文官网地址:https://doi.org/10.1016/j.chb.2021.106847