Leveraging non-expert crowdsourcing workers for improper task detection in crowdsourcing marketplaces

作者：

Highlights：

• We address the problem of improper task detection in crowdsourcing.

• We investigate the operational data inside a commercial crowdsourcing marketplace.

• We show machine learning is effective in detecting improper tasks in crowdsourcing.

• We show the use of both expert and non-expert improves the performance of detecting.

摘要

•We address the problem of improper task detection in crowdsourcing.•We investigate the operational data inside a commercial crowdsourcing marketplace.•We show machine learning is effective in detecting improper tasks in crowdsourcing.•We show the use of both expert and non-expert improves the performance of detecting.

论文关键词：Crowdsourcing,Machine learning,Improper task detection,Quality control

论文评审过程：Available online 20 November 2013.

论文官网地址：https://doi.org/10.1016/j.eswa.2013.11.011