Artificial intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetry

作者:

Highlights:

• New natural language generation (NLG) algorithms, like GPT-2, allegedly generate human-like text across diverse domains.

• We conducted two experiments (total N = 830) on human and machine behavior in the creative writing domain.

• Outputs by GPT-2 were either selected or randomly paired with human poems by novices (Study 1) or professionals (Study 2).

• In an incentivized version of the Turing Test, participants failed to reliably detect selected algorithmic creative text.

• People are averse to AI-generated poetry, independent on receiving information about the origin of the poem, or not.

摘要

•New natural language generation (NLG) algorithms, like GPT-2, allegedly generate human-like text across diverse domains.•We conducted two experiments (total N = 830) on human and machine behavior in the creative writing domain.•Outputs by GPT-2 were either selected or randomly paired with human poems by novices (Study 1) or professionals (Study 2).•In an incentivized version of the Turing Test, participants failed to reliably detect selected algorithmic creative text.•People are averse to AI-generated poetry, independent on receiving information about the origin of the poem, or not.

论文关键词:Natural language generation,Computational creativity,Turing,Test,Creativity,Machine behavior

论文评审过程:Received 21 January 2020, Revised 4 September 2020, Accepted 5 September 2020, Available online 8 September 2020, Version of Record 20 September 2020.

论文官网地址:https://doi.org/10.1016/j.chb.2020.106553