Shape autotuning activation function

作者：

Highlights：

• A smooth, nonmonotonic, bounded activation function is proposed.

• Proposed function solves the common deficiencies of existing functions.

• Properties of proposed function are studied and discussed.

• Performance of proposed function is evaluated on three different tasks.

摘要

•A smooth, nonmonotonic, bounded activation function is proposed.•Proposed function solves the common deficiencies of existing functions.•Properties of proposed function are studied and discussed.•Performance of proposed function is evaluated on three different tasks.

论文关键词：Activation functions,Deep learning

论文评审过程：Received 7 September 2020, Revised 22 December 2020, Accepted 22 December 2020, Available online 29 December 2020, Version of Record 23 January 2021.

论文官网地址：https://doi.org/10.1016/j.eswa.2020.114534