Activation Functions

This book describes the functions frequently used in deep neural networks.

This book describes the functions frequently used in deep neural networks. For this purpose, 37 activation functions are explained both mathematically and visually, and given with their LaTeX implementations due to their common use in scientific articles.

Autorentext

Yasin Kütük who is holding a Ph.D. in economics is an assistant professor at the Department of Economics at Altinbas University, Istanbul. His main research fields include computational social science, deep learning, econometrics, and statistical NLP.

Inhalt

Introduction - Machine Learning - Neural Networks - Activation Functions - Monotonic Activation Functions - Periodic Activation Functions - Bias Unit .