A Better Activation Function for Artificial Neural Networks

Abstract

An activation function, possibly new, is proposed for use in digital simulation of artificial neural networks, on the ground that the computational operation count for this function is much smaller than for those employing exponentials and it satisfies a simple differential equation generalizing the logistic equation.