A Controlled Accuracy-Based Recursive Algorithm for Approximation of Sigmoid Activation

xlomafota.13 shared this article with you from Inoreader A Controlled Accuracy-Based Recursive Algorithm for Approximation of Sigmoid Activation Via Latest Results for National Academy Science Letters Abstract The sigmoid activation function is widely used in the development of neural networks. It is implemented in hardware development using an approximation scheme. In this paper, a piecewise linear (PWL) approximation scheme is developed as an accuracy controlled recursive algorithm. It uses a maximum allowable error as an input parameter and the least square method for finding the PWL function. The algorithm's accuracy is calculated with an absolute average and maximum error and compared to the state of the art. The approximation scheme's hardware implementation complexity is compared in terms of the number of PWL functions required. Results show that the proposed algorithm requires comparatively fewer PWL functions for the approximate sigmoid function for the specified accuracy. View on the web Inoreader. Take back control of your news feed. Follow us on Twitter and Facebook.