Abstract: Back-propagation algorithm is one of the key stages of neural network training. At this stage, the derivation of an activation function is employed to ...