How can i use Hyperbolic tangent activation function in Neural Network

i want to change activation function from ReLU to tangent Hyperbolic function in Neural Network

now, i'm using this command

net.layers{1}.transferFcn = 'poslin';

but Is there a way to change the layer to the tangent Hyperbolic layer? Thanks

Answer 1

[Aditya Patil]

You can create a custom function, and assign it to transerFcn property. The details are mentioned in the Custom Neural Network Helper Functions documentation.

The steps for replicating this workflow are summarized as follows:

1. Navigate to the folder containing the NN transfer functions (MATLAB\<version>\toolbox\nnet\nnet\nntransfer in Windows)
2. Copy the file "tansig.m" and the directory "+tansig".
3. Paste the copied file and directory into your working directory
4. Modify the name of "tansig.m" and "+tansig" to reflect the new transfer function name, for example "myFcn.m" and "+myFcn".
5. Modify the code in the relevant files of "+myFcn"to properly calculate the new transfer function and its derivative.
6. For the layer in the neural network that will use this transfer function, change the "transferFcn" property to 'myFcn'.

[DONG JUN KIM]

Thank you for your help