How can we use Nadam optimizer in place of sgdm in training deep learning networks

Training_Options = trainingOptions('sgdm', ...

'MiniBatchSize', 32, ...

'MaxEpochs', 50, ...

"InitialLearnRate", 1e-5, ...

'Shuffle', 'every-epoch', ...

'ValidationData', Resized_Validation_Data, ...

'ValidationFrequency', 40, ...

"ExecutionEnvironment","gpu",...

'Plots','training-progress', ...

'Verbose',false);

Answer 1

[Joss Knight]

You cannot do this using trainNetwork. You need to use a dlnetwork with a custom training loop so you can author your own update rule. Perhaps adam will work for you instead.