Relation between input data points and hyper parameters that needs to be tuned
2 vues (au cours des 30 derniers jours)
Afficher commentaires plus anciens
Hi All,
Can anyone please let me know the relationship between the number of input data points and the hyperparameters/number of layers that needs to be present in any machine learning model?
Thanks for your time and help
1 commentaire
Réponse acceptée
Greg Heath
le 9 Août 2018
Modifié(e) : Greg Heath
le 9 Août 2018
[ I N] = size(input)
[ O N ] = size(target)
% (MATLAB DEFAULT)
Ntst = round(0.15*N)
Nval = Ntst
Ntrn = N-(Ntst+Nval)% ~ 0.7*N
% Design parameters
Ndes = Ntrn*O % No. of design equations ~ 0.7*N*O
H % No. of hidden nodes for I-H-O net
Nw = (I+1)*H+(H+1)*O % No. of unknown weights
Require Ndes >= Nw ==> H <= Hub = (Ntrn*O-O)/(I+O+1)
Desire Ndes >> Nw ==> H << Hub
My typical goal: Minimize H subject to the requirement
MSE < = 0.01*var(target',1) % Rsquare >= 0.99
My approach:
1. Apply the requirement to the training data
2. Loop over H to find the minimum H to satisfy the
requirement.
I have hundreds of examples in the NEWSGROUP comp.soft-sys.matlab as well as ANSWERS.
Hope this helps
Thank you for formally accepting my answer
Greg
Plus de réponses (1)
Greg Heath
le 11 Août 2018
Each case is different. However, things tend to be relatively straightforward if you have at least as many training equations as you have unknowns.
Voir également
Catégories
En savoir plus sur Image Data Workflows dans Help Center et File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!