Why is the learning rate for the bias usually twice as large as the the LR for the weights?

1 vue (au cours des 30 derniers jours)
Salma Hassan
Salma Hassan le 3 Jan 2018
Modifié(e) : Image Analyst le 5 Jan 2018
Why is the learning rate for the bias usually twice as large as the the LR for the weights?
  2 commentaires
Greg Heath
Greg Heath le 4 Jan 2018
Please post the proof of this assertion.
Greg
Salma Hassan
Salma Hassan le 5 Jan 2018
Modifié(e) : Image Analyst le 5 Jan 2018
https://datascience.stackexchange.com/questions/23549/why-is-the-learning-rate-for-the-bias-usually-twice-as-large-as-the-the-lr-for-t
on the other hand if you check, for example alexnet layers you will find that net.Layers(N, 1).BiasLearnRateFactor=2 and net.Layers(N, 1).WeightLearnRateFactor = 1

Connectez-vous pour commenter.

Connectez-vous pour répondre à cette question.

Réponses (0)

Catégories

En savoir plus sur Image Data Workflows dans Help Center et File Exchange

Tags

Produits

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by