Deep network behavior in custom training loop on shared layers

2 vues (au cours des 30 derniers jours)
John Smith
John Smith le 25 Déc 2019
Hello,
The example is clear. My question is about how it'd work if a dropout layer were added to the sub-network.
The question arises because dropout behaves differently in training (forward) and predicting (predict). During training the layer randomly sets input elements to zero given by the dropout mask each time it is invoked and at prediction the output of the layer is equal to its input (https://www.mathworks.com/help/deeplearning/ref/nnet.cnn.layer.dropoutlayer.html?s_tid=doc_ta). Therefore, it'd reason that the mask would be different for each image in the input images pair! But this is NOT what we want!
Please advise,
D

Réponses (0)

Catégories

En savoir plus sur Image Data Workflows dans Help Center et File Exchange

Produits


Version

R2019b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by