Definition of MiniBatchSize in Matlab training options

191 vues (au cours des 30 derniers jours)
Teo
Teo le 11 Juin 2021
Hi,
i currently having confusion on the 'MiniBatchSize' function offered under trainingOptions in deep learning. I put a scenario below for better understanding on the questions.
Example:
Dataset: 4500 Sample ( 9 categories with 500 sample each)
MiniBatchSize : 10
  1. Does it mean that i would have 10 samples in every batch or 500 samples in every batch (5000 sample/10 batch)?
  2. Does having more samples in one batch size increase the accuracy of the trained network (CNN) or vise versa ?
Wish someone could help me clarify on the confusion. Thank You very much.

Réponse acceptée

Srivardhan Gadila
Srivardhan Gadila le 13 Juin 2021
For the above example with dataset having 4500 Samples ( 9 categories with 500 sample each) and MiniBatchSize = 10, it means that there are 10 samples in every mini-batch, which implies 4500/10 = 450 iterations i.e., it takes 450 iterations with 10 samples per mini-batch to complete 1 epoch (full pass on the dataset).
Regarding the impact of batch size on the accuracy, I think in general it would not effect the final accuracy although there may be variations in how many epochs it took to arrive at final accuracy depending on the batch size. The following are few things you can consider w.r.t batch size: If you have a GPU then the training time decreases significantly by setting the appropriate batch size based on the available GPU memory. Refer to Deep Learning with Big Data on GPUs and in Parallel for more information. Also if your training data is too big to fit in the available memory, you can define smaller batch size and make use of datastores. Refer to Datastores for Deep Learning for more information.

Plus de réponses (1)

Neon Argentus
Neon Argentus le 28 Oct 2021
4500 samples/epoch, 10 samples/iteration (= min_batch_size):
4500/10 = (samples/epoch)/(samples/iteration) = 450 iterations/epoch (wrt: min_batch_size = 10)

Catégories

En savoir plus sur Deep Learning Toolbox dans Help Center et File Exchange

Produits


Version

R2021a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by