Batch size (machine learning)
Batch size is a term used in machine learning and refers to the number of training examples utilized in one iteration. The batch size can be one of three options:
- batch mode: where the batch size is equal to the total dataset thus making the iteration and epoch values equivalent
- mini-batch mode: where the batch size is greater than one but less than the total dataset size. Usually, a number that can be divided into the total dataset size.
- stochastic mode: where the batch size is equal to one. Therefore the gradient and the neural network parameters are updated after each sample.
Related Radiopaedia articles
Artificial intelligence
- artificial intelligence (AI)
- imaging data sets
- computer-aided diagnosis (CAD)
- machine learning (overview)
- models
- common data preparation/preprocessing steps
- DICOM to bitmap conversion
- scaling
- centering
- normalization
- principal component analysis
- training, testing and validation datasets
- augmentation
-
loss function
- mean squared error
- cross entropy
- optimization algorithms
- stochastic gradient descent
- momentum (Nesterov)
- ADAM
-
regularisation
- linear and quadratic
- batch normalization
-
ensembling
- boosting
- bagging
- natural language processing
- rule-based expert systems
- glossary
Unable to process the form. Check for errors and try again.