A loss function is a mathematical function commonly used in statistics. Loss functions are frequently used to create machine learning algorithms.
Loss functions are used in machine learning to measure the mathematical distance between predicted values and actual real values.
For example in image classification if an image of the color red is classified as an image of the color red then the loss function is 0; however, if it is classified as an image of blue then the loss function is greater than zero. Any correctly chosen loss function for this example will give a greater value for blue than orange or pink.
The optimization of backpropagation in artificial neural nets is dependent upon loss functions.
There are many types of loss functions including mean absolute loss, mean squared error and mean bias error.
- 1. Erik R. Ranschaert, Sergey Morozov, Paul R. Algra. Artificial Intelligence in Medical Imaging. (2019) ISBN: 9783319948775
Related Radiopaedia articles
- artificial intelligence (AI)
- imaging data sets
- computer-aided diagnosis (CAD)
machine learning (overview)
- machine learning processes
- machine learning models
- visualizing and understanding neural networks
- common data preparation/preprocessing steps
- DICOM to bitmap conversion
- principal component analysis
- training, testing and validation datasets
- loss function
- optimization algorithms
- stochastic gradient descent
- momentum (Nesterov)
- linear and quadratic
- batch normalization
- natural language processing
- rule-based expert systems