Variance

Variance in machine learning is the degree of sensitivity of a model's predictions to changes in the training data. High variance means that the model is too complex and overfits the training data, i.e., it learns the noise and idiosyncrasies of the training data rather than the underlying patterns. As a result, the model performs well on the training data but poorly on the unseen data or test set.

Low variance, on the other hand, indicates that the model is too simple and underfits the training data, i.e., it fails to capture the relevant features and patterns in the data. This leads to poor performance both on the training and test sets.

Scale your annotation workflows and power your model performance with data-driven insights

Try Encord today

Variance is one of the components of the bias-variance trade-off, a fundamental concept in machine learning that refers to the trade-off between the complexity and flexibility of the model and its ability to generalize to new, unseen data. Balancing the bias-variance trade-off is crucial for developing accurate and robust machine learning models.