Underfitting
IntermediateEnglish: Underfitting
When a model cannot capture underlying structure, performing poorly on both training and test data.
Why It Matters
Understanding underfitting is essential for building effective machine learning models. By ensuring that models are appropriately complex, practitioners can improve prediction accuracy and enhance performance across various applications, from image classification to natural language processing.
Definition
Underfitting occurs when a machine learning model is too simplistic to capture the underlying structure of the data, resulting in poor performance on both training and test datasets. This phenomenon is characterized by high bias, where the model fails to learn from the training data adequately. Mathematically, underfitting can be observed when the model's error is significantly higher than the optimal error achievable by more complex models. Common causes of underfitting include insufficient model capacity, inappropriate choice of model architecture, or inadequate feature representation. To address underfitting, practitioners may increase model complexity, enhance feature engineering, or employ more sophisticated algorithms.