Question 1 of 9 Fundamentals Concept
What is overfitting?
Short answer
Overfitting happens when a model learns noise, idiosyncrasies or training-specific patterns that fail to generalize to genuinely new cases.
Why
A flexible model can achieve nearly perfect training performance by capturing incidental features rather than stable predictors. In small biological studies this is especially risky because correlated features, repeated donors and technical batches greatly outnumber independent units. Diagnose overfitting by comparing training and correctly separated validation performance, examining learning curves and using external cohorts where possible.
Control complexity with appropriate regularization, feature selection performed inside each training fold and adequate sample design. Strong internal validation still may not predict deployment at another hospital because the population and laboratory process differ. Report uncertainty rather than selecting a lucky split.
The core issue is poor generalization, not merely that the model has many parameters or that its training accuracy is high.
Common mistakes
- Using one random train-test split with technical replicates from the same participant on both sides
The interviewer might ask next
What evidence would distinguish overfitting from a new-hospital distribution shift?