Regression to the Mean
Sidharth Mahotra
Senior Principal Data and Computer Vision Scientist | IEEE member | Career Coach
We all know about linear regression, but have you heard of "regression to the mean"?
Galton's Discovery
This fascinating statistical phenomenon was first observed by Francis Galton in the 19th century. He called it "regression towards mediocrity" - a term that might raise eyebrows today!
??Here's the scoop:
The Concept of "Mediocrity"
When Galton used the term "mediocrity," he was referring to the average or mean of the population. In modern terms, we would say "regression to the mean" rather than "regression to mediocrity." This change in terminology helps avoid any negative connotations associated with the word mediocrity.
领英推荐
Beyond Height: A Universal Phenomenon
Although Galton's initial observations were based on height, he and subsequent researchers realized that this phenomenon applies to many other characteristics and situations where multiple factors influence outcomes . It occurs whenever there is an imperfect correlation between two measures.
Statistical Explanation
Regression to the mean thus is a statistical phenomenon where extreme observations tend to be followed by more moderate ones. This occurs because extreme values are often partly due to random chance, and subsequent measurements are likely to be closer to the true average of the population. For example, if a student scores exceptionally high on one test, their next test score is likely to be closer to their average performance, even without any change in their abilities. This has many implications like :
Understanding regression to the mean can prevent us from misinterpreting data or overreacting to extreme events. It's a crucial tool in fields from medicine to finance.
So, next time you see an outlier, remember: it might just be nature's way of balancing the scales! ??