How did one statistician's 'Random Forests' algorithm grow into one of the most reliable tools in machine learning?
Sometimes the wisdom of the crowd applies to decision trees too.
The answer
In 2001, UC Berkeley statistician Leo Breiman published his landmark paper introducing Random Forests, an ensemble method that builds hundreds or thousands of decision trees on random subsets of data and features, then aggregates their predictions by majority vote. The paper has been cited over 100,000 times, making it one of the most influential machine learning papers ever written. Random Forests became beloved for their resistance to overfitting, ability to handle missing data, and requiring minimal hyperparameter tuning, making them a default choice in fields from genomics to finance.
Source: Machine Learning Journal (Springer)
- ensemble methods
- decision trees
- machine learning
More from AI & Machine Learning
- What radical question did Alan Turing ask in 1950 that launched the entire field of artificial intelligence?
- Can a machine fool you into thinking it's human - and does that mean it's truly intelligent?
- What happened at a small Dartmouth workshop in 1956 that gave artificial intelligence its name?
- How did a 1958 invention called the Perceptron convince people that machines could learn like brains?
- Could a 1966 chatbot really make people believe they were talking to a therapist?
- What was the first robot that could 'reason' about its own actions?