What do magnets and memory have in common? Ask a physicist who reinvented neural networks in 1982.
A physicist borrowed ideas from spin glasses and gave neural networks something they never had before - associative memory.
The answer
In 1982, Caltech physicist John Hopfield published a landmark paper in the Proceedings of the National Academy of Sciences introducing what are now called Hopfield networks. Inspired by the physics of spin glasses, these recurrent neural networks store patterns as stable energy minima, allowing them to retrieve a complete memory from partial or noisy input - a property called content-addressable or associative memory. Each neuron connects to every other neuron with symmetric weights, and the network provably converges to a stored pattern by minimizing an energy function analogous to the Ising model in statistical mechanics. Hopfield's work bridged physics and neuroscience, reinvigorated neural network research during the expert-systems era, and earned him a share of the 2024 Nobel Prize in Physics.
Source: Proceedings of the National Academy of Sciences
- hopfield
- neural-networks
- associative-memory
More from AI & Machine Learning
- What radical question did Alan Turing ask in 1950 that launched the entire field of artificial intelligence?
- Can a machine fool you into thinking it's human - and does that mean it's truly intelligent?
- What happened at a small Dartmouth workshop in 1956 that gave artificial intelligence its name?
- How did a 1958 invention called the Perceptron convince people that machines could learn like brains?
- Could a 1966 chatbot really make people believe they were talking to a therapist?
- What was the first robot that could 'reason' about its own actions?