What does a neural network named after a physicist who worked on the atomic bomb actually do?
It learns by simulating heat, randomness, and the slow cooling of metal - inside a computer.
The answer
Boltzmann Machines, introduced by Geoffrey Hinton and Terrence Sejnowski in 1985, are stochastic recurrent neural networks that learn internal representations through a process inspired by statistical mechanics. Named after Ludwig Boltzmann and his work on the probability distribution of particle energies, these networks use simulated annealing - gradually reducing random noise - to find optimal configurations. Each neuron makes probabilistic decisions based on the weighted sum of its inputs and a temperature parameter, allowing the network to escape local minima and explore the solution space. Though full Boltzmann Machines proved computationally impractical due to extremely slow learning, the Restricted Boltzmann Machine variant later became a key building block for deep learning, particularly in Hinton's 2006 deep belief networks.
Source: Cognitive Science Journal
- boltzmann-machines
- neural-networks
- stochastic
More from AI & Machine Learning
- What radical question did Alan Turing ask in 1950 that launched the entire field of artificial intelligence?
- Can a machine fool you into thinking it's human - and does that mean it's truly intelligent?
- What happened at a small Dartmouth workshop in 1956 that gave artificial intelligence its name?
- How did a 1958 invention called the Perceptron convince people that machines could learn like brains?
- Could a 1966 chatbot really make people believe they were talking to a therapist?
- What was the first robot that could 'reason' about its own actions?