Does the Chinese Room argument prove AI can never truly understand anything?
A person following translation rules in Chinese doesn't understand Chinese - so does a language model understand language?
The answer
Philosopher John Searle's 1980 Chinese Room thought experiment imagines a person in a room who follows English instructions to manipulate Chinese symbols, producing correct Chinese responses without understanding a word. Searle argued this proves that symbol manipulation (what computers do) can never produce genuine understanding, no matter how sophisticated. The argument has gained renewed urgency with large language models that generate remarkably coherent text. Critics counter with the 'systems reply' - that understanding emerges from the whole system, not any single component - while defenders note that LLMs demonstrably lack grounded understanding of the physical world. The debate remains one of the most contested in philosophy of mind.
Source: Stanford Encyclopedia of Philosophy
- philosophy
- chinese room
- understanding
- consciousness
More from AI & Machine Learning
- What radical question did Alan Turing ask in 1950 that launched the entire field of artificial intelligence?
- Can a machine fool you into thinking it's human - and does that mean it's truly intelligent?
- What happened at a small Dartmouth workshop in 1956 that gave artificial intelligence its name?
- How did a 1958 invention called the Perceptron convince people that machines could learn like brains?
- Could a 1966 chatbot really make people believe they were talking to a therapist?
- What was the first robot that could 'reason' about its own actions?