Does the Chinese Room argument prove AI can never truly understand anything?

A person following translation rules in Chinese doesn't understand Chinese - so does a language model understand language?

The answer

Philosopher John Searle's 1980 Chinese Room thought experiment imagines a person in a room who follows English instructions to manipulate Chinese symbols, producing correct Chinese responses without understanding a word. Searle argued this proves that symbol manipulation (what computers do) can never produce genuine understanding, no matter how sophisticated. The argument has gained renewed urgency with large language models that generate remarkably coherent text. Critics counter with the 'systems reply' - that understanding emerges from the whole system, not any single component - while defenders note that LLMs demonstrably lack grounded understanding of the physical world. The debate remains one of the most contested in philosophy of mind.

Source: Stanford Encyclopedia of Philosophy

More from AI & Machine Learning

All AI & Machine Learning →