How did Google teach computers to understand that 'king minus man plus woman equals queen'?
Word2Vec revealed that language has a hidden geometry - and it blew linguists' minds.
The answer
In 2013, Tomas Mikolov and his team at Google published Word2Vec, a method for learning dense vector representations of words from massive text corpora using shallow neural networks. The model maps each word to a vector in 100–300 dimensional space, where semantic relationships emerge as arithmetic operations: the vector for 'king' minus 'man' plus 'woman' produces a vector closest to 'queen.' Trained on the Google News dataset of about 100 billion words, Word2Vec captured analogies, synonyms, and even cultural biases embedded in language. It became a foundational building block for virtually all subsequent NLP systems.
Source: arXiv (Mikolov et al.)
- nlp
- word embeddings
- representation learning
More from AI & Machine Learning
- What radical question did Alan Turing ask in 1950 that launched the entire field of artificial intelligence?
- Can a machine fool you into thinking it's human - and does that mean it's truly intelligent?
- What happened at a small Dartmouth workshop in 1956 that gave artificial intelligence its name?
- How did a 1958 invention called the Perceptron convince people that machines could learn like brains?
- Could a 1966 chatbot really make people believe they were talking to a therapist?
- What was the first robot that could 'reason' about its own actions?