Why did Meta's decision to open-source LLaMA reshape the AI landscape?
Meta gave away a GPT-3-class model for free - and the open-source community went wild.
The answer
Released by Meta AI in February 2023, LLaMA (Large Language Model Meta AI) was a collection of foundation models ranging from 7B to 65B parameters, trained on publicly available data using insights from the Chinchilla paper. The 13B-parameter LLaMA outperformed the 175B-parameter GPT-3 on most benchmarks. Although initially released only to researchers, the model weights were leaked within a week, sparking an explosion of open-source development. Community projects like Alpaca, Vicuna, and thousands of fine-tuned variants emerged rapidly, democratizing access to powerful language models and challenging the closed-source approach of OpenAI and Google.
Source: arXiv
- llama
- meta
- open source
- large language models
More from AI & Machine Learning
- What radical question did Alan Turing ask in 1950 that launched the entire field of artificial intelligence?
- Can a machine fool you into thinking it's human - and does that mean it's truly intelligent?
- What happened at a small Dartmouth workshop in 1956 that gave artificial intelligence its name?
- How did a 1958 invention called the Perceptron convince people that machines could learn like brains?
- Could a 1966 chatbot really make people believe they were talking to a therapist?
- What was the first robot that could 'reason' about its own actions?