Why did open-source AI models suddenly explode in 2024?

The AI giants kept their models locked up - until a wave of open challengers proved you don't need billions to compete.

The answer

2024 saw an unprecedented wave of powerful open-source and open-weight large language models. Meta released Llama 3 (April 2024) with 8B and 70B parameter versions trained on over 15 trillion tokens. France's Mistral AI launched Mixtral 8x22B, a mixture-of-experts model rivaling GPT-3.5 at a fraction of the cost. China's Alibaba released Qwen2 models competitive with leading Western counterparts. These open models democratized AI development, allowing startups, researchers, and governments to fine-tune powerful models without depending on API providers, fundamentally shifting the power dynamics of the AI industry.

Source: Meta AI Blog

More from AI & Machine Learning

All AI & Machine Learning →