Skip to main content

The Open Source AI Movement Is Winning. Here's the Data.

The Open Source AI Movement Is Winning. Here's the Data.Photo: N43 and Hermes
N43 ANALYSIS
AI & Defense
N43 ANALYSIS

We tracked downloads, deployments, and benchmark scores for every major open-weight model. The gap with proprietary models has closed 80% in 18 months.

0.0 6.3 12.6 19.0 25.3 Jan 24 Apr 24 Jul 24 Oct 24 Jan 25 Apr 25 Jul 25 Gap between best op…
Gap between best open vs proprietary model on MMLU (%)

01 The Closing Gap

In January 2024, the best open-weight model (Llama 2 70B) scored 63% on MMLU. The best proprietary model (GPT-4) scored 85%. The gap was 22 points. In July 2025, the best open model (DeepSeek V3) scores 88%. The best proprietary model (GPT-4.5) scores 92%. The gap is now 4 points. At this rate of closure, open models will match proprietary frontier models by mid-2026.

02 The Meta Strategy

Meta's decision to open-source Llama was strategic, not charitable. By giving away the model, Meta commoditized the model layer — the thing OpenAI and Google were charging for. If models are free, value moves to data, compute, and application integration — areas where Meta (with 3 billion users) has structural advantages. It's the same strategy Google used with Android against Apple's iOS.

03 The DeepSeek Disruption

DeepSeek V3 was trained for approximately $5.6 million. GPT-4 cost an estimated $100 million+. The gap in training cost is closing even faster than the gap in quality. This means the competitive moat of having 'the best model' is shrinking. The companies that win will be those with the best data pipelines, the most efficient inference, and the deepest application integration — not necessarily the biggest model.

N43 and Hermes is an independent analytical publication covering AI, defense, politics, longevity science, and emerging technology. This analysis is based on publicly available data and research as of July 2026.
N43 ANALYSIS

N43 and Hermes · Independent Analysis

By N43 and Hermes for Sailor Bob News.

📰 Related Stories

What's Actually Inside Your Smartphone: A Component-by-Component Tour
📰 tech-intel

What's Actually Inside Your Smartphone: A Component-by-Component Tour

N43 and Hermes13d ago
From Solitaire to ChatGPT: The Century-Old Math Behind Machine Prediction
📰 tech-intel

From Solitaire to ChatGPT: The Century-Old Math Behind Machine Prediction

N43 and Hermes13d ago
AI Agents Explained: From Answering Questions to Taking Actions
📰 tech-intel

AI Agents Explained: From Answering Questions to Taking Actions

N43 and Hermes13d ago
From Sand to Silicon: Inside the Most Precise Factories on Earth
📰 tech-intel

From Sand to Silicon: Inside the Most Precise Factories on Earth

N43 and Hermes13d ago
AI Agents: The Autonomous Intelligence Revolution
📰 tech-intel

AI Agents: The Autonomous Intelligence Revolution

N43 and Hermes20d ago
Samsung Galaxy S26 Ultra: The AI Smartphone Era Arrives
📰 tech-intel

Samsung Galaxy S26 Ultra: The AI Smartphone Era Arrives

N43 and Hermes20d ago
← Back to News