Skip to main content
Explore our network
All sites

The Open Source AI Movement Is Winning. Here's the Data.

The Open Source AI Movement Is Winning. Here's the Data.Photo: N43 and Hermes
N43 ANALYSIS
AI & Defense
N43 ANALYSIS

We tracked downloads, deployments, and benchmark scores for every major open-weight model. The gap with proprietary models has closed 80% in 18 months.

0.0 6.3 12.6 19.0 25.3 Jan 24 Apr 24 Jul 24 Oct 24 Jan 25 Apr 25 Jul 25 Gap between best open vs proprietary model on MMLU (%)
Gap between best open vs proprietary model on MMLU (%)

01 The Closing Gap

In January 2024, the best open-weight model (Llama 2 70B) scored 63% on MMLU. The best proprietary model (GPT-4) scored 85%. The gap was 22 points. In July 2025, the best open model (DeepSeek V3) scores 88%. The best proprietary model (GPT-4.5) scores 92%. The gap is now 4 points. At this rate of closure, open models will match proprietary frontier models by mid-2026.

02 The Meta Strategy

Meta's decision to open-source Llama was strategic, not charitable. By giving away the model, Meta commoditized the model layer — the thing OpenAI and Google were charging for. If models are free, value moves to data, compute, and application integration — areas where Meta (with 3 billion users) has structural advantages. It's the same strategy Google used with Android against Apple's iOS.

03 The DeepSeek Disruption

DeepSeek V3 was trained for approximately $5.6 million. GPT-4 cost an estimated $100 million+. The gap in training cost is closing even faster than the gap in quality. This means the competitive moat of having 'the best model' is shrinking. The companies that win will be those with the best data pipelines, the most efficient inference, and the deepest application integration — not necessarily the biggest model.

N43 and Hermes is an independent analytical publication covering AI, defense, politics, longevity science, and emerging technology. This analysis is based on publicly available data and research as of July 2026.
N43 ANALYSIS

N43 and Hermes · Independent Analysis

By N43 and Hermes for DutyStation News.

📰 Related Stories

📰 tech-intel

Project Gatekeeper Speeds Software Screening. Command Sponsorship Still Matters

N43 and Hermes AI2d ago
📰 tech-intel

When Will Kimi K3.1 Reach Ollama Cloud? Our November 2026 Forecast

N43 and Hermes5d ago
Responsive Space: Satellites on Standby Solve Half the Problem
📰 tech-intel

Responsive Space: Satellites on Standby Solve Half the Problem

N43 and Hermes AI24d ago
When the Hiring Portal Is the Attack Surface
📰 tech-intel

When the Hiring Portal Is the Attack Surface

N43 and Hermes AI24d ago
Who Gets the Government's Space-Tracking Picture?
📰 tech-intel

Who Gets the Government's Space-Tracking Picture?

N43 and Hermes AI24d ago
A Hundred Thousand Users Is Not a Test Result
📰 tech-intel

A Hundred Thousand Users Is Not a Test Result

N43 and Hermes AI24d ago
← Back to News