European AI Sovereignty Part 9 of 9
  1. 1 Building AI Platforms Under European Sovereignty
  2. 2 Architecting for Two Europes with Compliance-as-Code
  3. 3 A Practical Guide to the European Sovereign Inference Stack
  4. 4 Securing the Open Source AI Supply Chain
  5. 5 What It Actually Takes to Fine-Tune an LLM in Europe
  6. 6 When the API Gets Switched Off
  7. 7 Compute Isn't the Constraint
  8. 8 Where AI Research Actually Happens, in Six Charts
  9. 9 How Far Behind Are Open Weights, Measured
About this series

How Far Behind Are Open Weights, Measured

How Far Behind Are Open Weights, Measured

Where AI Research Actually Happens ended on one bar chart: the best open-weight models trail the closed frontier by four months on Epoch's index, ten on private benchmarks, sixteen on compute. A single bar hides the interesting part, which is how that lag has moved. This post is the lag over time, and what it says about a sovereign stack that runs on weights it did not train.

The data is Epoch AI's Capabilities Index (ECI), a composite of more than fifty benchmarks fitted onto one scale, anchored so that Claude 3.5 Sonnet scores 130 and GPT-5 scores 150. I took the published scores on 30 October 2026: 273 models with a score and a release date, 143 of them closed, 123 with downloadable weights, and seven that Epoch files as neither (a limited-access Gemini preview, hosted-only Qwen variants, and Mistral Large 4 itself, scored as an API preview), which I left out. The file is under every chart, and every number in this post comes from one script over it.

Two staircases

The closed frontier and the open-weight frontier on the Epoch Capabilities Index, 2023 to 2026Two staircases rising over time. The closed line runs from GPT-4 at 126 in March 2023 to GPT-6 Astra at 169 in September 2026. The open-weight line runs from LLaMA-65B at 110 in February 2023 to DeepSeek V4.1 Flash at 159 in October 2026, staying below the closed line throughout and nearly touching it in January 2025 at DeepSeek-R1.1101201301401501601702023202420252026ECIGPT-4 (Mar 2023) (OpenAI), 14 Mar 2023: ECI 125.7GPT-4 Turbo (Nov 2023) (OpenAI), 25 Jan 2024: ECI 126.4Claude 3 Opus (Anthropic), 29 Feb 2024: ECI 126.9GPT-4 Turbo (Apr 2024) (OpenAI), 9 Apr 2024: ECI 127.3GPT-4o (May 2024) (OpenAI), 13 May 2024: ECI 129.0Claude 3.5 Sonnet (Anthropic), 20 Jun 2024: ECI 130.0o1-mini (OpenAI), 12 Sep 2024: ECI 135.7o1 (OpenAI), 17 Dec 2024: ECI 141.7Gemini 2.5 Pro (Mar 2025) (Google DeepMind), 31 Mar 2025: ECI 144.0o3 (OpenAI), 16 Apr 2025: ECI 146.8o3-pro (OpenAI), 10 Jun 2025: ECI 147.4GPT-5 (OpenAI), 7 Aug 2025: ECI 150.0GPT-5 Pro (OpenAI), 7 Oct 2025: ECI 150.7Gemini 3 Pro (Google DeepMind), 18 Nov 2025: ECI 153.1GPT-5.2 Pro (OpenAI), 11 Dec 2025: ECI 156.4GPT-5.3 Codex (OpenAI), 5 Feb 2026: ECI 157.1GPT-5.4 Pro (OpenAI), 5 Mar 2026: ECI 159.6GPT-5.5 Pro (OpenAI), 23 Apr 2026: ECI 162.9Claude Fable 5 (Anthropic), 9 Jun 2026: ECI 163.1Claude Opus 5 (Anthropic), 24 Jul 2026: ECI 163.8Claude Fable 5.1 (Anthropic), 1 Sep 2026: ECI 166.2GPT-6 Astra (OpenAI), 3 Sep 2026: ECI 168.9LLaMA-65B (Meta AI), 24 Feb 2023: ECI 109.9Llama 2-70B (Meta AI), 18 Jul 2023: ECI 113.6Stable Beluga 2 (Stability AI), 20 Jul 2023: ECI 117.0Yi-34B (01.AI), 2 Nov 2023: ECI 117.3Mixtral 8x7B (Mistral AI), 11 Dec 2023: ECI 118.4Mixtral 8x22B (Mistral AI), 17 Apr 2024: ECI 122.0Llama 3-70B (Meta AI), 18 Apr 2024: ECI 123.0DeepSeek-V2 (MoE-236B, May 2024) (DeepSeek), 7 May 2024: ECI 124.8Qwen2-72B (Alibaba), 7 Jun 2024: ECI 125.3Llama 3.1-405B (Meta AI), 23 Jul 2024: ECI 128.8Qwen2.5-72B (Alibaba), 19 Sep 2024: ECI 129.0Phi-4 (Microsoft Research), 12 Dec 2024: ECI 130.5DeepSeek-V3 (DeepSeek), 26 Dec 2024: ECI 132.3DeepSeek-R1 (DeepSeek), 20 Jan 2025: ECI 138.8Qwen3-235B-A22B (Alibaba), 28 Apr 2025: ECI 139.2DeepSeek-R1 (May 2025) (DeepSeek), 28 May 2025: ECI 141.2Qwen3-235B-A22B-Thinking (Jul 2025) (Alibaba), 25 Jul 2025: ECI 143.8DeepSeek-V3.2-Exp (DeepSeek), 29 Sep 2025: ECI 144.9Kimi K2 Thinking (Moonshot), 6 Nov 2025: ECI 145.8DeepSeek-V3.2 (DeepSeek), 1 Dec 2025: ECI 146.1Kimi K2.5 (Moonshot), 27 Jan 2026: ECI 148.1GLM-5.1 (Z.ai (Zhipu AI)), 7 Apr 2026: ECI 149.8Kimi K2.6 (Moonshot), 20 Apr 2026: ECI 151.0GLM-5.2 (Z.ai (Zhipu AI)), 16 Jun 2026: ECI 152.0Kimi K3 (Moonshot), 16 Jul 2026: ECI 157.9DeepSeek V4.1 Flash 1017 (DeepSeek), 17 Oct 2026: ECI 158.7GPT-4o1GPT-5GPT-6 AstraLlama 3.1-405BDeepSeek-R1Kimi K3Closed 169Open 159DeepSeek V4.1 FlashClosed frontierOpen-weight frontier
The highest ECI score available with closed weights and with open weights, by release date. Each dot is a new record. Epoch AI Capabilities Index, 30 October 2026 fit.Download the data (CSV)

The closed frontier has gone from GPT-4 at 126 to GPT-6 Astra at 169 in three and a half years. The open-weight frontier has gone from LLaMA-65B at 110 to DeepSeek V4.1 Flash at 159. Both lines climb at about the same rate, which is the first thing worth knowing: the open models are not falling further behind in capability terms, they are climbing a staircase that someone else built a few months earlier.

The second thing is where the two lines nearly meet. In January 2025 DeepSeek-R1 landed at 139, three points below o1, which had been the closed frontier for a month. That is the closest the open line has come to the closed one in the whole series.

The lag, day by day

How many months behind the closed frontier the best open-weight model was, day by dayA sawtooth line. The lag climbs between open-weight releases and drops at each one. It peaks just above 16 months in July 2024, falls to about 1 month at DeepSeek-R1 in January 2025, and sits between 4 and 8 months through 2026. Each record is a dot coloured by the lab's country: China from December 2024 onwards.0369121518months behind the closed frontier2023202420252026Llama 2-70B (Meta AI), 18 Jul 2023: 4.1 months behind, matched GPT-4 (Mar 2023) of Mar 2023Stable Beluga 2 (Stability AI), 20 Jul 2023: 4.2 months behind, matched GPT-4 (Mar 2023) of Mar 2023Yi-34B (01.AI), 2 Nov 2023: 7.7 months behind, matched GPT-4 (Mar 2023) of Mar 2023Mixtral 8x7B (Mistral AI), 11 Dec 2023: 8.9 months behind, matched GPT-4 (Mar 2023) of Mar 2023Mixtral 8x22B (Mistral AI), 17 Apr 2024: 13.1 months behind, matched GPT-4 (Mar 2023) of Mar 2023Llama 3-70B (Meta AI), 18 Apr 2024: 13.2 months behind, matched GPT-4 (Mar 2023) of Mar 2023DeepSeek-V2 (MoE-236B, May 2024) (DeepSeek), 7 May 2024: 13.8 months behind, matched GPT-4 (Mar 2023) of Mar 2023Qwen2-72B (Alibaba), 7 Jun 2024: 14.8 months behind, matched GPT-4 (Mar 2023) of Mar 2023Llama 3.1-405B (Meta AI), 23 Jul 2024: 2.3 months behind, matched GPT-4o (May 2024) of May 2024Qwen2.5-72B (Alibaba), 19 Sep 2024: 4.2 months behind, matched GPT-4o (May 2024) of May 2024Phi-4 (Microsoft Research), 12 Dec 2024: 3.0 months behind, matched o1-mini of Sep 2024DeepSeek-V3 (DeepSeek), 26 Dec 2024: 3.4 months behind, matched o1-mini of Sep 2024DeepSeek-R1 (DeepSeek), 20 Jan 2025: 1.1 months behind, matched o1 of Dec 2024Qwen3-235B-A22B (Alibaba), 28 Apr 2025: 4.3 months behind, matched o1 of Dec 2024DeepSeek-R1 (May 2025) (DeepSeek), 28 May 2025: 5.3 months behind, matched o1 of Dec 2024Qwen3-235B-A22B-Thinking (Jul 2025) (Alibaba), 25 Jul 2025: 3.8 months behind, matched Gemini 2.5 Pro (Mar 2025) of Mar 2025DeepSeek-V3.2-Exp (DeepSeek), 29 Sep 2025: 5.5 months behind, matched o3 of Apr 2025Kimi K2 Thinking (Moonshot), 6 Nov 2025: 6.7 months behind, matched o3 of Apr 2025DeepSeek-V3.2 (DeepSeek), 1 Dec 2025: 7.5 months behind, matched o3 of Apr 2025Kimi K2.5 (Moonshot), 27 Jan 2026: 5.7 months behind, matched GPT-5 of Aug 2025GLM-5.1 (Z.ai (Zhipu AI)), 7 Apr 2026: 8.0 months behind, matched GPT-5 of Aug 2025Kimi K2.6 (Moonshot), 20 Apr 2026: 5.0 months behind, matched Gemini 3 Pro of Nov 2025GLM-5.2 (Z.ai (Zhipu AI)), 16 Jun 2026: 6.9 months behind, matched Gemini 3 Pro of Nov 2025Kimi K3 (Moonshot), 16 Jul 2026: 4.4 months behind, matched GPT-5.4 Pro of Mar 2026DeepSeek V4.1 Flash 1017 (DeepSeek), 17 Oct 2026: 7.4 months behind, matched GPT-5.4 Pro of Mar 2026Llama 3.1-405BDeepSeek-R1Qwen2-72BKimi K3Chinese labAmerican labEuropean lab
For each day, the best open-weight model available, and how many months earlier the closed frontier first reached its score. Dots are the open-weight records, coloured by the country of the lab that released them. Derived from the Epoch data above.Download the data (CSV)

The measure is simple. Take the best open-weight model available on a given day. Find the first day the closed frontier reached that score. The lag is the time between the two. It climbs by one day per day between open releases and drops at each new record, which gives the sawtooth.

The sawtooth has three regions. Through 2023 and the first half of 2024 the closed frontier was GPT-4 and its successors, stuck within three points of 126 for fourteen months while the open models crawled up from 110. By June 2024 Qwen2-72B had got to 125 and the lag was fifteen months, and the day before Llama 3.1 405B it touched sixteen. Then the 405B model matched GPT-4o and the lag fell to two months in one release.

The second region is the eighteen months from July 2024 to the end of 2025, when the lag never got above nine months and averaged four to six. DeepSeek-R1 in January 2025 brought it down to one month, the lowest point in the data.

The third region is 2026, where the lag has settled into a band between four and nine months and the sawtooth teeth have the same shape every time: a Chinese lab releases, the lag drops to four or five, two or three months pass, it climbs to eight or nine, another Chinese lab releases. The mean for 2026 to date is 6.7 months. On 30 October it was 7.9, because GPT-6 Astra had gone out in September and nothing open had answered it yet.

The half-year means, for the record:

Half year Mean lag, months Mean gap, ECI points
2023 H2 6.6 9.2
2024 H1 12.6 6.4
2024 H2 5.9 5.2
2025 H1 3.8 5.5
2025 H2 6.2 6.4
2026 H1 7.0 10.7
2026 H2 to 30 Oct 6.3 8.9

Epoch's own figure is lower than mine, and the difference is the method. Their May 2026 analysis counts an open model as having caught up with a closed one when it beats it in at least five per cent of bootstrap resamples, which is a generous reading of two overlapping error bars. On that reading the lag since January 2026 is four months. On a strict reading, where the open model's central score has to match, they get six, and my day-by-day version of the same strict reading gets between six and seven. Their October 2025 analysis of the two years before that gave 3.5 months with a 90% interval of 1.1 to 5.3, which matches the middle region of the chart. Both pieces say the gap is slightly wider than it was. The chart agrees, and adds that the widening happened in capability points before it happened in months: the ECI gap was five or six points through 2025 and has been nine to eleven through 2026. The closed labs have found a faster gear, and the open labs are matching their pace from further back.

Who holds the record

Which country's lab held the open-weight record, February 2023 to October 2026A horizontal strip coloured by country. American labs hold the record for most of 2023, French Mistral for the winter of 2023 to 2024, then the strip is Chinese from 26 December 2024 to the end without a break.LLaMA-65B (Meta AI), 24 Feb 2023 to 18 Jul 2023: United StatesLlama 2-70B (Meta AI), 18 Jul 2023 to 20 Jul 2023: United StatesStable Beluga 2 (Stability AI), 20 Jul 2023 to 2 Nov 2023: EuropeYi-34B (01.AI), 2 Nov 2023 to 11 Dec 2023: ChinaMixtral 8x7B (Mistral AI), 11 Dec 2023 to 17 Apr 2024: EuropeMixtral 8x22B (Mistral AI), 17 Apr 2024 to 18 Apr 2024: EuropeLlama 3-70B (Meta AI), 18 Apr 2024 to 7 May 2024: United StatesDeepSeek-V2 (MoE-236B, May 2024) (DeepSeek), 7 May 2024 to 7 Jun 2024: ChinaQwen2-72B (Alibaba), 7 Jun 2024 to 23 Jul 2024: ChinaLlama 3.1-405B (Meta AI), 23 Jul 2024 to 19 Sep 2024: United StatesQwen2.5-72B (Alibaba), 19 Sep 2024 to 12 Dec 2024: ChinaPhi-4 (Microsoft Research), 12 Dec 2024 to 26 Dec 2024: United StatesDeepSeek-V3 (DeepSeek), 26 Dec 2024 to 20 Jan 2025: ChinaDeepSeek-R1 (DeepSeek), 20 Jan 2025 to 28 Apr 2025: ChinaQwen3-235B-A22B (Alibaba), 28 Apr 2025 to 28 May 2025: ChinaDeepSeek-R1 (May 2025) (DeepSeek), 28 May 2025 to 25 Jul 2025: ChinaQwen3-235B-A22B-Thinking (Jul 2025) (Alibaba), 25 Jul 2025 to 29 Sep 2025: ChinaDeepSeek-V3.2-Exp (DeepSeek), 29 Sep 2025 to 6 Nov 2025: ChinaKimi K2 Thinking (Moonshot), 6 Nov 2025 to 1 Dec 2025: ChinaDeepSeek-V3.2 (DeepSeek), 1 Dec 2025 to 27 Jan 2026: ChinaKimi K2.5 (Moonshot), 27 Jan 2026 to 7 Apr 2026: ChinaGLM-5.1 (Z.ai (Zhipu AI)), 7 Apr 2026 to 20 Apr 2026: ChinaKimi K2.6 (Moonshot), 20 Apr 2026 to 16 Jun 2026: ChinaGLM-5.2 (Z.ai (Zhipu AI)), 16 Jun 2026 to 16 Jul 2026: ChinaKimi K3 (Moonshot), 16 Jul 2026 to 17 Oct 2026: ChinaDeepSeek V4.1 Flash 1017 (DeepSeek), 17 Oct 2026 to 30 Oct 2026: China2023202420252026Chinese labAmerican labEuropean lab
Which country's lab released the best open-weight model available, day by day. Same data.Download the data (CSV)

Of the 1,344 days from the first LLaMA to the end of October 2026, an American lab held the open-weight record for 237, a European lab for 234 and a Chinese lab for 873. Europe's share is Mistral for 129 days over the winter of 2023 to 2024, and 105 days in 2023 when Stability AI's Stable Beluga 2 was the best open model in the world, which is the only time a British lab has appeared on this strip.

Since 26 December 2024, the day DeepSeek-V3 went past Phi-4, the record has been Chinese without a break: 673 days. DeepSeek, Alibaba, Moonshot and Z.ai have passed it between them fourteen times. Meta's best 2025 release, Llama 4 Maverick, scored 132 in April against DeepSeek-R1's 139 from January. OpenAI's gpt-oss-120b in August 2025 scored 140 against a Chinese record of 144. The American open frontier is now Meta's Muse Spark Open at 155, released in October 2026 and ten months behind the closed line.

Under what licence the open-weight record holder was releasedThe same strip coloured by licence. Non-commercial for the first LLaMA, restricted use through most of 2023 and 2024, unrestricted for most of 2025 and 2026, then non-commercial again for Kimi K3 from July to October 2026.LLaMA-65B (Meta AI), 24 Feb 2023 to 18 Jul 2023: Non-commercialLlama 2-70B (Meta AI), 18 Jul 2023 to 20 Jul 2023: Restricted useStable Beluga 2 (Stability AI), 20 Jul 2023 to 2 Nov 2023: Non-commercialYi-34B (01.AI), 2 Nov 2023 to 11 Dec 2023: Restricted useMixtral 8x7B (Mistral AI), 11 Dec 2023 to 17 Apr 2024: UnrestrictedMixtral 8x22B (Mistral AI), 17 Apr 2024 to 18 Apr 2024: UnrestrictedLlama 3-70B (Meta AI), 18 Apr 2024 to 7 May 2024: Restricted useDeepSeek-V2 (MoE-236B, May 2024) (DeepSeek), 7 May 2024 to 7 Jun 2024: Restricted useQwen2-72B (Alibaba), 7 Jun 2024 to 23 Jul 2024: UnrestrictedLlama 3.1-405B (Meta AI), 23 Jul 2024 to 19 Sep 2024: Restricted useQwen2.5-72B (Alibaba), 19 Sep 2024 to 12 Dec 2024: UnrestrictedPhi-4 (Microsoft Research), 12 Dec 2024 to 26 Dec 2024: UnrestrictedDeepSeek-V3 (DeepSeek), 26 Dec 2024 to 20 Jan 2025: Restricted useDeepSeek-R1 (DeepSeek), 20 Jan 2025 to 28 Apr 2025: UnrestrictedQwen3-235B-A22B (Alibaba), 28 Apr 2025 to 28 May 2025: UnrestrictedDeepSeek-R1 (May 2025) (DeepSeek), 28 May 2025 to 25 Jul 2025: UnrestrictedQwen3-235B-A22B-Thinking (Jul 2025) (Alibaba), 25 Jul 2025 to 29 Sep 2025: UnrestrictedDeepSeek-V3.2-Exp (DeepSeek), 29 Sep 2025 to 6 Nov 2025: UnrestrictedKimi K2 Thinking (Moonshot), 6 Nov 2025 to 1 Dec 2025: Restricted useDeepSeek-V3.2 (DeepSeek), 1 Dec 2025 to 27 Jan 2026: UnrestrictedKimi K2.5 (Moonshot), 27 Jan 2026 to 7 Apr 2026: UnrestrictedGLM-5.1 (Z.ai (Zhipu AI)), 7 Apr 2026 to 20 Apr 2026: UnrestrictedKimi K2.6 (Moonshot), 20 Apr 2026 to 16 Jun 2026: UnrestrictedGLM-5.2 (Z.ai (Zhipu AI)), 16 Jun 2026 to 16 Jul 2026: UnrestrictedKimi K3 (Moonshot), 16 Jul 2026 to 17 Oct 2026: Non-commercialDeepSeek V4.1 Flash 1017 (DeepSeek), 17 Oct 2026 to 30 Oct 2026: Unrestricted2023202420252026UnrestrictedRestricted useNon-commercial
The same strip, coloured by the licence the record holder was released under, using Epoch's three categories.Download the data (CSV)

The licence strip matters more than the country strip if you are the one deploying. The record holder was unrestricted (Apache 2.0, MIT or equivalent) for 803 of those days, under a use-restricted licence of the Llama kind for 199, and non-commercial for 342. The non-commercial days are the first LLaMA, Stable Beluga 2, and then ninety-three days from July to October 2026 when the best open-weight model in the world was Kimi K3, released under Moonshot's own licence: free until your group revenue passes twenty million dollars a year, then a separate agreement. Epoch files that as non-commercial. For most of the firms I would expect to be reading this, it is.

So the model you would have picked for a production stack in September 2026, on capability alone, was one you could not legally run in production. DeepSeek V4.1 Flash has since taken the record back under MIT, and the strip is green again. It was red for a quarter, and nothing stops it going red again.

Three open frontiers

The open-weight frontier by region, against the closed frontierFour staircases. The closed frontier ends at 169. The Chinese open-weight frontier tracks it closest, ending at 159. The American open-weight frontier ends at 155 with Meta's Muse Spark Open. The European frontier, all Mistral, ends at 141 in April 2026, with Mistral Large 4's preview score of 150.5 shown as a hollow point at its weights release on 29 October 2026.1101201301401501601702023202420252026ECIGPT-4 (Mar 2023) (OpenAI), 14 Mar 2023: ECI 125.7GPT-4 Turbo (Nov 2023) (OpenAI), 25 Jan 2024: ECI 126.4Claude 3 Opus (Anthropic), 29 Feb 2024: ECI 126.9GPT-4 Turbo (Apr 2024) (OpenAI), 9 Apr 2024: ECI 127.3GPT-4o (May 2024) (OpenAI), 13 May 2024: ECI 129.0Claude 3.5 Sonnet (Anthropic), 20 Jun 2024: ECI 130.0o1-mini (OpenAI), 12 Sep 2024: ECI 135.7o1 (OpenAI), 17 Dec 2024: ECI 141.7Gemini 2.5 Pro (Mar 2025) (Google DeepMind), 31 Mar 2025: ECI 144.0o3 (OpenAI), 16 Apr 2025: ECI 146.8o3-pro (OpenAI), 10 Jun 2025: ECI 147.4GPT-5 (OpenAI), 7 Aug 2025: ECI 150.0GPT-5 Pro (OpenAI), 7 Oct 2025: ECI 150.7Gemini 3 Pro (Google DeepMind), 18 Nov 2025: ECI 153.1GPT-5.2 Pro (OpenAI), 11 Dec 2025: ECI 156.4GPT-5.3 Codex (OpenAI), 5 Feb 2026: ECI 157.1GPT-5.4 Pro (OpenAI), 5 Mar 2026: ECI 159.6GPT-5.5 Pro (OpenAI), 23 Apr 2026: ECI 162.9Claude Fable 5 (Anthropic), 9 Jun 2026: ECI 163.1Claude Opus 5 (Anthropic), 24 Jul 2026: ECI 163.8Claude Fable 5.1 (Anthropic), 1 Sep 2026: ECI 166.2GPT-6 Astra (OpenAI), 3 Sep 2026: ECI 168.9Qwen-14B (Alibaba), 24 Sep 2023: ECI 112.8Yi-34B (01.AI), 2 Nov 2023: ECI 117.3DeepSeek-V2 (MoE-236B, May 2024) (DeepSeek), 7 May 2024: ECI 124.8Qwen2-72B (Alibaba), 7 Jun 2024: ECI 125.3Qwen2.5-72B (Alibaba), 19 Sep 2024: ECI 129.0DeepSeek-V3 (DeepSeek), 26 Dec 2024: ECI 132.3DeepSeek-R1 (DeepSeek), 20 Jan 2025: ECI 138.8Qwen3-235B-A22B (Alibaba), 28 Apr 2025: ECI 139.2DeepSeek-R1 (May 2025) (DeepSeek), 28 May 2025: ECI 141.2Qwen3-235B-A22B-Thinking (Jul 2025) (Alibaba), 25 Jul 2025: ECI 143.8DeepSeek-V3.2-Exp (DeepSeek), 29 Sep 2025: ECI 144.9Kimi K2 Thinking (Moonshot), 6 Nov 2025: ECI 145.8DeepSeek-V3.2 (DeepSeek), 1 Dec 2025: ECI 146.1Kimi K2.5 (Moonshot), 27 Jan 2026: ECI 148.1GLM-5.1 (Z.ai (Zhipu AI)), 7 Apr 2026: ECI 149.8Kimi K2.6 (Moonshot), 20 Apr 2026: ECI 151.0GLM-5.2 (Z.ai (Zhipu AI)), 16 Jun 2026: ECI 152.0Kimi K3 (Moonshot), 16 Jul 2026: ECI 157.9DeepSeek V4.1 Flash 1017 (DeepSeek), 17 Oct 2026: ECI 158.7LLaMA-65B (Meta AI), 24 Feb 2023: ECI 109.9Llama 2-70B (Meta AI), 18 Jul 2023: ECI 113.6Llama 3-70B (Meta AI), 18 Apr 2024: ECI 123.0Llama 3.1-405B (Meta AI), 23 Jul 2024: ECI 128.8Phi-4 (Microsoft Research), 12 Dec 2024: ECI 130.5Llama 4 Maverick (Meta AI), 6 Apr 2025: ECI 132.2gpt-oss-120b (OpenAI), 5 Aug 2025: ECI 139.8Gemma 4 31B IT (Google DeepMind), 2 Apr 2026: ECI 143.0Nemotron 3 Ultra (Nvidia), 4 Jun 2026: ECI 145.9Inkling-Small (Thinking Machines), 15 Jul 2026: ECI 150.4Muse Spark Open (Meta AI), 15 Oct 2026: ECI 154.9Stable Beluga 2 (Stability AI), 20 Jul 2023: ECI 117.0Mixtral 8x7B (Mistral AI), 11 Dec 2023: ECI 118.4Mixtral 8x22B (Mistral AI), 17 Apr 2024: ECI 122.0Mistral Large 2 (Jul 2024) (Mistral AI), 24 Jul 2024: ECI 127.6Mistral Large 2 (Nov 2024) (Mistral AI), 18 Nov 2024: ECI 128.6Magistral Small 1.0 (Mistral AI), 10 Jun 2025: ECI 133.1Mistral Medium 3.5 (Mistral AI), 28 Apr 2026: ECI 141.4Mistral Large 4, weights released 29 Oct 2026; Epoch scored the API preview at 150.5 on 6 OctClosed frontier 169Open, China 159Open, US 155Mistral Large 4, preview 150.5Open, Europe 141Closed frontierOpen, ChinaOpen, USOpen, Europe
The best open-weight score from a Chinese, American and European lab, each as its own staircase, against the closed frontier. Mistral Large 4 is shown hollow at its weights release on 29 October 2026, at the score Epoch gave its API preview three weeks earlier.Download the data (CSV)

A sovereign stack argument usually stops at “open weights”, as if open weights were one thing. The chart splits them by where the lab is.

The Chinese line is the open frontier. It has been the top open line since the end of 2024 and sits just under eight months behind the closed frontier today.

The American line is Meta, Microsoft, OpenAI's one open release, Nvidia, Thinking Machines and Meta again. It fell behind the Chinese line in December 2024 and has stayed behind it, by about a year for most of 2026: Gemma 4 in April was twelve months behind the closed frontier, Nemotron 3 Ultra in June was nearly fourteen, and Muse Spark Open in October is ten.

The European line is Mistral and only Mistral. It was the top open line for part of 2023 and 2024, when Mixtral 8x7B and 8x22B were the best models anyone would let you download. Since then every Mistral release has been well below both other open lines. Mistral Medium 3.5, the best European open-weight model Epoch had scored at the end of October, is at 141 and sixteen months behind the closed frontier.

Mistral Large 4 changes this, and the timing is why it is a hollow dot. Epoch scored the API preview at 150.5 on 6 October. The weights went up on Hugging Face on 29 October under Mistral's new Ecosystem Open-Weight licence, a modified MIT whose one restriction is that selling the model as a hosted service needs a separate commercial licence. If the downloadable weights keep the preview score, which they should, Europe's open frontier jumps from sixteen months behind to under thirteen. That puts it level with the American line, which only passed 150 itself in October, and six months behind the Chinese one. The closed model it matches is GPT-5 Pro, the frontier of October 2025.

If “sovereign” means weights from a lab under European law, the stack post already said you pay a capability price for it. The chart puts a number on it: a year behind the frontier for Mistral Large 4, sixteen months for anything before it, against seven or eight for Chinese weights you accept the provenance of.

DeepSeek, and the compute that was not spent

Epoch Capabilities Index against estimated training compute, open and closed modelsA scatter on a log compute axis. Closed models sit to the right, from GPT-4 at 2 times 10 to the 25 FLOP up to GPT-6 Astra at 9 times 10 to the 26. Open-weight models sit to the left between 10 to the 24 and 2 times 10 to the 25, with DeepSeek-R1 at 139 and Kimi K3 at 158 scoring where closed models spent ten to a hundred times the compute.1e241e251e261e27120130140150160170training compute, FLOPECIGPT-4 (Mar 2023) (OpenAI), Mar 2023: ECI 125.7, 2.1e+25 FLOPQwen2-72B (Alibaba), Jun 2024: ECI 125.3, 3.0e+24 FLOPClaude 3.5 Sonnet (Anthropic), Jun 2024: ECI 130.0, 2.7e+25 FLOPLlama 3.1-70B (Meta AI), Jul 2024: ECI 125.9, 7.9e+24 FLOPLlama 3.1-405B (Meta AI), Jul 2024: ECI 128.8, 3.8e+25 FLOPQwen2.5-72B (Alibaba), Sep 2024: ECI 129.0, 7.8e+24 FLOPLlama 3.3 70B (Meta AI), Dec 2024: ECI 127.3, 6.9e+24 FLOPPhi-4 (Microsoft Research), Dec 2024: ECI 130.5, 9.3e+23 FLOPDeepSeek-V3 (DeepSeek), Dec 2024: ECI 132.3, 3.3e+24 FLOPDeepSeek-R1 (DeepSeek), Jan 2025: ECI 138.8, 3.5e+24 FLOPClaude 3.7 Sonnet (Anthropic), Feb 2025: ECI 141.1, 3.3e+25 FLOPGPT-4.5 (OpenAI), Feb 2025: ECI 136.7, 3.8e+26 FLOPQwQ-32B (Alibaba), Mar 2025: ECI 137.5, 3.5e+24 FLOPGemma 3 27B (Google DeepMind), Mar 2025: ECI 130.0, 2.3e+24 FLOPDeepSeek-V3 (Mar 2025) (DeepSeek), Mar 2025: ECI 135.9, 3.3e+24 FLOPLlama 4 Scout (Meta AI), Apr 2025: ECI 129.6, 4.1e+24 FLOPLlama 4 Maverick (Meta AI), Apr 2025: ECI 132.2, 2.2e+24 FLOPGrok 3 (xAI), Apr 2025: ECI 138.2, 3.5e+26 FLOPQwen3-8B (Alibaba), Apr 2025: ECI 136.1, 1.8e+24 FLOPQwen3-235B-A22B (Alibaba), Apr 2025: ECI 139.2, 4.8e+24 FLOPQwen3-30B-A3B (Alibaba), Apr 2025: ECI 136.1, 6.5e+23 FLOPQwen3-14B (Alibaba), Apr 2025: ECI 138.2, 3.2e+24 FLOPQwen3-32B (Alibaba), Apr 2025: ECI 138.4, 7.1e+24 FLOPDeepSeek-R1 (May 2025) (DeepSeek), May 2025: ECI 141.2, 4.0e+24 FLOPGrok 4 (xAI), Jul 2025: ECI 146.3, 5.0e+26 FLOPQwen3-235B-A22B-Thinking (Jul 2025) (Alibaba), Jul 2025: ECI 143.8, 4.8e+24 FLOPgpt-oss-20b (OpenAI), Aug 2025: ECI 137.7, 5.5e+23 FLOPgpt-oss-120b (OpenAI), Aug 2025: ECI 139.8, 4.9e+24 FLOPGPT-5 (OpenAI), Aug 2025: ECI 150.0, 6.6e+25 FLOPDeepSeek-V3.1 (DeepSeek), Aug 2025: ECI 139.8, 3.6e+24 FLOPQwen3-Max (Alibaba), Sep 2025: ECI 142.3, 1.5e+25 FLOPDeepSeek-V3.2-Exp (DeepSeek), Sep 2025: ECI 144.9, 4.2e+24 FLOPKimi K2 Thinking (Moonshot), Nov 2025: ECI 145.8, 4.2e+24 FLOPDeepSeek-V3.2 (DeepSeek), Dec 2025: ECI 146.1, 4.2e+24 FLOPGLM-4.7 (Z.ai (Zhipu AI)), Dec 2025: ECI 143.6, 4.4e+24 FLOPKimi K2.5 (Moonshot), Jan 2026: ECI 148.1, 5.8e+24 FLOPGLM-5 (Z.ai (Zhipu AI)), Feb 2026: ECI 145.8, 6.8e+24 FLOPDeepSeek-V4-Flash (DeepSeek), Apr 2026: ECI 146.1, 2.5e+24 FLOPDeepSeek-V4-Pro (DeepSeek), Apr 2026: ECI 149.2, 9.7e+24 FLOPNemotron 3 Ultra (Nvidia), Jun 2026: ECI 145.9, 6.6e+24 FLOPInkling (Thinking Machines), Jul 2026: ECI 148.4, 1.1e+25 FLOPKimi K3 (Moonshot), Jul 2026: ECI 157.9, 2.0e+25 FLOPGLM-5.3-Flash (Z.ai (Zhipu AI)), Aug 2026: ECI 153.1, 3.2e+24 FLOPGPT-6 Astra (OpenAI), Sep 2026: ECI 168.9, 9.4e+26 FLOPDeepSeek V4.1 Flash (DeepSeek), Sep 2026: ECI 156.0, 4.3e+24 FLOPGPT-4GPT-4.5Grok 4GPT-5GPT-6 AstraLlama 3.1-405BDeepSeek-R1Kimi K3DeepSeek V4.1 FlashClaude 3.7 SonnetClosed weightsOpen weights
ECI against estimated training compute for the models Epoch has both numbers for. Compute estimates from Epoch's open-versus-closed dataset and the Notable AI Models table; most recent closed models have no public estimate and are missing.Download the data (CSV)

Compute Isn't the Constraint used DeepSeek-V3 as the exception: near-frontier capability for 2.8 million H800 hours, which the technical report prices at about five and a half million dollars. The scatter says it stopped being an exception the moment it happened.

Every open-weight model above 140 on this chart sits between two and twenty times 1024 FLOP. Every closed model above 140 with a public estimate sits at 1025 or above. GPT-5 at 150 used 6.6 times 1025. Kimi K2.5 reached 148 five months later on 5.8 times 1024, an eleventh of it. GPT-6 Astra at 169 is estimated at 9.4 times 1026. DeepSeek V4.1 Flash at 156 is on 4.3 times 1024, which is about one two-hundredth.

The November 2024 Epoch report measured a fifteen to sixteen month lag in training compute, with Llama 3.1 405B as the open model that finally spent what GPT-4 had spent. Nobody has released weights trained on more compute than that model since. Epoch's largest open estimate after it is Kimi K3 at 2 times 1025, half of Llama's budget, scoring 158 to Llama's 129. The compute lag is now a measure of something the open labs have decided not to do, and the capability lag of seven months is what their alternative costs them.

Which is the point for the research argument from June. The thing that put DeepSeek, Moonshot and Z.ai seven months behind GPT-6 rather than three years behind it is not a cluster. It is the set of techniques that make a 4 times 1024 FLOP training run score 156, most of which they published, and all of which were developed by people who could not buy their way out of the constraint.

The lag by other measures

The index is one lens. Here are the others, with my reading of each.

Measure Lag Source and date
Epoch Capabilities Index, allowing a draw within the error bars 4 months Epoch AI, May 2026, from 1 January 2026
Epoch Capabilities Index, strict 6 to 8 months This post, 2026 to date; Epoch's strict figure is 6
Cyber ECI 6 to 7 months Epoch AI, October 2026
Public benchmarks 4 to 6 months Håvard Tveit Ihle, May 2026, 9 benchmarks
Private benchmarks 8 to 10 months Same, 8 benchmarks
Training compute 15 to 16 months Epoch AI, November 2024; no open model has passed Llama 3.1 405B since

The cyber row is new since the six charts post. Epoch's cyber-only index puts Z.ai's GLM-5.3 above GPT-5.4 and below Claude Mythos Preview, so the open cyber frontier in October 2026 was where the closed one stood six or seven months earlier. If you are picking open weights for security work, that is the number.

The public and private benchmark rows come from Håvard Tveit Ihle's analysis of Epoch's benchmark data, not from Epoch itself, which the six charts post had wrong and now says. His method is different from the index: for each of seventeen benchmarks he sets score thresholds and times how long after the first closed model each threshold was crossed by an open one. The private set lags the public set by about four months, which he reads as the open models tuning harder on the benchmarks they can see. He also notes that several of his “private” benchmarks are semi-private at best, that exposure cuts both ways, and that his guess is the real gap is larger than ten months, not smaller.

What it means for the stack

The June post said the achievable sovereign win was operational: freeze open weights, host them under your own law, accept that the training was not yours. The data adds three qualifications.

The lag is seven months, and it is stable. A stack built on the best open weights today runs what the closed frontier was running in March. For most production work that is fine, and the staircase shows no sign of the open line stalling. It is a lag, not a ceiling.

The best open weights are Chinese, and have been for 673 days. The post on securing the open-source supply chain covers what that means in practice. The capability data says the alternative, American or European open weights, costs you another three to nine months, and that the European option costs the most. Mistral Large 4 narrows that from sixteen months to thirteen. It does not close it.

The licence is the variable nobody charts. Kimi K3 held the open record for a quarter under terms that excluded most of the firms who would want it. The strip above is green most of the time, and the exceptions are recent. Pin the licence of the weights you deploy as carefully as you pin the weights.

The data

Every chart has a CSV link, and they all come out of one script over Epoch's published scores. The Epoch file itself is here as taken on 30 October 2026, so the derivation can be checked. ECI scores shift slightly each time Epoch refits the index, so the figures here will not match a later download to the decimal.

Sources