Aleph Alpha's open Kolibri model routes each token through 3.46B of its 78.1B parameters
Aleph Alpha released Kolibri, an Apache 2.0 German-English model that activates 3.46B of its 78.1B parameters per token. Each token costs about as much compute as a small model, yet a team hosting it in Europe still has to fit every expert in memory.
The Engineer · Build desk

What happened
- Aleph Alpha trained Kolibri on 24 trillion tokens using 768 NVIDIA B200 GPUs located in Germany and Finland.
- According to the dev.to write-up, Kolibri's UniBPE tokenizer needs 11.2% fewer tokens for German text than GPT-5's tokenizer does.
- The Hugging Face model card lists reasoning at four levels (none, low, medium and high), tool calling, and a knowledge cutoff of June 18, 2026.
- Aleph Alpha has signed the EU General-Purpose AI Code of Practice, the voluntary framework that accompanies the AI Act.
Why it matters
- What it costs cost A European team self-hosting Kolibri for sovereignty still pays for hardware sized to the full model. The lower per-token compute shows up as throughput on that hardware.
- What it limits constraint A sovereignty requirement that covers data lineage as well as hosting and jurisdiction has to be checked against the third-party models the card lists in the data pipeline.
- Who has to decide decision The weights are Apache 2.0 and no provider can change or switch off the model, so adopting Kolibri depends on a team's own German evals and its memory budget.
Next story · Build · 6h ago
Reflection's 501B-parameter Beam coding model launches on SageMaker JumpStartConfirmed2 publishers
Kolibri is German for hummingbird [21]. That suits the compute side of this design and flatters the memory side. In a mixture-of-experts model, the work per token follows the active parameters, and the memory a server must hold follows the total. The dev.to write-up describes Kolibri as light on compute but carrying considerable memory [11]. Each token runs through 3.46B parameters, about 4.4% of the 78.1B that stay loaded. The resident model is roughly 22.6 times the slice used on any one token [16]. Kolibri moves Aleph Alpha from the dense models of its earlier Luminous family to this design [12].
If the weights are held at 16 bits, two bytes each, the full set is about 156.2 GB before any KV cache [17]. Quantized to 8 bits, it is about 78.1 GB [18]. The write-up does not state the released precision or a recommended serving configuration.
On the tokenizer figures, a German passage that takes 1,000 tokens under GPT-5's tokenizer takes about 888 under UniBPE [19]. On a self-hosted deployment, that means fewer decode steps per German answer and more German text per context window [19]. The saving carries over only if your German resembles the text it was measured on. Running a sample of your own documents through both tokenizers is a cheap check.
Aleph Alpha's own evaluation puts Kolibri above every comparable model of its size in German and English [5]. That is the vendor grading its own work, and the dev.to piece tells readers to treat it with caution [5]. For the ranking to apply to you, your prompts need to resemble the evaluation set. "Its size" also needs to mean the size you pay for, which could be 3.46B active or 78.1B resident [3].
The sovereignty claim is about where the model was built and which law applied. Aleph Alpha wrote in its launch post, as quoted in an analysis on tej.as, that "teams built the model in Germany, trained it on infrastructure in Germany and Finland, under European and German law, with no foreign control" [7]. The post uses the word "sovereign" several times [8]. The model card covers the data side. English training text was rewritten with Google's Gemma 4 and German text with Mistral-NeMo, and Qwen3-32B labeled data for the quality filters [10]. Aleph Alpha says it also filtered out political bias it measured in Chinese open models [20].
Listing that pipeline in the model card was good practice. The card shipped with the weights and a 189-page technical report on October 3, 2026 [2]. A reviewer can check a data-lineage requirement against the models it names. The dev.to author places Kolibri's sovereignty in the training infrastructure, the governing law and control of the final model, and not in every byte of data having come from Europe [13].
What to watch
- Independent German and English benchmark results that compare Kolibri against models matched on active and on total parameter counts.
- Guidance from Aleph Alpha or others on the released weight precision and the hardware needed to serve all 78.1B parameters.
- Whether EU public-sector buyers accept a sovereignty claim for a model whose training data was rewritten and labeled by Gemma 4, Mistral-NeMo and Qwen3-32B.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence72
- Adoption
- Not scored
- Hype gap+15
- Incentives65
- Confidence70
Perspective Coverage
6 publishers- Builder
- Builder 47%
- Operator
- Operator 37%
- Investor
- Investor 16%
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Kolibri's weights are released under the Apache 2.0 license.
- [2]
Aleph Alpha, based in Heidelberg, presented Kolibri on October 3, 2026, alongside a launch post, a 189-page technical report and the weights on Hugging Face.
- [3]
Kolibri is an open-weight German and English mixture-of-experts model with 78.1 billion total parameters that activates only 3.46 billion parameters per token (4.4%).
- [4]
Kolibri was trained on 24 trillion tokens on 768 NVIDIA B200 GPUs located in Germany and Finland.
- [5]
In Aleph Alpha's internal evaluation, Kolibri ranks above all comparable models of its size in German and English; the dev.to write-up says this should be read with caution because it comes from the maker, not an independent benchmark.
- [6]
Kolibri's UniBPE tokenizer cuts the number of tokens needed for German by 11.2% compared with GPT-5's tokenizer.
- [7]
"teams built the model in Germany, trained it on infrastructure in Germany and Finland, under European and German law, with no foreign control"
- [8]
In its launch post, Aleph Alpha describes the model with the word "sovereign", repeated several times.
- [9]
According to the launch post, customers get full deployment freedom and IP security, with compliance built in by design and not dependent on an external provider that could change or switch off the model.
- [10]
The Kolibri model card states that English training text was rewritten with Google's Gemma 4, German text with Mistral-NeMo, and that Qwen3-32B labeled data for the quality filters.
- [11]
The dev.to write-up describes Kolibri as light in compute while carrying considerable memory.
- [12]
Aleph Alpha previously released the Luminous family; Kolibri is an architecture jump from dense models to mixture-of-experts.
- [13]
Kolibri's sovereignty lies in the training infrastructure, the applicable law and control of the final model, not in every byte of data having originated in Europe.
- [14]
According to the Hugging Face model card, Kolibri supports reasoning at four levels (none, low, medium, high) and tool calling, with a knowledge cutoff of June 18, 2026.
- [15]
Aleph Alpha signed the EU General-Purpose AI Code of Practice, the voluntary framework that accompanies the AI Act for general-purpose models.
- [16]
Kolibri's active parameters are about 4.4% of its total, and the total is roughly 22.6 times the active set.
- [17]
At 16-bit precision (two bytes per parameter), Kolibri's 78.1B weights occupy about 156.2 GB before KV cache.
- [18]
At 8-bit precision (one byte per parameter), Kolibri's 78.1B weights occupy about 78.1 GB.
- [19]
German text that takes 1,000 tokens under GPT-5's tokenizer would take about 888 tokens under UniBPE, meaning fewer generation steps and more text per context window.
- [20]
Aleph Alpha filtered out political bias that it says it measured in Chinese open models.
- [21]
Kolibri means hummingbird in German.
Sources
6 independent publishers whose own reporting we read for this story.
- cryptobriefing.comAleph Alpha releases Kolibri, a 78B-parameter open-weight AI model built in Europe
1 article · October 3, 2026
- dev.toAleph Alpha lanza Kolibri, LLM alemán que activa solo 4,4% de sus parámetros
1 article · October 3, 2026
- mezha.netAleph Alpha випустила відкриту модель Kolibri з контекстом до мільйона токенів
1 article · October 5, 2026
- runtimewire.comAleph Alpha releases German AI model with 78 GB of FP8 weights
1 article · October 3, 2026
- testingcatalog.comAleph Alpha releases open-weight Kolibri with 1M context
1 article · October 3, 2026
- the-decoder.comAleph Alpha releases Kolibri, an open-weight model that makes the case for European AI sovereignty
1 article · October 5, 2026