#mixture of experts
1 published article
Aleph Alpha Kolibri-1 opens 78B German and English MoE weights under Apache 2.0, with 3.46B active parameters
The 3 October release needs one H200 or two A100 80 GB cards plus a vLLM plugin. Aleph Alpha's blog and model card give different German shares of the training mix.