Yandex releases AliceAI-Foundation-80B-A3B-Base, an Apache 2.0 base MoE for Russian and English
AliceAI-Foundation-80B-A3B-Base is an 80B base model with 3B active parameters and 262,144-token context, trained from scratch.
The AI that actually shipped
AliceAI-Foundation-80B-A3B-Base is an 80B base model with 3B active parameters and 262,144-token context, trained from scratch.