Yandex/Text / LLMWorkstation GPU
Yandex releases 80B MoE base model under Apache 2.0
AliceAI-Foundation is a sparse mixture-of-experts model with just 3B active parameters, aimed at Russian and English text.
Company
Yandex
2 models
CategoriesText / LLM
Releases
Yandex/Text / LLMConsumer GPU
Yandex releases a sparse T5 model with 0.6B active params
The AliceAI-T5-35B-A0.6B is an encoder-decoder mixture-of-experts model that keeps only a sliver of its 35B parameters active per token.
