Yandex/Text / LLM
Yandex releases a sparse T5 model with 0.6B active params
The AliceAI-T5-35B-A0.6B is an encoder-decoder mixture-of-experts model that keeps only a sliver of its 35B parameters active per token.
Company
Yandex
1 models
Company
Releases
The AliceAI-T5-35B-A0.6B is an encoder-decoder mixture-of-experts model that keeps only a sliver of its 35B parameters active per token.
