GigaChat 3.5 arrives as a 432B mixture-of-experts model
The multilingual instruct model activates 28B parameters per token and leans on hybrid attention for efficiency at scale.
The team behind GigaChat has published GigaChat3.5-432B-A28B on Hugging Face, a large mixture-of-experts language model aimed at instruction-following across multiple languages. According to the model page, it carries 432 billion total parameters but activates only about 28 billion for any given token.
That sparse design is the whole point. Instead of running every parameter for every request, an MoE model routes each token through a small subset of specialized "experts," which keeps inference costs closer to a mid-sized dense model while retaining the capacity of a much larger one. GigaChat 3.5 pairs this with hybrid attention, a technique meant to trim the memory and compute overhead that normally grows with longer inputs.
Why it matters
Open-weight MoE releases at this scale remain relatively rare, and each one gives practitioners another option outside the handful of frontier labs. The key details here:
- 432B total parameters, with roughly 28B active per token
- Multilingual instruction tuning rather than an English-only focus
- Hybrid attention to manage the efficiency trade-offs of a very large model
A few specifics are still unstated on the release page, notably the context window and the exact licensing terms, both of which will shape how usable the model is in production. For now, GigaChat 3.5 lands as a notable addition to the growing roster of large sparse models available to download and run.
Sources
- Visit
ai-sage/GigaChat3.5-432B-A28B
Hugging Face
More in Text / LLM
Meituan Ships a Lighter, Sparser LongCat-Flash
The food-delivery giant's newest open model trims its mixture-of-experts design for more efficient inference under an MIT license.
DeepSeek Refreshes V4-Flash With New 0731 Checkpoint
The MIT-licensed mixture-of-experts model returns in an updated build shipping with FP8 weights for cheaper inference.
DeepSeek Ships V4-Flash, a 304B MoE Tuned for Agents
The latest checkpoint in DeepSeek's V4 line leans into agentic workflows while keeping the permissive MIT license.
0 comments
No comments yet. Be the first to weigh in.