IFM/Text / LLMMulti-GPU server
IFM releases K2-Horizon, a 375B open-weight MoE
The flagship model uses a mixture-of-experts design that activates just 23 billion parameters per token, keeping inference costs in check.
Company
Releases
The flagship model uses a mixture-of-experts design that activates just 23 billion parameters per token, keeping inference costs in check.
The dense 7-billion-parameter model ships as open weights alongside the datasets used to train it.
The open-weight language model activates just 4B of its 36B parameters per token, aiming for efficiency without shedding capacity.