Moonshot AI Releases Trillion-Parameter Kimi-K2 Model

Moonshot AI has released the weights for Kimi-K2-Instruct, a new large language model built at a massive scale. The model is described as having a trillion parameters, placing it among the largest open-access models available to researchers and developers.

Built on a Mixture-of-Experts (MoE) architecture, Kimi-K2 is designed for efficiency at scale. The model features a 128,000-token context window, enabling it to process and reason over extensive documents and complex codebases. According to the developers, the model's strengths lie in its agentic capabilities and coding performance, suggesting an aptitude for multi-step, autonomous tasks.

A New Tool for Complex Tasks

The release of a trillion-parameter model is a significant event for the open-source AI landscape. It provides a powerful foundation for building sophisticated applications that require deep reasoning and the ability to maintain context over long interactions. Key features of Kimi-K2-Instruct include:

• Massive Scale: One trillion parameters.
• Efficient Architecture: Mixture-of-Experts (MoE).
• Large Context: 128,000-token window.
• Specialization: Strong performance in coding and agentic reasoning.

The model weights and card are now available for download from the Hugging Face Hub. The model is released under a custom license, and developers should review its specific terms of use before integrating it into their work.