Moonshot AI Releases Trillion-Parameter Kimi-K2 Model
The new Mixture-of-Experts model brings massive scale to the open-weights community, focusing on complex reasoning and coding tasks with a 128K context window.
Moonshot AI has released the weights for Kimi-K2-Instruct, a new large language model built at a massive scale. The model is described as having a trillion parameters, placing it among the largest open-access models available to researchers and developers.
Built on a Mixture-of-Experts (MoE) architecture, Kimi-K2 is designed for efficiency at scale. The model features a 128,000-token context window, enabling it to process and reason over extensive documents and complex codebases. According to the developers, the model's strengths lie in its agentic capabilities and coding performance, suggesting an aptitude for multi-step, autonomous tasks.
A New Tool for Complex Tasks
The release of a trillion-parameter model is a significant event for the open-source AI landscape. It provides a powerful foundation for building sophisticated applications that require deep reasoning and the ability to maintain context over long interactions. Key features of Kimi-K2-Instruct include:
- Massive Scale: One trillion parameters.
- Efficient Architecture: Mixture-of-Experts (MoE).
- Large Context: 128,000-token window.
- Specialization: Strong performance in coding and agentic reasoning.
The model weights and card are now available for download from the Hugging Face Hub. The model is released under a custom license, and developers should review its specific terms of use before integrating it into their work.
Sources
- Visit
moonshotai/Kimi-K2-Instruct
Hugging Face
0 comments
No comments yet. Be the first to weigh in.
More in Text / LLM
Zhipu AI Releases MIT-Licensed GLM-5.2 MoE Model
The new bilingual model from the Chinese AI firm uses a Mixture of Experts architecture and sparse attention under a fully permissive license.
Weibo AI Releases VibeThinker-3B, a Compact Reasoning Model
The new 3-billion-parameter model from the Chinese tech giant focuses on challenging benchmarks in mathematics, coding, and graduate-level questions.
Moonshot AI Releases Kimi, a Multimodal Coding Model
The new Mixture-of-Experts model from the Chinese AI company can generate code while also understanding visual inputs, a rare combination in open models.