Nanbeige Releases 3B Chinese-Enhanced Language Model
The new Llama-based model was trained from scratch on 3.5 trillion tokens of Chinese and English data to enhance its bilingual capabilities.
Chinese AI firm Nanbeige Technology has released Nanbeige4.1-3B, a new 3-billion-parameter language model designed for strong performance in both Chinese and English. The model is based on the popular Llama architecture but was trained from scratch on a custom, high-quality dataset of 3.5 trillion tokens.
This release adds a new contender to the growing field of specialized, efficient open models. By focusing on a specific language pair and a compact size, Nanbeige4.1-3B offers developers a capable option that can run on less powerful hardware. The company's provided benchmarks show it performing competitively against other models in its class on Chinese-centric evaluations like CMMLU and C-Eval.
Key Specifications
The model's technical details make it a practical choice for a range of applications:
- Architecture: Llama
- Parameters: 3 billion
- Context Length: 4096 tokens
- Training Data: 3.5T tokens (Chinese & English)
According to its Hugging Face release card, Nanbeige4.1-3B is available under a custom license that permits free commercial use, an important consideration for teams looking to build products with the model.
Sources
- Visit
Nanbeige/Nanbeige4.1-3B
Hugging Face
More from Nanbeige
All Nanbeige releases →
Nanbeige 4.3 Arrives as a 33B Bilingual Model
A dense English–Chinese language model lands under Apache 2.0, aimed at teams that want permissive licensing at mid-size scale.
Nanbeige 4.2 arrives as a compact 3B bilingual model
The new English-Chinese language model targets efficient deployment in a small parameter footprint.
More in Text / LLM
All Text / LLM →IBM's Granite Switch Treats Models Like Software
A new Apache-2.0 release reframes enterprise LLMs as components you can swap and update in place.
Mistral Large 4 Arrives as a 1T-Parameter MoE
The new flagship pairs a trillion total parameters with 52B active per token and adds vision alongside multilingual text.
Liquid AI debuts LFM3-1.7B for edge deployment
A compact 1.7B-parameter multilingual model built to run locally and serve as the base for specialized multimodal variants.
0 comments
No comments yet. Be the first to weigh in.