The Open Weights
LatestModelsLeaderboardsCompanies
Subscribe
The Open Weights

The daily record of open-source AI. New model releases, leaderboards, and what's coming next — written for people who ship.

Refreshed every 12 hours

Discover

  • Latest releases
  • New today
  • Trending models

Browse

  • All models
  • Companies
  • Categories
  • Leaderboards

About

  • About
  • Editorial policy
  • Hardware estimates
  • RSS feed
  • llms.txt
  • Newsletter

© 2026 The Open Weights. An independent publication.

PrivacyTermsSMSAggregated by Claude · curated by humans.
LatestMicrosoft1.0-4B
MicrosoftText / LLM

Microsoft's FastContext is a 4B sub-agent for code

A compact Qwen3-derived model built to explore repositories, released under a permissive MIT license.

Jun 14, 2026
UpdateMIT
FastContext 1.0 4B SFT

Microsoft has published FastContext 1.0 4B SFT, a small language model designed to act as a repository-exploration sub-agent. Rather than a general-purpose assistant, it is tuned for the narrower job of navigating and gathering context from codebases—the kind of grunt work that larger orchestrating models can offload to a cheaper helper.

The model is a supervised fine-tune of Qwen3-4B, weighing in at roughly four billion parameters. That size is deliberate: a 4B model is light enough to run cheaply and quickly, which matters when its role is to be called repeatedly inside a larger agent pipeline.

Why it matters

The interesting signal here is architectural, not benchmark-driven. As coding agents mature, the field is increasingly splitting tasks across specialized models instead of routing everything through one expensive frontier system.

  • It targets a specific function—context retrieval across repositories—rather than broad chat.
  • It builds on an open Qwen3 base, continuing the pattern of vendors fine-tuning each other's weights.
  • It ships under the permissive MIT license, leaving developers free to adapt and deploy it.

Details such as context length and evaluation results are sparse at launch, so the model's real-world usefulness as a sub-agent will be judged by the teams who wire it into their own toolchains. For now, it is a small, openly licensed building block aimed squarely at agentic coding workflows.

Sources

  • microsoft/FastContext-1.0-4B-SFT

    Hugging Face

    Visit
OlderMoonshot AI releases Kimi K3, a 2.8T-parameter MoE modelMoonshot AI · Text / LLM · 5 months agoNewerPoolside Releases Laguna-M.1, an Open MoE ModelPoolside · Text / LLM · 5 months ago

Get the model

Hugging Face

Specs

Parameters4B
Context window262K tokens
Size8 GB
PrecisionBF16
ArchitectureQwen3ForCausalLM
LicenseMIT
Downloads7K
Likes369

Can you run it?

Runs on a laptop — about 4.2 GB at 4-bit.

  • BF16 (as published)

    12 GB GPU (RTX 3060 / 4070) · 16 GB Mac

    9.8 GB
  • 8-bit

    8 GB GPU (RTX 4060) · 16 GB laptop or Mac

    6.1 GB
  • 4-bit

    8 GB GPU (RTX 4060) · 16 GB laptop or Mac

    4.2 GB
Your machine
GGUF builds
  • KV cache approximated from model size (no config metadata) at 8,192 tokens.

Based on Hugging Face weights metadata. Assumes an 8K context and ~1 GB runtime overhead; actual needs vary. How we estimate


Modalities

CodeText / LLM

The Weekly Weights

Every open release that mattered, one email a week.

0 comments

No comments yet. Be the first to weigh in.

More from Microsoft

All Microsoft releases →
FrogNano-4B
Microsoft/Text / LLMRuns on a laptop

Microsoft Releases FrogNano-4B Under MIT License

The compact 4-billion-parameter text model lands on Hugging Face with a permissive license aimed at developers.

Sep 17, 2026
VibeVoice-ASR-Streaming-7B
Microsoft/Speech → TextRuns on a laptop

Microsoft's VibeVoice ASR brings streaming speech-to-text

A 7-billion-parameter model targets real-time, multilingual transcription with an open release on Hugging Face.

Sep 2, 2026
Mage-VL
Microsoft/Vision-LanguageRuns on a laptop

Microsoft's Mage-VL Streams Video Natively

A codec-native multimodal foundation model aims to understand live video and vision-language input in real time.

Jul 26, 2026

More in Text / LLM

All Text / LLM →
IBM/Any-to-Any

IBM's Granite Switch Treats Models Like Software

A new Apache-2.0 release reframes enterprise LLMs as components you can swap and update in place.

Oct 29, 2026
Mistral Large 4 (1T-A52B)
Mistral AI/Text / LLMDatacenter

Mistral Large 4 Arrives as a 1T-Parameter MoE

The new flagship pairs a trillion total parameters with 52B active per token and adds vision alongside multilingual text.

Oct 29, 2026
Nanbeige4.3-33B
Nanbeige/Text / LLMConsumer GPU

Nanbeige 4.3 Arrives as a 33B Bilingual Model

A dense English–Chinese language model lands under Apache 2.0, aimed at teams that want permissive licensing at mid-size scale.

Oct 24, 2026