# Edge0's 35B MoE Aims for SSD-Backed Edge Inference

> A preview mixture-of-experts model uses trained routing prediction to run on machines that can't hold it all in memory.

Published by The Open Weights on Sep 8, 2026. Canonical: https://theopenweights.com/news/edge0-35b-a3b-vzm8

## Key facts

- Company: Edge0
- Model: Edge0-35B-A3B-preview
- Version: preview
- Category: Text / LLM
- Modalities: Text / LLM
- License: Apache 2.0 (Open weights, commercial use allowed)
- Parameters: 35B (mixture of experts)
- Active parameters: 3B
- Context window: 262K tokens
- Architecture: Qwen3_5MoeForConditionalGeneration
- Significance: notable
- Published: 2026-09-08
- Last verified: 2026-09-20
- Hugging Face: https://huggingface.co/Edge0/Edge0-35B-A3B-preview
- Canonical URL: https://theopenweights.com/news/edge0-35b-a3b-vzm8

Edge0 has published a preview of Edge0-35B-A3B, a mixture-of-experts language model designed for a specific and often awkward problem: running large models on hardware that doesn't have enough RAM to hold them. According to its [Hugging Face repository](https://huggingface.co/Edge0/Edge0-35B-A3B-preview), the model carries roughly 35 billion total parameters but activates only about 3 billion per token, the sparse pattern that gives MoE models their efficiency edge.

The twist here is deployment strategy. Edge0 says the model is tuned for SSD-offloaded inference, meaning expert weights can live on fast storage rather than being fully resident in memory. To make that practical, the team trained a routing predictor — a mechanism that anticipates which experts a token will need — so the system can prefetch weights from disk before they're required, reducing the stalls that normally make offloading painful.

## Why it matters

MoE architectures already reduce compute per token, but their full weight footprint still demands substantial memory. Offloading to SSD is a known workaround, and the bottleneck is latency: fetching the wrong experts on demand can grind throughput to a crawl. Training the model to help predict its own routing is a pragmatic attempt to close that gap.

- Roughly 35B total parameters with about 3B active per token
- Trained routing prediction to enable SSD prefetching
- Released under the permissive Apache-2.0 license

As a preview, this is an early look rather than a finished release, and Edge0 has not published context length or detailed benchmarks. The permissive licensing and the focus on constrained hardware make it worth watching for anyone trying to squeeze capable models onto laptops, workstations, or edge boxes without generous RAM budgets.

## Get the model

- [Hugging Face](https://huggingface.co/Edge0/Edge0-35B-A3B-preview)

## Sources

- [Edge0/Edge0-35B-A3B-preview](https://huggingface.co/Edge0/Edge0-35B-A3B-preview) — Hugging Face, Sep 8, 2026

---
Source: The Open Weights (https://theopenweights.com/). Aggregated and written by Claude, curated by humans. Cite as: "Edge0's 35B MoE Aims for SSD-Backed Edge Inference", The Open Weights, Sep 8, 2026, https://theopenweights.com/news/edge0-35b-a3b-vzm8