The Open Weights
LatestModelsLeaderboardsCompanies
Subscribe
The Open Weights

The daily record of open-source AI. New model releases, leaderboards, and what's coming next — written for people who ship.

Refreshed every 12 hours

Discover

  • Latest releases
  • New today
  • Trending models

Browse

  • All models
  • Companies
  • Categories
  • Leaderboards

About

  • About
  • Editorial policy
  • Hardware estimates
  • RSS feed
  • llms.txt
  • Newsletter

© 2026 The Open Weights. An independent publication.

PrivacyTermsSMSAggregated by Claude · curated by humans.
LatestGoogle DeepMind4
Google DeepMindAny-to-Any

Google Releases Gemma 4 Multimodal Open Model

The new 26-billion-parameter model from DeepMind uses a mixture-of-experts design for greater efficiency and is tuned for assistant-style tasks.

Apr 23, 2026
NotableApache 2.0
Gemma 4 26B-A4B Instruct (MoE)

Google DeepMind has expanded its open-source offerings with the release of Gemma 4, a new generation of its popular model family. The initial variant, Gemma 4 26B-A4B Instruct, is a powerful multimodal model designed for conversational AI and assistant tasks.

Efficient by Design

Gemma 4 employs a sparse Mixture-of-Experts (MoE) architecture, a design choice that balances model scale with computational cost. While the model contains a total of 26 billion parameters, only 4 billion are active during inference for any given input. This approach allows Gemma 4 to achieve the performance associated with larger models while requiring significantly less processing power.

Key specifications include:

  • Total Parameters: 26 billion
  • Active Parameters: 4 billion
  • Modalities: Text and Vision (VLM)
  • License: Apache 2.0

This release is notable for its multimodal capabilities. As a vision-language model (VLM), Gemma 4 can understand and process both text and image inputs, making it suitable for a wide range of applications from image captioning to visual Q&A. This specific version is instruction-tuned, meaning it has been optimized to follow user prompts and engage in helpful dialogue.

By releasing Gemma 4 under the permissive Apache 2.0 license, Google continues to support the open-source AI community. This allows developers and researchers to freely build upon, modify, and deploy the model for both academic and commercial purposes, further accelerating innovation in the field.

Sources

  • google/gemma-4-26B-A4B-it-assistant

    Hugging Face

    Visit
OlderGoogle Releases Multimodal Gemma 4 31B ModelGoogle DeepMind · Any-to-Any · 6 months agoNewerNVIDIA Releases Efficient Nemotron-3 Multimodal MoENVIDIA · Any-to-Any · 6 months ago

Get the model

Hugging Face

Specs

Parameters26B · MoE
Context window262K tokens
PrecisionBF16
ArchitectureGemma4AssistantForCausalLM
LicenseAPACHE-2.0
Downloads370K
Likes198

Can you run it?

Runs on a 24 GB GPU at 4-bit.

  • BF16 (as published)

    80 GB GPU (A100 / H100) · 128 GB Mac Studio

    53.3 GB
  • 8-bit

    32 GB GPU (RTX 5090) · 48 GB Mac

    28.8 GB
  • 4-bit

    24 GB GPU (RTX 3090 / 4090) · 32 GB Mac

    16.9 GB
Your machine
GGUF builds
  • Mixture-of-experts: all 26B parameters must be resident even though only 3.8B are active per token — active count affects speed, not memory.
  • Parameter count is an editorial estimate — no weights metadata on Hugging Face.
  • KV cache sized for 8,192 tokens of context; longer prompts need proportionally more.

Estimated from the parameter count. Assumes an 8K context and ~1 GB runtime overhead; actual needs vary. How we estimate


Modalities

Any-to-AnyText / LLMVision-Language

The Weekly Weights

Every open release that mattered, one email a week.

0 comments

No comments yet. Be the first to weigh in.

More from Google DeepMind

All Google DeepMind releases →
EmbeddingGemma 2
Google DeepMind/EmbeddingsRuns anywhere

EmbeddingGemma 2 Expands to Any Modality

Google DeepMind's compact embedding model now spans text, vision, audio, and video in a single vector space.

Sep 14, 2026
Google DeepMind/Any-to-Any

Google DeepMind's Gemma 4 Goes Multimodal and MoE

The new open-weights family adds a mixture-of-experts design, encoder-free multimodal inputs, and an optional thinking mode.

Jul 1, 2026
TabFM 1.0.0
Google DeepMind/Any-to-Any

Google DeepMind Releases TabFM for Tabular Data

A new foundation model brings zero-shot, in-context learning to classification and regression on structured tables.

Jun 29, 2026

More in Any-to-Any

All Any-to-Any →
LFM3-Omni-2B
LiquidAI/Any-to-AnyRuns anywhere

Liquid AI's LFM3-Omni-2B brings any-to-any AI to the edge

The 2-billion-parameter model combines vision, audio and speech-to-speech in a package small enough to run on device.

Oct 21, 2026
MiniMax-M3.1-Flash
MiniMax/Vision-LanguageMulti-GPU server

MiniMax Debuts M3.1 Flash, a Multimodal MoE Model

The new release pairs a mixture-of-experts design with agentic, coding, and video-understanding abilities in a single open model.

Oct 17, 2026
IBM/Any-to-Any

IBM's Granite Switch 4.1 Unifies Chat, Logic, Speech

A single endpoint now routes text conversation, decision-making, and speech synthesis across IBM's Apache-licensed Granite line.

Oct 15, 2026