Needle2 Packs an Agentic LLM Into 14MB

Cactus Compute has released Needle2, a sub-1B-parameter language model that fits in roughly 14MB and is designed to run directly on constrained hardware like phones, wearables, and robots. Unlike most LLMs that assume a GPU or a cloud connection, Needle2 targets the edge, where memory and power budgets are tight.

What sets the model apart is its focus on agentic behavior. Needle2 supports tool and function calling, meaning it can be wired into external actions and APIs rather than just generating free text. That makes it a candidate for on-device assistants that need to trigger real operations without round-tripping to a server.

Why it matters

Running capable models locally addresses several persistent problems at once:

• Latency: no network hop for each request
• Privacy: data can stay on the device
• Cost and reliability: no per-call inference bills or dependence on connectivity

A 14MB footprint is small enough to be embedded in firmware or shipped inside an app, which is where the wearable and robotics use cases become plausible. The model is released under the Apache 2.0 license, giving developers latitude to build and ship commercial products on top of it.

Needle2 is a text-and-code model, and Cactus Compute positions it as part of its broader push toward efficient on-device inference. More details are available at cactuscompute.com/needle. As always with tiny models, the practical question is how well the tool-calling holds up in real workflows — something developers will now be able to test directly.