Needle2 Packs an Agentic LLM Into 14MB
Cactus Compute's tiny model brings tool and function calling to phones, wearables, and robots.

Cactus Compute has released Needle2, a sub-1B-parameter language model that fits in roughly 14MB and is designed to run directly on constrained hardware like phones, wearables, and robots. Unlike most LLMs that assume a GPU or a cloud connection, Needle2 targets the edge, where memory and power budgets are tight.
What sets the model apart is its focus on agentic behavior. Needle2 supports tool and function calling, meaning it can be wired into external actions and APIs rather than just generating free text. That makes it a candidate for on-device assistants that need to trigger real operations without round-tripping to a server.
Why it matters
Running capable models locally addresses several persistent problems at once:
- Latency: no network hop for each request
- Privacy: data can stay on the device
- Cost and reliability: no per-call inference bills or dependence on connectivity
A 14MB footprint is small enough to be embedded in firmware or shipped inside an app, which is where the wearable and robotics use cases become plausible. The model is released under the Apache 2.0 license, giving developers latitude to build and ship commercial products on top of it.
Needle2 is a text-and-code model, and Cactus Compute positions it as part of its broader push toward efficient on-device inference. More details are available at cactuscompute.com/needle. As always with tiny models, the practical question is how well the tool-calling holds up in real workflows — something developers will now be able to test directly.
Sources
More from Cactus Compute
All Cactus Compute releases →
Cactus Compute's Mirage brings vision tasks on-device
The new open vision-language model targets detection, segmentation, and visual Q&A without relying on the cloud.
Cactus Compute's Whistle brings speech-to-text to the edge
A compact on-device ASR model built for edge hardware and WebAssembly, with early support for English, German, and French.
Cactus Needle 3: tiny on-device tool-calling models
Cactus Compute's 8–29MB models aim to run automation and tool-calling entirely on-device, rivaling far larger cloud systems.
More in Text / LLM
All Text / LLM →
Microsoft's Aion 1.0 Instruct is a compact 2.3B chat model
A small, multilingual instruction-tuned model aimed at chat and summarization lands on Hugging Face.
SenseTime Releases Looped 9B Multimodal Model
The company's new SenseNova-Loop-9B pairs vision-language capabilities with a recurrent looped-transformer design.

Tencent releases Hunyuan Hy4-flash multimodal MoE
The lightweight, mixture-of-experts model adds vision and text instruction-following to Tencent's open Hunyuan lineup.
0 comments
No comments yet. Be the first to weigh in.