Fla Hub/Text / LLM
RWKV7-G1j arrives as a 13.3B attention-free model
The latest RWKV7 checkpoint scales the recurrent, attention-free architecture to 13.3 billion parameters under a permissive Apache 2.0 license.
Company
Releases
The latest RWKV7 checkpoint scales the recurrent, attention-free architecture to 13.3 billion parameters under a permissive Apache 2.0 license.