RWKV-7 'Goose': Efficient, Powerful Sequence Modeling
Introducing RWKV-7 'Goose', a novel RNN architecture challenging Transformer dominance. It achieves SoTA multilingual performance with linear complexity and constant memory, offering efficient sequence modeling. Models and a 3.1T token corpus are open-sourced under Apache 2.0.