Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

backend(rwkv): python rwkv backend #1658

Open
mudler opened this issue Jan 29, 2024 · 0 comments
Open

backend(rwkv): python rwkv backend #1658

mudler opened this issue Jan 29, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@mudler
Copy link
Owner

mudler commented Jan 29, 2024

Is your feature request related to a problem? Please describe.

We have rwkv support with rwkv.cpp with the go-rwkv binding, however that might not be in par with rwkv changes

Describe the solution you'd like
Support also https://pypi.org/project/rwkv/ alongside rwkv.cpp

Describe alternatives you've considered
keep rwkv support as-is

Additional context

Eagle 7b and Raven 13b now got very good benchmarks !

https://twitter.com/RWKV_AI/status/1751797147492888651

Part of #1126

@mudler mudler added the enhancement New feature or request label Jan 29, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant