Logo
Loading ...

rustformers/llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

6125
5
81

Notes

Sign in to add notes for this repository

RN
rustformers
250
Followers
0
Following
3
Repos
No Twitter
Transformers in Rust!

Branches

main
gguf
feat/sliding_window

Releases

v0.1.1

Commits

Archival notice
docs(readme): further detail current branches
Merge pull request #443 from JRazek/elided_lifetimes_in_associated_constant-fixup fix &'static lifetime warning

Issues

Supporting Llama-2 70B param
Metal Prompt Feeding
Proper Rewind+Refeed when stop token is detected.