zenlm/engine
1
0
Fork 0
mirror of https://github.com/zenlm/engine.git synced 2026-10-30 15:00:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
main
engine/mistralrs/examples/paged_attn
T
History
Eric BuehlerandGitHub ebf1c27adc Improved Rust-side API (#785) 
* Nice, easy rust API

* Nicer example

* Docs

* Update docs

* Support lora rust api model

* Reorganize

* Add the examples

* Update tool calling example

* Fix crate name

* Add messages_ref

* Add llama 8b specific example

* Add gguf, lora/xlora models

* Export them

* Doctests build

* Add support for vision models

* Add some docs

* Even *more* docs

* Format
2024-09-22 15:20:21 -04:00
..
main.rs
Improved Rust-side API (#785)
2024-09-22 15:20:21 -04:00