engine/mistralrs/README.md

mistral.rs Rust API: mistralrs

Mistral.rs provides a convenient Rust multithreaded/async API. To install, add mistralrs = { git = "https://github.com/EricLBuehler/mistral.rs.git" } to the Cargo.toml file.

Examples can be found here.