mirror of
https://github.com/zenlm/engine.git
synced 2026-10-30 15:00:05 +00:00
Eric BuehlerandGitHub
272f7ee1b5
* Refactor MistralRs * Working multi-model! * Add mutli-model docs initially * Update mistralrs-pyo3, mistralrs-bench, mistralrs * Update apis for consistency * API tweaks * Logging tweaks * Add examples, tweak cli * Clearer pipeline id * Fix config key semantics * Format and clippy * Tweak logging, fix example * Clippy refactor * Update examples * Remove unused multi model docs * Replace 'ignore' with 'default' * Update docs
14 lines
226 B
JSON
14 lines
226 B
JSON
{
|
|
"llama3-3b": {
|
|
"Plain": {
|
|
"model_id": "meta-llama/Llama-3.2-3B-Instruct"
|
|
},
|
|
"in_situ_quant": "4"
|
|
},
|
|
"qwen3-4b": {
|
|
"Plain": {
|
|
"model_id": "Qwen/Qwen3-4B"
|
|
},
|
|
"in_situ_quant": "4"
|
|
}
|
|
} |