zenlm/engine
1
0
Fork 0
mirror of https://github.com/zenlm/engine.git synced 2026-10-30 15:00:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
master
engine/docs/SAMPLING.md
T
Eric BuehlerandGitHub bbb3f41841 Update docs and deps (#804) 
* Update docs, for isq ordering

* Update deps

* Update rust examples in docs

* Update docs

* Update .pyi
2024-09-29 22:59:22 -04:00

314 B
Raw Permalink Blame History

Sampling and penalty techniques in mistral.rs

We currently support the following sampling and penalty techniques in mistral.rs:

  • Top K
  • Top P
  • Min P
  • Dry Penalty
  • Frequency Penalty
  • Presence Penalty

Please suggest more by raising an issue!

Reference in New Issue View Git Blame Copy Permalink