mirror of
https://github.com/hanzoai/ml.git
synced 2026-11-20 23:08:29 +00:00
520 B
520 B
hanzo-ml-quantized-qwen2-instruct
Qwen2 is an upgraded version of Qwen1.5, released by Alibaba Cloud.
Running the example
cargo run --example quantized-qwen2-instruct --release -- --prompt "Write a function to count prime numbers up to N."
0.5b, 1.5b, 7b and 72b models are available via --which argument.
cargo run --release --example quantized-qwen2-instruct -- --which 0.5b --prompt "Write a function to count prime numbers up to N."