mirror of
https://github.com/hanzoai/ml.git
synced 2026-11-20 23:08:29 +00:00
987 B
987 B
hanzo-ml-voxtral: speech recognition
An implementation of Voxtral speech recognition using hanzo-ml.
Running the example
Run with the cuda feature for GPU acceleration:
cargo run --example voxtral --features tekken,symphonia,rubato,cuda --release
# you may also add the `cudnn` feature for extra performance
# cargo run --example voxtral --features tekken,symphonia,rubato,cuda,cudnn --release
Remove the cuda feature to run on the CPU instead:
cargo run --example voxtral --features tekken,symphonia,rubato --release
# or pass the `--cpu` flag to force CPU usage
# cargo run --example voxtral --features tekken,symphonia,rubato,cuda --release -- --cpu
Command line options
--cpu: Run on CPU rather than on GPU (default: false, uses GPU if available)--input: Audio file path in wav format. If not provided, a sample file is automatically downloaded from the hub.--model-id: Model to use (default:mistralai/Voxtral-Mini-3B-2507)