mirror of
https://github.com/hanzoai/speech.git
synced 2026-10-04 07:37:19 +00:00
zooqueenandHanzo Dev
d519c1e460
Three files are the service: routes, the whisper half, the kokoro half. No auth of its own — in-cluster only; the ai plane (api.hanzo.ai) authenticates and meters every caller, including the anon grant tier, before a request lands here. Weights bake into the image at build so the container boots offline. Phase 2 is /v1/realtime: full-duplex websocket speech with barge-in, plus camera-frame relay into the multimodal models. Co-authored-by: Hanzo Dev <[email protected]>
speech
CPU speech for the Hanzo platform: STT (faster-whisper, CTranslate2 int8) and TTS (kokoro-onnx, 82M) behind one OpenAI-shaped surface.
Routes
POST /v1/audio/transcriptions— multipartfile+model(+language,response_format) →{"text": …}POST /v1/audio/speech—{model, input, voice, response_format}→ audio bytes (mp3 default, wav native)GET /v1/models,GET /healthz
Trust model
No auth of its own, in-cluster only. api.hanzo.ai fronts it through the ai
plane, which authenticates and meters every caller — a provider row pointing at
http://speech.hanzo.svc/v1 is the whole integration. Weights bake into the
image at build; the container boots without the network.
Run
uv sync && uv run uvicorn main:app --port 8000
Phase 2 is /v1/realtime: websocket full-duplex (silero-vad segmentation,
partial transcripts, kokoro frames, barge-in) plus camera-frame relay into the
multimodal models.