Files

3.5 KiB

oto (音)
Hanzo's Foley & sound effects model

Oto

Oto (oto, oto-1) is Hanzo's Foley and sound effects generation model, served from Hanzo's inference fabric at api.hanzo.ai under the canonical id oto (open foundation: zen-foley / zenlm/zen-foley). It synthesizes timeline-synchronized Foley, physical impact transients, acoustic room impulse environments, and layered multi-stem ambience.

curl https://api.hanzo.ai/v1/audio/foley \
  -H "Authorization: Bearer $HANZO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"oto","prompt":"heavy leather boots walking across wet cobblestone in a narrow stone alley"}' \
  --output foley.wav

Capabilities

Modes text → Foley / SFX, video + text → synchronized Foley (/v1/audio/foley)
Model IDs oto, oto-1 (open foundation: zen-foley)
Controls Prompt, duration, acoustic space / impulse response, stem isolation
  • Timeline-synchronized Foley — aligns transient sound impacts, footsteps, collisions, and cloth rustle to video frames down to millisecond precision.
  • Acoustic room impulse modeling — matches early reflections, reverberation decay, and high-frequency absorption to physical scene geometry.
  • Layered multi-stem ambience — generates isolated multichannel bed tracks (wind, urban traffic, foliage movement, room tone).
  • Dynamic mechanical & impact sound — synthesizes complex physical audio (vehicle engine load, glass stress fractures, metallic resonance).

Creative AI Lineup

Each creative modality in Hanzo has its own dedicated model and repository:

Model Modality Endpoint Repository Open Foundation
Iro (iro) Image generation & editing POST /v1/images/generations hanzo-inc/iro zen3-image (zenlm/zen-artist)
Koma (koma) Video generation & motion POST /v1/videos/generations hanzo-inc/koma zen-director (zenlm/zen-director)
Koe (koe) Voice & dialogue synthesis POST /v1/audio/voice hanzo-inc/koe zen3-tts (zenlm/zen-dub)
Oto (oto) Foley & sound effects POST /v1/audio/foley hanzo-inc/oto zen-foley (zenlm/zen-foley)
Uta (uta) Music & score generation POST /v1/audio/music hanzo-inc/uta zen-musician (zenlm/zen-musician)
Mori (mori) 3D assets, meshes & scenes POST /v1/videos/generations hanzo-inc/mori zen-3d (zenlm/zen-3d)

Surfaces

Oto is served by hanzo-inc/zen and declared in hanzo/universe (charts/app/files/zen/catalog.yaml), with first-party Studio integration in hanzo-inc/studio.

License

The contents of this repository are licensed under Apache-2.0. The proprietary oto-1 weights are served through the Hanzo API under the Hanzo Terms; the open foundation zen-foley is available under Apache-2.0 at huggingface.co/zenlm/zen-foley.