video/skills/pipelines/localization-dub/asset-director.md

Asset Director - Localization Dub Pipeline

When To Use

This stage produces the localized asset kit: translated subtitle files, dubbed audio, optional lip-sync renders, and any language-specific replacements needed for the final outputs.

Prerequisites

Layer	Resource	Purpose
Schema	schemas/artifacts/asset_manifest.schema.json	Artifact validation
Prior artifacts	state.artifacts["scene_plan"]["scene_plan"], state.artifacts["script"]["script"], state.artifacts["idea"]["brief"]	Language plan and transcript package
Tools	tts_selector, subtitle_gen, lip_sync, audio_enhance — tts_selector auto-discovers all available TTS providers from the registry	Dubbed audio, subtitle, and optional lip-sync production
Playbook	Active style playbook	Subtitle and replacement-text rules

Process

1. Produce Subtitle Assets First

Create the subtitle or caption package for each language. This gives a reviewable fallback even if dubbed-audio generation or lip sync is blocked.

1b. Hero Scene Sample (Mandatory)

Before batch asset generation:

1. Identify the hero scene (the visual peak of the video)
2. Generate ONE sample dubbed audio clip for that scene in the target language
3. Present it: "This is the voice direction for the most important scene. Does this match what you're imagining? I'll generate the rest in this style."
4. Wait for approval before proceeding to batch generation

This prevents the most expensive mistake: generating 10+ dubbed assets in a direction the user doesn't like.

2. Generate Dubbed Audio Per Language

Use the approved translated script package, not raw machine output. Record which voice or synthesis path was used for each language.

3. Treat Lip Sync As Optional

Only generate lip-sync assets for scenes and languages that actually need it. If the tool path is blocked, record that and keep the dub-audio path alive.

4. Use Metadata For Localization Truth

Recommended metadata keys:

• subtitle_assets_by_language
• dub_audio_assets_by_language
• lip_sync_assets_by_language
• voice_map
• pronunciation_warnings
• blocked_assets

5. Quality Gate

• subtitle assets exist,
• dubbed audio assets exist for planned dub outputs,
• lip-sync remains explicitly optional,
• every referenced file exists.

Mid-Production Fact Verification

If you encounter uncertainty during asset generation:

• Use web_search to verify visual accuracy of subjects (e.g. what does this building actually look like?)
• Use web_search to find reference images before generating illustrations
• Log verification in the decision log: category="visual_accuracy_check"

Visual accuracy matters. If the script mentions a specific place, person, or object, verify what it actually looks like before generating images. Don't rely on the AI model's training data — it may be wrong or outdated.

Common Pitfalls

• Generating dubbed audio before finalizing translation review.
• Treating lip sync as mandatory for every language.
• Failing to record which language asset maps to which voice and subtitle set.

When You Do Not Know How

If you encounter a generation technique, provider behavior, or prompting pattern you are unsure about:

1. Search the web for current best practices — models and APIs change frequently, and the agent's training data may be stale
2. Check .agents/skills/ for existing Layer 3 knowledge (provider-specific prompting guides, API patterns)
3. If neither helps, write a project-scoped skill at projects/<project-name>/skills/<name>.md documenting what you learned
4. Reference source URLs in the skill so the knowledge is traceable
5. Log it in the decision log: category: "capability_extension", subject: "learned technique: <name>"

This is especially important for:

• Video generation prompting — models respond to specific vocabularies that change with each version
• Image model parameters — optimal settings for FLUX, DALL-E, Imagen differ and evolve
• Audio provider quirks — voice cloning, music generation, and TTS each have model-specific best practices
• Remotion component patterns — new composition techniques emerge as the framework evolves

Do not rely on stale knowledge. When in doubt, search first.