video/skills/pipelines/clip-factory/asset-director.md

Asset Director - Clip Factory Pipeline

When To Use

This stage builds the shared visual and audio kit for the entire clip batch. The key is reuse, not bespoke design per clip.

Prerequisites

Layer	Resource	Purpose
Schema	schemas/artifacts/asset_manifest.schema.json	Artifact validation
Prior artifacts	state.artifacts["scene_plan"]["scene_plan"], state.artifacts["script"]["script"], state.artifacts["idea"]["brief"]	Clip plans and rankings
Tools	subtitle_gen, audio_enhance	Batch-ready subtitles and audio cleanup
Playbook	Active style playbook	Subtitle and overlay consistency

Process

1. Build Shared Assets First

Prefer reusable assets over per-clip reinvention:

• one subtitle style system,
• one hook text treatment,
• one lower-third treatment,
• one watermark / brand frame,
• one CTA / end-tag treatment if needed.

1b. Hero Scene Sample (Mandatory)

Before batch asset generation:

1. Identify the hero scene (the visual peak of the batch)
2. Generate ONE sample visual asset for that scene
3. Present it: "This is the visual direction for the most important clip. Does this match what you're imagining? I'll generate the rest in this style."
4. Wait for approval before proceeding to batch generation

This prevents the most expensive mistake: generating 10+ assets in a direction the user doesn't like.

2. Generate Per-Clip Subtitles

Each approved clip needs its own subtitle asset, timed from clip start rather than source start. This timestamp rebasing is critical.

Store clip-relative timing details in asset_manifest.metadata.subtitle_map.

3. Normalize Audio Consistently

Use audio_enhance across the clip set so the batch feels like one series:

• similar loudness,
• similar noise floor,
• similar vocal clarity.

4. Keep Hook Assets Lightweight

Most hook overlays should be text-first and template-based. Do not spend time or budget generating bespoke art unless the batch truly benefits.

5. Use Metadata For Batch Structure

Recommended metadata keys:

• shared_assets
• subtitle_map
• audio_profile
• clip_asset_index
• style_tokens

6. Quality Gate

• every clip has subtitles,
• every clip has a clean audio asset or verified source audio path,
• shared assets are referenced consistently,
• the asset count stays practical for the batch size.

Mid-Production Fact Verification

If you encounter uncertainty during asset generation:

• Use web_search to verify visual accuracy of subjects (e.g. what does this building actually look like?)
• Use web_search to find reference images before generating illustrations
• Log verification in the decision log: category="visual_accuracy_check"

Visual accuracy matters. If the script mentions a specific place, person, or object, verify what it actually looks like before generating images. Don't rely on the AI model's training data — it may be wrong or outdated.

Common Pitfalls

• Forgetting to rebase subtitle timing per clip.
• Overdesigning hook assets so the batch becomes inconsistent.
• Normalizing some clips and not others.
• Treating a 10-clip batch like 10 unrelated projects.

When You Do Not Know How

If you encounter a generation technique, provider behavior, or prompting pattern you are unsure about:

1. Search the web for current best practices — models and APIs change frequently, and the agent's training data may be stale
2. Check .agents/skills/ for existing Layer 3 knowledge (provider-specific prompting guides, API patterns)
3. If neither helps, write a project-scoped skill at projects/<project-name>/skills/<name>.md documenting what you learned
4. Reference source URLs in the skill so the knowledge is traceable
5. Log it in the decision log: category: "capability_extension", subject: "learned technique: <name>"

This is especially important for:

• Video generation prompting — models respond to specific vocabularies that change with each version
• Image model parameters — optimal settings for FLUX, DALL-E, Imagen differ and evolve
• Audio provider quirks — voice cloning, music generation, and TTS each have model-specific best practices
• Remotion component patterns — new composition techniques emerge as the framework evolves

Do not rely on stale knowledge. When in doubt, search first.