mirror of
https://github.com/hanzoai/video.git
synced 2026-11-02 12:13:09 +00:00
2.7 KiB
2.7 KiB
Grok Prompting
Use this when the chosen provider is grok_image or grok_video.
When Grok Is The Right Pick
- You need to edit an existing image instead of generating from scratch
- You need to merge multiple source images into one output
- You need a short video influenced by reference images without locking the first frame
- You want one provider for both image and video generation with similar prompt language
Grok Image
Best Prompt Shape
[subject] + [action or change] + [setting] + [one style anchor] + [lighting]
Edit Prompts
For image edits, describe the intended transformation directly:
- "Render this as a pencil sketch with detailed shading."
- "Replace the plain t-shirt with a dark green bomber jacket."
- "Combine these two people into the same sunny park scene."
Do not over-specify every unchanged detail unless preservation is critical.
Multi-Image Composites
Tell Grok how to combine the inputs:
- who comes from which source
- what should stay separate
- where the final scene takes place
Example:
Place the person from image 1 and the person from image 2 on the same subway platform at dusk,
standing shoulder to shoulder, cinematic sodium-vapor lighting, realistic photography.
Grok Video
Best Prompt Shape
[shot] + [camera movement] + [subject] + [main motion beat] + [environment] + [lighting] + [tone]
Reference-Image Video
Grok supports prompts that refer to source images with placeholders like <IMAGE_1>.
Use that when you need identity, wardrobe, or product consistency.
Example:
Medium full shot, slow push-in. The model from <IMAGE_1> walks onto a clean white runway wearing
the jacket from <IMAGE_2>. Soft studio lighting, premium fashion campaign, confident expression.
Image-to-Video vs Reference-to-Video
- Use image-to-video when the source image should act like the opening frame.
- Use reference-to-video when the source images should influence the content but not freeze the composition.
Common Mistakes
- Treating Grok reference images like strict storyboards. They are influence inputs, not exact frame locks.
- Writing multiple scene changes into one clip request.
- Combining too many style labels with too little scene information.
- Using vague edit prompts like "make it better" instead of naming the change.
OpenMontage Guidance
- For image edits or compositing, prefer
grok_imageover the selector's default workhorse tools. - For reference-conditioned video, prefer
grok_videowhen the brief depends on carrying people, clothing, or products from input images into motion. - If the deliverable is pure cinematic motion without reference constraints, compare Grok against Runway, Veo, and Kling before locking the provider.