Benchmark

Benchmarking Image-to-Video Consistency

A controlled test plan for measuring whether image-to-video tools preserve subject identity, composition, and motion intent across repeated generations.

Jul 15, 2026

18 min

Advanced

Benchmark design

A useful benchmark changes one production variable at a time and records every intermediate result, not only the final successful clip.

MODULAR TRANSMISSION SYSTEM

Modules: hypothesis, source assets, run matrix, output gallery, comparison notes, failure cases, findings, verdict.

PROMPT BLOCK

Copy

Use a fixed subject reference. Generate motion variations with only one variable changed per run.

FINDINGS

Identity drift should be measured separately from motion quality.

RESOURCES

Model docs, run sheet, output comparisons.

EVIDENCE SUMMARY

Compare runs against fixed prompts, reference frames, seed behavior, and edit distance in the final footage.

TOOLS

Image-to-video models, reference stills, spreadsheet run log

REFERENCE ASSETS

Reference stills, run log, selected exports.

VERDICT

Consistency testing needs a run matrix, not a single favorite output.