Midjourneyvs.Runway
Compare prompt adherence, consistency across attempts, directed editing and usage terms on the same briefs.
Short answer
This comparison is planned and has not been run. The test gives Midjourney and Runway the same ten briefs and measures prompt adherence, consistency across attempts and directed edits. Visual quality is reported separately as blind editorial preference. No result or winner is published.12
Midjourney
Vendor-described: Midjourney's announcement post on the Edit Model for V8 says it updated the interfaces on the main website and the alpha website.1
View product page →Reviewed. Reviewed by our team from the vendor's pages and public sources, with an editor's rating. Not independently tested yet. No winner is declared and none of the content below is a finding.
Stage 2 of 5: Test conditions published
- 4
- Questions to answer
- 4
- Dimensions
- 0
- Documented differences
- 0
- Evidence records
Questions this comparison will answer
What we will examine, before any result exists.
This page lists what a fair comparison of Midjourney and Runway needs to answer. It publishes questions first and conclusions only when evidence supports them.
- Control and consistencyHow many of a brief's required elements does each output contain?
- Output qualityHow consistent are results across attempts from the same brief?
- Usage rights and provenanceCan a specific change be directed without starting over?
- Production workflowWhat do the terms say about commercial use, ownership and provenance labels?
What each side says
Vendor claims, labeled as such, and what is still untested.
These are vendor-reported claims, not test results. We list them so you can see what each side says about itself, and we mark everything we have not tested.
| Dimension | Midjourney | Runway | Evidence |
|---|---|---|---|
| Where it runs | Midjourney's announcement post on the Edit Model for V8 says it updated the interfaces on the main website and the alpha website.1 | Runway's site links to apps for iPhone and Android.2 | Vendor-reported |
| Data use | Not yet documented | Runway's Terms of Use say inputs and outputs may be used by the company to train and improve its AI models.3 | Vendor-reported |
| Usage limits | Midjourney's announcement post on Thinking Mode says Thinking Mode is being tested on its Alpha website.4 | Runway's pricing page lists 125 one-time credits for the Free plan.5 | Vendor-reported |
| Control and consistency | Not yet documented | Not yet documented | Untested |
| Output quality | Not yet documented | Not yet documented | Untested |
| Usage rights and provenance | Not yet documented | Not yet documented | Untested |
| Production workflow | Not yet documented | Not yet documented | Untested |
Vendor terms differ by plan and change over time. Check each vendor's current terms for the exact plan you would use.
Where this comparison stands
Test conditions, differences and the conclusion.
- PlannedSelected for evaluation
- Test conditions publishedTasks, versions, settings, runs, pass criteria
- Testing runBoth products tested under the published conditions
- Evidence recordedEach result linked to an evidence record
- ConclusionAdded only when evidence supports it
Test conditions
Test conditions are published before results: the tasks, tool versions, settings, number of runs and pass criteria are fixed in advance.
- Task set: ten written briefs, each with a checklist of required elements, run on the image features both products offer. Four attempts per brief per tool.Published
- Measures: prompt adherence (checklist items present divided by items required); consistency (share of attempts per brief that contain every required element); directed-edit success (three scripted edits per output, counted as success when no restart is needed); and time and cost per accepted output.Published
- Visual quality: scored as blind pairwise preference by at least three reviewers, reported with the reviewer count and labelled as editorial judgment, never merged with the measured figures.Published
- Separate document check: terms on commercial use, ownership and provenance are read from each vendor's own pages on a stated date.Published
- Versions and plans: the plan, model and version of each tool are recorded for every run and published with the results.Published
- Repeats: every task is run at least three times per tool, alternating which tool goes first, and every run is reported, failures included.Published
- Fixed in advance: prompts, inputs, reference answers and scoring rubrics are written and published before any run, and the operator pastes prompts verbatim.Published
- Publication rule: nothing is published as a result until every planned run is recorded, and each figure is shown with its sample size.Published
Documented differences
Differences are listed here only when each is supported by a linked evidence record.
Conclusion
A conclusion is added only when the evidence supports it. Until then, this page makes no claim about which option is better.
Limitations
- No testing has been run, so there are no results.
- Test conditions are fixed before any run and may be extended, never changed after results exist.
- No winner is declared.
The planned test, in full
Conditions, criteria and result cells, fixed before any run. Every result says Not yet run.
Short answer: This comparison is planned and has not been run. The test gives Midjourney and Runway the same ten briefs and measures prompt adherence, consistency across attempts and directed edits. Visual quality is reported separately as blind editorial preference. No result or winner is published.
What are the test conditions?
- Task set: ten written briefs, each with a checklist of required elements, run on the image features both products offer. Four attempts per brief per tool.
- Measures: prompt adherence (checklist items present divided by items required); consistency (share of attempts per brief that contain every required element); directed-edit success (three scripted edits per output, counted as success when no restart is needed); and time and cost per accepted output.
- Visual quality: scored as blind pairwise preference by at least three reviewers, reported with the reviewer count and labelled as editorial judgment, never merged with the measured figures.
- Separate document check: terms on commercial use, ownership and provenance are read from each vendor's own pages on a stated date.
- Versions and plans: the plan, model and version of each tool are recorded for every run and published with the results.
- Repeats: every task is run at least three times per tool, alternating which tool goes first, and every run is reported, failures included.
- Fixed in advance: prompts, inputs, reference answers and scoring rubrics are written and published before any run, and the operator pastes prompts verbatim.
- Publication rule: nothing is published as a result until every planned run is recorded, and each figure is shown with its sample size.
What will we measure for Midjourney and Runway?
| Question | Midjourney | Runway |
|---|---|---|
| How many of a brief's required elements does each output contain? | Not yet run | Not yet run |
| How consistent are results across attempts from the same brief? | Not yet run | Not yet run |
| Can a specific change be directed without starting over? | Not yet run | Not yet run |
| What do the terms say about commercial use, ownership and provenance labels? | Not yet run | Not yet run |
How do we keep the comparison fair?
Every figure above stays empty until the runs exist. Prompts, inputs, answers and rubrics are fixed first, each task is repeated, failures are published, and judgment calls are labelled as editorial next to the measured numbers. If a condition has to change after results exist, the old results are kept and the change is logged on the updates page.
Read each review first: Midjourney and Runway. See how to read an evaluation and the methodology.
The exact prompts, rubrics and datasets are in the full test protocols.
How do I compare them myself?
A method you can run on your own work today.
Write a brief for the output you actually need, generate several attempts and compare consistency, then test whether you can direct specific changes without starting over. Check how files move into your editing tools, and read the terms on commercial use, ownership and provenance labels.
- Write a brief for the kind of output you actually need.
- Generate several attempts from the same brief and compare consistency.
- Test whether you can direct specific changes without starting over.
- Check how outputs move into your editing and review tools.
- Read the terms on commercial use, ownership, and provenance labels.
Related reading
Frequently asked questions
Short answers to common questions.
Which is better, Midjourney or Runway?
We have not tested either, so we do not declare one better. The planned test uses the same briefs for both and measures prompt adherence, consistency and directed edits, with visual quality reported separately as editorial judgment.
Will video be compared too?
The first test covers the image features both products offer. Video would be a separate protocol with its own conditions, published before any run.
Can I run this comparison myself?
Yes. Use the same inputs for both tools, write your scoring rubric before you start, repeat each task at least three times, and keep failed runs in the results. Our guides describe how to read an evaluation and what to record.
Sources and further reading
Vendor pages behind the claims above.
- Midjourney: updates.midjourney.comVendor page, captured October 21, 2026.
- Runway: runway.comVendor page, captured October 10, 2026.
- Runway: runway.comVendor page, captured October 10, 2026.
- Midjourney: updates.midjourney.comVendor page, captured October 21, 2026.
- Runway: runway.comVendor page, captured October 10, 2026.
Editorial independence. Commercial relationships, affiliate links and sponsored placements are disclosed and never determine evaluation scores. See the affiliate disclosure and the editorial policy.