In April 2017, ScriptBook and The Black List launched an AI-powered script analysis service that the film industry killed within 48 hours. Nine years later, the same industry accepts a growing catalogue of AI script tools without meaningful pushback. Almost all of them are built on top of general-purpose large language models. Almost none of them have been independently validated against commercial outcomes.
This is a look at what changed, and, more importantly, what didn’t.
What the industry actually attacked in 2017
The 2017 critics were consistent about what they objected to. Award-winning screenwriters Craig Mazin, John August, Brian Koppelman, producer Keith Calder, and a large volume of Reddit and Twitter commentary framed the objections in four categories:
- AI cannot meaningfully evaluate creative work.
- Quantitative assessment of screenplays is philosophically inappropriate.
- The $99 price point exploits struggling writers.
- The company itself was suspicious, with one podcast famously referring to it as a “shady Belgian company.”
If those objections were sincere, they should apply, and apply more strongly, to the current wave of AI script tools. They do not.
What was actually being attacked
For context, here is what the industry mobilised against in 2017:
- A purpose-built machine learning system trained on more than 100,000 screenplays paired with historical box office outcomes.
- Patented in the European Union (EP3340069A1) and the United States (US20200334336A1).
- Publicly validated at 87% box office prediction accuracy in a 50-film Hollywood study, and 80% greenlight accuracy against a benchmark where the industry standard sits at roughly 36%.
- Proof-of-concept engagements with Paramount Pictures and other major studios.
- Publicly endorsed by senior industry figures including Tom Hayes, SVP / Head of New Media at Paramount Pictures.
- Subject of independent academic study in peer-reviewed journals including Media Industries (University of Michigan), NECSUS European Journal of Media Studies, and a 23-page chapter in Transforming Cinema with Artificial Intelligence (IGI Global).
This is a fact pattern. The technology existed. The results were measured. The methodology was published. The system was patented.
What is on the market in 2026
The current AI script tool landscape looks nothing like this. The dominant category is thin application layers built on top of general-purpose large language models such as GPT-4, Claude, Gemini, and their peers. These systems share specific characteristics:
- Trained on general internet text, not on screenplays paired with commercial outcomes.
- Generate text rather than analyze it against a validated model of what actually performs.
- Hallucinate. This is a documented property of every major large language model, publicly acknowledged by their own developers.
- Publish no accuracy benchmarks against actual box office or commercial outcome data.
- Have not completed independently reviewed proof-of-concept work with major studios in the domain of screenplay commercial prediction.
- Are not subject to peer-reviewed academic study of their outputs as screenplay analysis tools.
- Are not patented in the domain of screenplay evaluation.
Most are marketed directly to writers at $10-30 per month subscription pricing. Some are free.
This is not a critique of large language models generally. LLMs are powerful for many uses. They are simply not the right tool for validated commercial prediction, and their developers are careful not to claim they are. The application-layer companies wrapping them, however, are less careful.
The reception
Search Reddit or r/Screenwriting today for AI script tools. You will not find condemnation threads. You will find recommendation threads. You will find comparison articles. You will find enthusiastic posts about which GPT wrapper works “best.”
The voices that led the 2017 opposition have not called this generation of tools “snake oil.” No prominent podcast has devoted hours to discrediting them. No producer has written a dozen tweets branding them a “hard pass.” No screenwriting guild has threatened boycotts of companies that partner with them.
This is not a criticism of writers using AI tools. Writers use what is available. It is an observation about a striking silence from the same industry voices that once mobilised so effectively against a technology that could actually measure something.
Then vs. now, side by side
| ScriptBook (2017) | Typical AI script tool (2026) | |
|---|---|---|
| Training data | 100,000+ screenplays paired with box office outcomes | General internet text (LLM base model) |
| Task | Predicts measurable commercial outcomes | Generates text-based “coverage” and suggestions |
| Validated accuracy | 87% box office prediction (50-film study) | None published |
| Patented | Yes, EU EP3340069A1, US US20200334336A1 | No |
| Studio POCs | Paramount Pictures and others | None publicly known |
| Peer-reviewed study | Multiple (Media Industries, NECSUS, IGI Global) | None |
| Hallucinations | Not applicable (predictive model, not generative) | Documented, universal to LLMs |
| Industry reaction | Mob attacks, cancelled partnership within 48 hours | Silence. Recommendation threads on Reddit. |
If the 2017 objections were about AI, they would apply more today
Let’s take the 2017 objections seriously and test them against the current landscape.
If the objection was “AI cannot meaningfully evaluate creative work,” generative LLMs should be worse. They both generate and evaluate creative work. They also hallucinate. The critique applies more strongly to them, not less.
If the objection was that “quantitative assessment of screenplays is philosophically inappropriate,” then LLM-based “coverage” should be worse. It presents fabricated scoring, ranking, and evaluative language that is neither quantitative in method nor validated in fact. It is scoring that only looks like scoring.
If the objection was $99 as exploitative pricing for writers, then subscription tools at $30 per month for output that hallucinates should be worse. Over a year of use, the writer spends more. They also get less reliable output.
If the objection was to a foreign company being suspect, then U.S.-based AI startups should not be inherently more trustworthy. But somehow they are.
None of the 2017 objections are being applied to the 2026 landscape. This is not a coincidence. It suggests the 2017 objections were not the real objections.
What was actually threatening
The characteristic that ScriptBook had, and that GPT wrappers do not have, is measurable prediction against outcomes.
ScriptBook’s 87% box office accuracy figure was not a marketing claim. It was a validated statistic from an independent study. It meant that when ScriptBook’s model predicted a film would underperform and the film was greenlit anyway, the outcome could be measured and the decision could be attributed.
That kind of measurement creates accountability. An executive who greenlights a film against a validated prediction has to answer for the decision.
Generative LLMs do not create this problem. Their outputs are, by construction, unverifiable. If a GPT wrapper says a screenplay is “compelling with strong character arcs,” there is no counterfactual to check against. If it says the same thing about a screenplay that later flops at the box office, no one can go back to the tool and hold it accountable, because it never made a testable claim.
The industry that rejected validated AI in 2017 has embraced unvalidated AI in 2026 because unvalidated AI is safer. It gives executives, coverage services, and podcast hosts the aesthetic of engagement with technology without introducing the risk of measurement.
The base rate hasn’t moved
In 2017, more than 86% of released films failed to become financially successful. In 2026, the base rate is essentially unchanged. Cats. Mulan (live action). Dark Phoenix. Gemini Man. A Wrinkle in Time. The Marvels. Argylle. Kraven the Hunter. Madame Web. The list of nine-figure losses continues to grow.
These are films that had every resource except one: a rigorous evaluation stage in pre-production that could have been used to reallocate the budget. The tools to do that evaluation existed in 2017. They still exist. The industry has spent nearly a decade routing around them, and it now spends real money on tools that produce plausible-sounding text about screenplays without predicting anything.
Closing thought
The 2017 rejection of ScriptBook was not really about AI. If it had been, the 2026 landscape would look very different. What was attacked in 2017 was the possibility of measurement. What is embraced in 2026 is the appearance of measurement without any of the actual accountability.
This is not a story about being early. It is a story about how creative industries decide which tools are acceptable, and what they are actually protecting when they decide.
The tools that were attacked into oblivion in 2017 were the ones that would have measurably improved a broken decision-making process. The tools that are welcomed without scrutiny in 2026 are the ones that improve nothing measurable at all.
Draw your own conclusions.
Tags: