Understanding the Scores

Critical Errors

Factually incorrect statements about the film. These are the most serious mistakes.

Weight: 5x

Critical Omissions

Important information that was completely missing from the response.

Weight: 5x

Imprecisions

Partially correct or vaguely stated information that could mislead.

Weight: 1x

Notable Gaps

Minor missing details that would have improved the response.

Weight: 1x
Weighted Score Formula: ((Critical Errors + Critical Omissions) × 5) + Imprecisions + Notable Gaps

Lower scores indicate more accurate responses. A score of 0 means perfect accuracy.

AI Model Rankings

Compare models by different scoring methods

Ranked by weighted score: Critical errors and omissions are penalized 5x more than imprecisions and gaps.

Rank Model Reports Critical Imprecisions Weighted Score
🥇 Gemini 3.0 Flash + Search +Search 1313 0.38 0.91 3.68
🥈 Gemini 2.5 Flash + Search +Search 342 0.46 0.88 4.65
🥉 Gemini 2.0 Flash + Search +Search 3 0.33 0.67 6.33
#4 Claude 4.5 Haiku + Search +Search 30 0.77 1.03 7.73
#5 Claude 4 Sonnet + Search +Search 21 0.67 1.52 8.62
#6 Gemini 3.0 Flash 430 1.13 1.27 9.12
#7 Gemini 2.0 Flash 87 1.54 1.52 17.01
#8 Gemini 2.5 Flash 299 2.5 1.23 19.01
#9 Claude 4.5 Sonnet + Search +Search 2 1.0 0.0 26.0

Ranked by average critical errors only. This shows which models make the fewest factual mistakes.

Rank Model Reports Avg Critical Errors
🥇 Gemini 2.0 Flash + Search +Search 3 0.33
🥈 Gemini 3.0 Flash + Search +Search 1313 0.38
🥉 Gemini 2.5 Flash + Search +Search 342 0.46
#4 Claude 4 Sonnet + Search +Search 21 0.67
#5 Claude 4.5 Haiku + Search +Search 30 0.77
#6 Claude 4.5 Sonnet + Search +Search 2 1.0
#7 Gemini 3.0 Flash 430 1.13
#8 Gemini 2.0 Flash 87 1.54
#9 Gemini 2.5 Flash 299 2.5

Ranked by total error count (all types combined, unweighted). This treats all errors equally.

Rank Model Reports CE I O G Total
🥇 Gemini 3.0 Flash + Search +Search 1313 0.38 0.91 0.08 0.47 1.84
🥈 Gemini 2.5 Flash + Search +Search 342 0.46 0.88 0.18 0.57 2.09
🥉 Gemini 2.0 Flash + Search +Search 3 0.33 0.67 0.67 0.67 2.33
#4 Claude 4.5 Haiku + Search +Search 30 0.77 1.03 0.4 0.87 3.07
#5 Gemini 3.0 Flash 430 1.13 1.27 0.29 0.73 3.42
#6 Claude 4 Sonnet + Search +Search 21 0.67 1.52 0.38 1.86 4.43
#7 Gemini 2.5 Flash 299 2.5 1.23 0.85 1.04 5.62
#8 Gemini 2.0 Flash 87 1.54 1.52 1.22 1.7 5.98
#9 Claude 4.5 Sonnet + Search +Search 2 1.0 0.0 3.5 3.5 8.0

Film Accuracy Rankings

Films AI handles most accurately (by weighted score)

Rank Film Year Reports Avg Score
🥇 Winter Light 1963 2 0.0
🥈 Godzilla 1954 1 0.0
🥉 Decalogue V 1989 1 0.0
#5 Ted 2012 2 0.0
#6 Me Before You 2016 2 0.0
#7 Hot Fuzz 2007 1 0.0
#8 Antiviral 2012 1 0.0
#9 Kick-Ass 2010 2 0.0
#10 The Queen's Gambit 2020 1 0.0
#11 Se7en 1995 1 0.0
#12 Kung Fu Panda 2 2011 1 0.0
#13 Talk to Me 2022 1 0.0
#14 The Rock 1996 1 0.0
#16 The Cabin in the Woods 2011 1 0.0
#18 Crazy, Stupid, Love. 2011 1 0.0
#19 Bram Stoker's Dracula 1992 1 0.0
#20 A New Kind of Love 1963 1 0.0

Most Challenging Questions

Questions that cause the most AI errors (click to view report)

#1
The Best Years of Our Lives (1946)
What happens in the aircraft graveyard scene in The Best Years of Our Lives?
General Analysis 1 models tested
86.0
#2
The Young Girls of Rochefort (1967)
What is the significance of the ax murder subplot in The Young Girls of Rochefort?
Plot Analysis 1 models tested
70.0
#3
Calvaire (2004)
What is the significance of the piano scene in Calvaire?
General Analysis 1 models tested
70.0
#4
Gravity (2013)
What is the significance of the Ganges sunrise story in Gravity?
General Analysis 1 models tested
65.0
#5
Oldboy (2003)
Is the pregnancy in Oldboy real or a phantom pregnancy?
General Analysis 1 models tested
60.0
#6
Kingdom of Crooked Mirrors (1963)
Regarding the film Kingdom of Crooked Mirrors (1963), how does the relationship between the two main characters evolve o...
Character Analysis 2 models tested
59.5
#7
The Daytrippers (1996)
What is the significance of the Andrew Marvell poem in The Daytrippers?
General Analysis 1 models tested
57.0
#8
Unknown (0)
Did the real 2025 Conclave elect a Pope similar to the film's character?
Character Analysis 1 models tested
53.0
#9
Mikey and Nicky (1976)
What is the significance of the watch in Mikey and Nicky?
General Analysis 1 models tested
52.0
#10
Shock Corridor (1963)
What is the significance of the color sequence in Shock Corridor?
General Analysis 1 models tested
51.0
#11
Nine Queens (2000)
What is the significance of the bank failure in Nine Queens?
General Analysis 1 models tested
51.0
#12
Donovan's Reef (1963)
Regarding Donovan's Reef (1963), what is the significance of the December 7th birthday in Donovan's Reef?
General Analysis 1 models tested
51.0
#13
Gentlemen Prefer Blondes (1953)
Regarding Gentlemen Prefer Blondes (1953), what is the significance of the 'Diamonds Are a Girl's Best Friend' number in...
Plot Analysis 1 models tested
50.0
#14
The Warriors (1979)
Did Mercy bite a Punk in The Warriors bathroom fight?
General Analysis 1 models tested
50.0
#15
Beautiful Thing (1996)
What happens to Leah in Beautiful Thing?
General Analysis 1 models tested
48.0
#16
All That Heaven Allows (1955)
Regarding the film All That Heaven Allows (1955), how much did the film make at both the box office and after (detail br...
Reception & Reviews 2 models tested
47.5
#17
Secret Honor (1984)
What is the 'China Plan' mentioned in Secret Honor?
Plot Secrets 1 models tested
47.0
#18
Fear (1996)
What happens to Gary in the movie Fear?
General Analysis 1 models tested
47.0
#19
Mickey 17 (2025)
What is the significance of the dream sequence at the end of Mickey 17?
General Analysis 1 models tested
46.0
#20
Ghost in the Shell (1995)
What is the difference between the 1995 Ghost in the Shell ending and the manga ending?
General Analysis 1 models tested
46.0