Rewinder

Analyzing AI accuracy on film knowledge

Exploring how AI models handle questions about movies — from plot details to cast information, awards to production trivia. Ultimately interested in whether LLMs can efficiently fact-check themselves at reasonable cost to apply at scale, and whether we can develop user experience models that pull people into the process of verification rather than away from it.

2527
Reports Analyzed
886
Films Covered
9
AI Models Tested
7.1
Avg Error Score
3916
Errors Found
3909
Missing Context
19169
Claims Verified
213
Reruns

What This Is

This is not a research project about the accuracy of LLMs or specific LLM models. This is a design project to see if LLM-based annotation can reliably surface issues in LLM responses and provide information to analyze and resolve those issues.

As such, see this as a site primarily to click around in and think about design patterns and solutions, not as a database to answer questions.

If you use this as a database to answer research questions I will come to your work personally and mock you.

10 Random Questions

10 Most Challenging Questions

10 Middle Difficulty Questions

Error Score Distribution

Recent Reports

X (2022) 0 1 Bicycle Thieves (1948) 1 1 Saturday Night Fever (1977) 1 0 Saturday Night Fever (1977) 0 0 Saturday Night Fever (1977) 1 3 L'Immortelle (1963) 0 2 Time of Return (1963) 1 1 Time of Return (1963) 0 0 Time of Return (1963) 0 1 The Bow (2005) 0 2 What is the symbolic meaning of the ending of The Bow (2005) 0 2 No Country for Old Men (2007) 0 2 No Country for Old Men (2007) 0 1 No Country for Old Men (2007) 3 0 Chungking Express (1994) 3 4 Chungking Express (1994) 1 0 Chungking Express (1994) 0 0 Unknown (0) 2 1 The Warriors (1979) 0 0 Touch of Evil (1958) 0 1 The Martian (2015) 0 0 First Blood (1982) 1 1 Does Rambo kill anyone in the film First Blood (1982) 0 1 Das Boot (1981) 0 0 Das Boot (1981) 1 1 Blade Runner 2049 (2017) 0 2 The Birds (1963) 1 0 The Birds (1963) 1 0 Monty Python and the Holy Grail (1975) 0 2 Indiana Jones and the Temple of Doom (1984) 0 0 What is the difference between the ending of Nosferatu (1922) 0 2 Lilya 4-ever (2002) 0 4 Eyes Wide Shut (1999) 1 3 Eyes Wide Shut (1999) 1 0 Mean Girls (2004) 0 2 Any Number Can Win (1963) 1 5 Any Number Can Win (1963) 0 0 Any Number Can Win (1963) 1 0 Lone Star (1996) 0 0 Lone Star (1996) 2 1 Companion (2025) 0 0 Companion (2025) 0 0 Capernaum (2018) 3 1 The Thin Red Line (1964) 4 1 My Girl (1991) 0 1 Jerry Maguire (1996) 2 2 The Bridge over the River Kwai (1957) 1 1 The Bridge on the River Kwai (1957) 1 4 The Bridge on the River Kwai (1957) 3 0 Center Stage (2000) 0 1 Unknown (0) 0 0 Cronos (1993) 0 0 Barbie (2023) 1 1 Barbie (2023) 2 0 Kingsman: The Secret Service (2014) 1 0 Sidewalls (2011) 0 0 Sidewalls (2011) 1 2 Boogie Nights (1997) 2 0 Boogie Nights (1997) 1 1 Logan (2017) 1 1 Office Space (1999) 1 2 Office Space (1999) 2 1 Office Space (1999) 2 3 The Return of the King (2003) 0 0 Serpico (1973) 0 1 All About Lily Chou-Chou (2001) 1 2 Unknown (0) 2 3 The Exterminating Angel (1962) 1 1 Crash (2004) 2 0 Elf (2003) 0 0 Annihilation (2018) 0 1 Annihilation (2018) 0 2 13 Assassins (2010) 0 0 One Battle After Another (2024) 1 1 One Battle After Another (2025) 1 2 Lamb (2021) 0 2 Lamb (2021) 0 0 Lamb (2021) 0 0 The Young Girls of Rochefort (1967) 0 0 The Young Girls of Rochefort (1967) 3 1 The Young Girls of Rochefort (1967) 0 2 Once Upon a Time in America (1984) 0 0 Once Upon a Time in America (1984) 0 1 Sling Blade (1996) 3 0 All About My Mother (1999) 0 0 All About My Mother (1999) 2 1 The Muppet Movie (1979) 1 0 The Muppet Movie (1979) 3 3 Reservoir Dogs (1992) 0 4 Unknown (0) 0 2 Dial Code Santa Claus (1989) 0 0 Dial Code Santa Claus (1989) 1 1 Dial Code Santa Claus (1989) 0 0 The Hurt Locker (2008) 1 3 The Hurt Locker (2008) 2 0 American Beauty (1999) 2 0 American Beauty (1999) 1 3 American Beauty (1999) 0 2 Funny Face (1957) 0 0 The Island (2005) 1 0