SIFT
National Day of Learning / Let's Talk Science 2026
National Day of Learning / Let's Talk Science 2026

Above it,
not in it

How to use LLMs for the investigation of claims

Mike Caulfield
National Day of Learning / Let's Talk Science · 3/28/2026
Scroll
View on mobile →
02
National Day of Learning / Let's Talk Science 2026
SIFT infographic

SIFT

Stop
Investigate the source
Find better coverage
Trace claims, quotes, and media to the original context
National Day of Learning / Let's Talk Science 2026
SIFT infographic

SIFT Success

Taught in hundreds of universities in U.S. as information literacy introduction (possibly thousands around world)
Taught to over 10,000 librarians and library staff worldwide through Google Super Searchers, in dozens of languages
Saw twofold to sixfold increases in student capabilities on core outcome measures in over a dozen NRCTs and RCTs
Along with Sam Wineburg's "lateral reading", changed much of the shape of online information literacy
National Day of Learning / Let's Talk Science 2026

Have you ever yelled at an AI?

National Day of Learning / Let's Talk Science 2026

Have you ever "bro'd-out" with an AI?

National Day of Learning / Let's Talk Science 2026

Do you ask AI for answers?

National Day of Learning / Let's Talk Science 2026

Or do you ask AI for information?

National Day of Learning / Let's Talk Science 2026

From
chatbot to
information
assistant

We've all gotten into the back and forth. We've all been swayed by the flattery. We've all put our brain on auto-pilot. That's OK.

But this is a session about how to take back control; how with AI to stay above it, not in it.

National Day of Learning / Let's Talk Science 2026

From
critical
thinking
to critical
doing

Not (just) about how we think about what is on our screen, but

how we use AI as a tool to navigate complex information environments.

05
National Day of Learning / Let's Talk Science 2026

SIFT
for AI

Stop and get it in. Investigate the evidence. Find better sources. Track it down!

National Day of Learning / Let's Talk Science 2026
SIFT framework: Stop and get it in, Investigate evidence, Find sources, Track it down
06
National Day of Learning / Let's Talk Science 2026

Stop and
get it in

Key Insight: The first step is the hardest part of the journey

Tip #1

Just select the whole claim or upload the whole image

Stop (and get it in!)...

National Day of Learning / Let's Talk Science 2026

This is very different!

Search was about keywords

LLMs can process claims

08
National Day of Learning / Let's Talk Science 2026

Investigate
the evidence

Use "evidence-focused" not "answer-focused" follow-ups.

Assemble, weight, and categorize evidence

Don't rush to the answer, explore the space

08
National Day of Learning / Let's Talk Science 2026

Investigate
the evidence
(cont'd)

Tip #4

Explore instead of sleepwalk with an evidence-focused prompt

Tip #5

Categorize, list, produce tables of evidence and sources

Tip #6

Keep a follow-ups file

National Day of Learning / Let's Talk Science 2026

Beyond the buzz...

Choose the follow-up that is most suited to your information need...

Put some facts, misconceptions, and hype about _______ in a table, with misconceptions and hype having corrections follow, and facts having additional detail.
Categorize the elements of this event as unprecedented, unusual, noteworthy, or normal. It's OK to have empty categories.
Search for and reason about evidence against this claim and present in a table, THEN search for and reason about evidence for this claim and present in a table
National Day of Learning / Let's Talk Science 2026

Sign of the times (to come)...

Is this good evidence that ________? Give a table that shows the surrounding context that supports this as strong or weak evidence of that.
Categorize the elements of this event as unprecedented, unusual, noteworthy, or normal. It's OK to have empty categories.
What's the overarching claim of what I posted? What is the evidence for and against?
Read the room: what do a variety of experts think about the claim? How does scientific, professional, popular, and media coverage break down and what does it tell us?
07
National Day of Learning / Let's Talk Science 2026

Find better
sources

Look at sources for support, depth, accuracy

Tip #2

If you see links, scan them. If you don't, ask for them.

Tip #3

Ask for the links you need, whether types of publications, or a link to the original source.

Is this real?

Can you find the best sources to cite on the actual claim?
Find me a link to the original source. If not available, find a link to the closest thing to the original source.
Give me a source that is the most recent coverage on ______________.

Hope or Hype?

Choose a source-focused follow-up:

Show me the best academic sources on this subject (with links).
Show me the most recent news stories on this subject (with links).
Find the best general explainer on this subject (with links).
National Day of Learning / Let's Talk Science 2026

Track
it down!

Click the links. AI made you the map, now head to your destination.

This is a move we use throughout!

Keep tethered!

Follow-ups File

Keep a file of follow-ups, or use a text-expander plugin for quick use.

Follow-ups file example
09
National Day of Learning / Let's Talk Science 2026

And that's it…

Stop and get it in. Investigate the evidence. Find better sources. Track it down!

Now let's try it together.

Workshop Activity

Note: "Track it down" is used throughout — we hover over sources, we click, we verify.

You see this come across your feed:

Find better sources

Copy the text below:

Find me a link to the original source of this information. If not available, find me a link to the closest thing to the original source.

Click through the links, and the links in the linked items until you find the study.

Activity

Ask what people found and how they got there (what did they click?), then do front of class walkthrough

Investigate the evidence #1

Copy this text:

Evaluate the evidence for the claim that _____ and provide a table that matches evidence to rebuttals and rates the strength of the evidence

Fill in the blank with the claim you are interested in — memory benefits? Cognitive benefits? Then enter and review the evidence chart.

Once done reviewing, turn and talk to your classmate. Compare the results you got with the results they got and note differences. Then discuss how the different types of evidence impact your confidence that chocolate improves memory in humans and why.

Discussion

Teacher should ask students what they found compelling, and particularly if there was any information they learned that changed how they thought about the research

Investigate the evidence #2

Copy one of the following follow-ups:

How does the research that is industry funded compare to the research that is not industry funded when it comes to findings around this category of outcomes around ____?

OR

Is this ____ study industry funded?

Fill in the blank with the claim or study topic and submit.

National Day of Learning / Let's Talk Science 2026

Conclusion

One of the greatest fears of teachers is that LLMs are "thinking for" students

One of the greatest fears students have? The same!

How do we address it? How do we help our students?

National Day of Learning / Let's Talk Science 2026

From
chatbot
to
assistant

Chatbots were a historical mistake of sorts

These are tools that help you navigate an information environment

The skills you need?

What we teach students: how to ask the right questions, how to interpret sources

National Day of Learning / Let's Talk Science 2026

The
Paradox

This is a fraught time for critical thinking.

This is a golden age for critical thinkers.

National Day of Learning / Let's Talk Science 2026

The brighter path

By teaching these simple habits, and showing students the power of the right questions, we have a chance to choose the brighter path.

National Day of Learning / Let's Talk Science 2026

Skills into
Superpowers

The weird thing? The skills we teach when applied to a tool like this become superpowers.

Critical thinking — or critical doing — may be in jeopardy, but its benefits have never been more visible or immediate.

National Day of Learning / Let's Talk Science 2026

Thank you

Mike Caulfield
1 / 22