How Journalists think about statistics -- and how they don't

Published on May 14, 2018

Professional Development Talk; AP Statistics Readers Conference; Kansas City, Missouri; June 12, 2018

PRESENTATION OUTLINE

How journalists think about statistics
(and how they don't)

Regina Nuzzo, Ph.D.
Professor, Gallaudet University
Freelance Science Writer

June 12, 2018
AP Statistics Reading
Kansas City, Missouri

Photo by Taylor Kiser

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Hearing ≠ Listening



Telling ≠ Commu-nicating

“Explainability Strategist”
“Algorithmic Forensic Analyst”

Photo by bgottsab

JOURNALISTS
find the story amidst
the facts.

STATISTICIANS
find the signal amidst the noise.

Photo by DocChewbacca

JOURNALISTS:
"If your grandmother says she loves you, check it out anyway."

STATISTICIANS:
"What's the strength of evidence that Granny loves you?"

STORY-HACKING

Photo by d_jan

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

“Winner’s Curse”

Untitled Slide

Untitled Slide

Untitled Slide

“Amid Statistical Illiteracy, 62% of Colleges See a Rise or No Change in Applicants”

Untitled Slide

Untitled Slide

P-hacking & Story-hacking:
Confirmation bias
Motivated cognition

Combat these with:
Teach about cognitive biases;
Instill a healthy fear of being called out.

Photo by tropical.pete

"STATISTICAL SIGNIFICANCE IS SIGNIFICANT."

Photo by Alex Woods

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

P-Dazzled and Ignoring
Effect Size:
Assuming p Failing to connect results to the real world


Combat with:
Less p-value worship;
The oh-come-on “story behind the story”

“WARNING: DON’T TOUCH THE NUMBERS”

Photo by zeesenboot

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Untitled Slide

Avoidance of touching the numbers:
Fear of numbers;
Fear of going “off script”

How to combat:
Teach the power of descriptive statistics and data manipulation;
Less emphasis on one right answer;
Encourage playing around with data in fun and creative ways

Photo by bmooneyatwork

What if . . . statisticians and journalists worked together to create meaningful, accurate, and truly human-centered data communication?

Photo by Wenni Zhou

Hard work, but worth it.

Photo by anaxolotl

Regina Nuzzo

Haiku Deck Pro User