Skip to main content

Courses About Pricing Educators

Sign in Get started

Courses About Pricing Educators

Get started Sign in

Loading courses

Loading lessons

Testing Claims: Probability & Statistics: Uncharted

Courses Probability & StatisticsTesting Claims

Testing Claims

Build tests from skeptical benchmarks, interpret p-values, manage errors, and defend against flexible analysis.

Probability & Statistics
Unit 10 of 12
20 lessons
152 min
420 XP

Every lesson is open. Sign in when you are ready to begin.

Sign in to start

Lessons

20 total

1The Skeptic's StanceFrame a statistical test by asking how surprising the data are under a benchmark.InteractiveConcept7 min20 XPOpen
2The Lady Tasting TeaRecognize randomization as the reference world for Fisher’s tea test.InteractiveConcept7 min20 XPOpen
3Null and AlternativePair research questions with precise null and alternative claims.InteractiveConcept7 min20 XPOpen
4How Surprising Is ThatLocate an observed statistic in an authored null distribution.InteractiveConcept8 min20 XPOpen
5The P-Value SaysInterpret a p-value as a tail probability under the null model.InteractiveConcept7 min20 XPOpen
6Compute a Simple PCompute an exact one-sided p-value in a small binomial test.InteractiveConcept8 min20 XPOpen
7The Significance LineTreat a significance threshold as a decision convention with tradeoffs.InteractiveConcept7 min20 XPOpen
8P WorkoutCompute and interpret exact tail probabilities in small null worlds.InteractivePractice9 min20 XPOpen
9Two Ways to Be WrongDistinguish false alarms from missed real effects.InteractiveConcept7 min20 XPOpen
10Set the Smoke DetectorPlace a decision threshold while balancing false alarms and misses.InteractiveConcept8 min20 XPOpen
11Power Is Seeing TrulyIdentify the design changes that increase power to detect a real effect.InteractiveConcept7 min20 XPOpen
12Significant but TinySeparate statistical significance from practical importance.InteractiveConcept7 min20 XPOpen
13The A/B TestUse an estimated difference and uncertainty to make a cautious experiment call.InteractiveConcept7 min20 XPOpen
14Torture the DataExplain why many unplanned tests manufacture false discoveries.InteractiveConcept8 min20 XPOpen
15The P-Hacking CatalogMatch flexible research moves with the bias each one creates.InteractiveConcept7 min20 XPOpen
16Preregister the BetOrder an experiment so its primary analysis is committed before inspection.InteractiveConcept7 min20 XPOpen
17Testing WorkoutCombine p-value readings and error types across decision cases.InteractivePractice9 min20 XPOpen
18Replication Is the RefereeTreat replication as a test of whether a finding survives new data.InteractiveConcept7 min20 XPOpen
19Read a Study Like a ProSelect the abstract details that earn statistical trust.InteractiveConcept7 min20 XPOpen
20Testing Mastery CheckCompute an exact test tail and interpret the resulting decision.InteractiveMastery check11 min40 XPOpen

How Sure Are You Two Variables