The Replication Crisis in Psychology

Psychology Fundamentals

Chapter 9 · The Replication Crisis in Psychology

Every prior chapter of this course has surfaced its own individual case of a famous finding not holding up as well as its popular reputation suggests. This chapter steps back and names the pattern directly: a real, field-wide "replication crisis" that psychology has spent the last decade actively confronting.

The Field-Wide Evidence — Already Covered Elsewhere on This Site

This site's own Scientific Methodology course already covers the single most important piece of real evidence behind this crisis in depth — the 2015 Open Science Collaboration reproducibility study, which attempted to replicate 100 published psychology studies and found only around a third produced a statistically significant effect the second time, with surviving effect sizes roughly half their original size. Rather than repeat that material here, this chapter points to it directly: see Scientific Methodology, Chapter 6 ("Reproducibility"), and builds on it with a case specific to psychology's own popular reach.

Why Cross-Reference Instead of Repeat
Several chapters in this course have already used the same discipline this cross-reference reflects — reusing an established, verified finding rather than re-deriving it from scratch each time a related topic comes up. The Open Science Collaboration figures are the field-wide backdrop; what follows here is one concrete, especially public example of exactly how that pattern plays out in practice.

Amy Cuddy's "Power Posing": A Real, Especially Public Case

In 2010, Dana Carney, Amy Cuddy, and Andy Yap published a study with 42 participants claiming that holding an expansive, "powerful" physical pose for just two minutes produced real measurable changes — increased testosterone, decreased cortisol, and greater self-reported risk tolerance. The idea that a simple bodily posture could genuinely shift a person's own hormones and confidence was enormously appealing, and Cuddy's 2012 TED talk presenting it became one of the platform's most-watched talks ever, reaching roughly 47 million views by 2017.

The Real Collapse
Independent replication attempts consistently failed to reproduce the original findings. A real 2015 replication by Ranehill and colleagues found people felt more powerful after posing, but detected no real hormonal or behavioral effects. A real 2017 special journal issue gathering eleven new studies again failed to replicate the behavioral effect. Most strikingly of all: Dana Carney — the original study's own lead author — published a real, public 2016 statement declaring, in her own words, "I do not believe that 'power pose effects' are real," calling the evidence against the effect "undeniable."

This case is worth sitting with specifically because of what makes it different from several of this course's other examples. Zimbardo (Chapter 6) still stands by his own original study today, disputing Le Texier's critique. Mischel's marshmallow test (Chapter 7) was weakened, not eliminated, by later replication. Power posing is a genuinely rarer case: an original author of the finding publicly repudiating her own earlier conclusion, in the full glare of the finding's own massive popular reach.

Why This Keeps Happening

Small Original Samples

42 participants (power posing), 24 (Zimbardo), 50 (Asch, Mischel) — genuinely modest sample sizes make chance findings more likely to look real.

Publication Incentives

Striking, positive results are historically far more publishable than a "we found nothing" result.

Popular Appeal Outrunning Evidence

A simple, empowering, low-effort claim (a two-minute pose changes your hormones) spreads faster than the more cautious science underneath it.

Slow Correction

Genuine correction, as with Carney's own reversal, can take years to catch up with a finding's own initial popular spread.

What the Field Has Actually Done About It

This isn't a story of psychology quietly ignoring its own problem. The 2015 Open Science Collaboration project (Scientific Methodology, Chapter 6) was itself the field's own large-scale, coordinated response — a deliberate, public effort to measure the real scale of the problem rather than look away from it. Pre-registration (committing to a study's own hypotheses and analysis plan before collecting data, also covered in Scientific Methodology's own Chapter 8) has become far more common specifically because of cases like this one, precisely to prevent a positive-sounding but ultimately fragile result from being published, popularized, and only years later quietly walked back.

Hands-On Exercises

Exercise 1

Explain, in your own words, why Dana Carney's own 2016 public repudiation of power posing is a genuinely stronger piece of evidence against the effect than an independent researcher's failed replication alone would be.

📄 View solution
Exercise 2

Explain, in your own words, why a study's real popularity (like a 47-million-view TED talk) has no actual bearing on whether its underlying finding is scientifically sound.

📄 View solution
Exercise 3

Compare power posing's real collapse against Zimbardo's Stanford Prison Experiment (Chapter 6). Explain, in your own words, one genuine similarity and one genuine difference between how each case unfolded.

📄 View solution

Chapter 9 Quick Reference

  • The field-wide evidence for psychology's replication crisis (the 2015 Open Science Collaboration study) is covered in depth in Scientific Methodology, Chapter 6 — not repeated here
  • Amy Cuddy's 2010 "power posing" study (Carney, Cuddy & Yap) became one of TED's most-watched talks (~47 million views) before failing multiple real replications
  • Lead co-author Dana Carney publicly repudiated her own original findings in 2016, calling the evidence against power posing "undeniable"
  • Small original sample sizes, publication incentives favoring striking results, and popular appeal outrunning cautious science all contribute to this recurring pattern
  • Pre-registration and large-scale coordinated replication efforts are the field's own real, active response, not a problem it has ignored