Investigating the replicability of the social and behavioural sciences

Tyner, Andrew H and Abatayo, Anna Lou and Daley, Mason and Field, Samuel and Fox, Nicholas and Haber, Noah A and Hahn, Krystal M and Struhl, Melissa Kline and Mawhinney, Brinna and Miske, Olivia and Silverstein, Priya and Soderberg, Courtney K and Stankov, Theresa and Abbasi, Ahmed and Aberson, Christopher L and Aczel, Balazs and Adamkovič, Matúš and Albayrak, Nihan and Allen, Peter J and Andreychik, Michael and Awtrey, Eli and Axxe, Erick and Azevedo, Flavio and Bader, Miles D and Bago, Bence and Bailey, James and Bakker, Marjan and Banik, Gabriel and Banks, George C and Baskin, Ernest and Batruch, Anatolia and Beatteay, Annika and Behr, Sophie M and Berente, Nicholas and Berry, Zachariah and Białkowski, Jędrzej and Bodroža, Bojana and Boeschoten, Laura and Bognar, Miklos and Bokhove, Christian and Bonfiglio, Diane and Bouwman, Robin and Brady, Timothy F and Braithwaite, Scott R and Briceño Jiménez, Gabriel and Brick, Cameron and Bricka, Traci and Briker, Roman and Brown, Annette N and Brown, Gordon D A and van Aert, Robbie C M and Caldwell, Kathryn and Capitan, Sara and Capitán, Tabaré and Chandler, Jesse and Charles, Tessa and Chartier, Christopher R and Chawdhary, Rahul and Cheng, Kent Jason and Chopik, William J and Clark, Bruce and Colvin, Victoria E and Comer, C Cozette and Costantini, Giulio and Coupé, Tom and Cummins, Jamie and Czernatowicz-Kukuczka, Aneta and de Leeuw, Joshua and Dobolyi, David and Druckman, James N and Duan, Jianhua and Dujmović, Marin and Dunleavy, Daniel J and Durkee, Patrick K and Emery, Cécile and Esterling, Kevin M and Evans, Thomas R and Fedor, Anna and Fernández-Castilla, Belén and Fiala, Nathan and Field, James G and Fong, Nathan and Fonseca, Miguel A and Freeman, Alexandra L J and Freese, Jeremy and Geiger, Sandra J and Geng, Jing and Getz, Laura M and Geven, Linda Marjoleine and Gleibs, Ilka Helene and Gonzales, Donna Pamella and Gooty, Janaki and Gourdon-Kanhukamwe, Amélie and Greculescu, Cristina and Griffin, Siobhán M and Grigoryan, Lusine and Grunow, Martina and Gunby, Nicholas and Hall, Braeden and Hanel, Paul H P and Hannon, Erin E and Harper, Sam and Held, Marco Jürgen and Hickman, Louis and Higgins, Nathan C and Hippel, Svenja and Hoeppner, Sven and Hong, Sanghyun and Hostler, Thomas J and Inzlicht, Michael and Izydorczak, Kamil and Jaeger, Bastian and Jankowsky, Kristin and Jarke-Neuert, Johannes and Jensen, Matthew and Jokić, Biljana and Jolles, Daniel and Jolly, Phillip and Jones, Angela M and Juanchich, Marie and Kačmár, Pavol and Kapoor, Hansika and Keljanovic, Andjela and Koirala, Samjhana and Kołczyńska, Marta and Kouroupaki, Dimitra and Kühnen, Ulrich and Landgrave, Michelangelo and Larson, Michael J and Laulié, Lyonel and Lawrence, Alice C E and Le Forestier, Joel M and Leahy, Katelin E and Lee, Sungmok and Leslie, Jared and Lewis, Savannah C and Limnios, Christopher and Lin, Hause and Liu, An-Chiao and Lloyd, John Wills and Ludvig, Elliot A and Lynott, Dermot and MacDonald, Jordan and Mallik, Peter and Mallinson, Daniel J and Marinazzo, Daniele and Martarelli, Corinna S and Matacotta, Joshua and McBride, Andrew and McHugh, Cillian and McMillan, Gail and Méndez, Esteban and Metzger, Mitchell and Michaelides, Michalis P and Michalak, Johannes and Micheli, Leticia and Miller, Jeremy K and Milyavskaya, Marina and Molden, Daniel C and Monjaras, Ambar G and Moreau, David and Morrow, Audrey and Moya, Cristóbal and Mudrik, Liad and Mulder, Laetitia B and Munt, Katie A and Nandi, Arijit and Nason, Kathryn and Nast, Carolin and Nave, Gideon and Nax, Heinrich H and Neubauer, Florian and Nguyen, Phuong Linh L and Nichols, Austin Lee and Nilsonne, Gustav and O'Boyle, Ernest and Oettinghaus, Jule and Oh, Jeewon and Oshana, Adoril and Ostermann, Thomas and Ostrowski, Rachel P and Oyebanjo, Abiola and Panczak, Radoslaw and Patrianakos, Jamie and Pavez, Ignacio and Pavlov, Yuri G and Persson, Sofia and Perugini, Marco and Peters, Kim and Pieters, Constant and Ponizovskiy, Vladimir and Porter, Nathaniel D and Prenoveau, Jason M and Purić, Danka and Purol, Mariah F and Puthillam, Arathy and Quinn, Kimberly A and Ramljak, Marco and Reed, W Robert and Ritchie, Michaela and Ritzau, Margaret and Roche, Sean Patrick and Rodela, Romina and Röer, Jan Philipp and Ropovik, Ivan and Rothschild, Jacob and Saal, Justine and Safadi, Hani and Samaha, Jason and Sanchez, Mary and Sankaran, Soorya and Santos, David and Sargent, Amanda C and Sauter, Marian and Schmidt, Kathleen and Schnabel, Landon and Schroeder, Amber N and Schuetz, Sebastian W and Schuetze, Brendan A and Schulte-Mecklenbeck, Michael and Schütz, Astrid and Sevigny, Eric L and Shackleton, Ellie and Shafranek, Richard M and Shaki, Samuel and Shakya, Shishir and Sirota, Miroslav and Sisco, Matthew Ryan and Sitnikov, Maksim M and Slevc, L Robert and Smalarz, Laura and Smith, Colin Tucker and Snyder, Joel S and Sommet, Nicolas and Sonmez, Fatih and Spellman, Barbara A and Stanulewicz-Buckley, Natalia and Stock, George and Street, Chris N H and Strømland, Eirik and Sundelin, Tina and Syed, Moin and Szabelska, Anna and Szaszi, Barnabas and Szumowska, Ewa and Tagat, Anirudh and Täuber, Susanne and Tay, Louis and Thapa, Stuti and Thatcher, Jason and Tsaklakidou, Domna and Tummers, Lars and Turkovich, Elise and Tutor, Melba Verra and Urbanska, Karolina and van 't Veer, Anna Elisabeth and van Assen, Marcel and van de Ven, Niels and van den Goorbergh, Ruben and Vargo, Elisabeth Julie and Vaughn, Leigh Ann and Vazire, Simine and Vermeulen, Jentien M and Vo, Diem Thi Hong and Volkman, Victor and Wagenmakers, Eric-Jan and Wagner, Deliah and Walasek, Lukasz and Walter, Frank and Warmelink, Lara and Wei, Liuqing and Weißflog, Marie Isabelle and Weller, Nicholas and Wichman, Aaron L and Wilbiks, Jonathan and Williams, Jamal R and Wolfe, Kelly and Wort, Finnian and Wright, Ryan and Wulff, Jesper N and Xue, Xindong and Yan, Veronica X and Yang, Yuzhi and Yoon, Sangsuk and Žeželj, Iris and Zhang, Yinxian and Ziano, Ignazio and Zogmaister, Cristina and Zupan, Zorana and Zwaan, Rolf A and Nosek, Brian A and Errington, Timothy M (2026) Investigating the replicability of the social and behavioural sciences. Nature, 652 (8108). pp. 143-150. ISSN 0028-0836

Abstract

Pursuing replicability - independent evidence for previous claims - is important for creating generalizable knowledge 1,2. Here we attempted replications of 274 claims of positive results from 164 quantitative papers published from 2009 to 2018 in 54 journals in the social and behavioural sciences. Replications were high powered on average to detect the original effect size (median of 99.6%), used original materials when relevant and available, and were peer reviewed in advance through a standardized internal protocol. Replications showed statistically significant results in the original pattern for 151 of 274 claims (55.1% (95% confidence interval (CI) 49.2-60.9%)) and for 80.8 of 164 papers (49.3% (95% CI 43.8-54.7%)), weighed for replicating multiple claims per paper. We observed modest variation in replication rates across disciplines (42.5-63.1%), although some estimates had high uncertainty. The median Pearson's r effect size was 0.25 (95% CI 0.21-0.27) for original studies and 0.10 (95% CI 0.09-0.13) for replication studies, an 82.4% (95% CI 67.8-88.2%) reduction in shared variance. Thirteen methods for evaluating replication success provided estimates ranging from 28.6% to 74.8% (median of 49.3%). Some decline in effect size and significance is expected based on power to detect original effects and regression to the mean because we replicated only positive results. We observe that challenges for replicability extend across social-behavioural sciences, illustrating the importance of identifying conditions that promote or inhibit replicability 3,4.