For decades scholars have discussed how the lack of replication studies impedes scientific progress in the field of management (Starbuck, 2006). More recently, related empirical investigations have cast additional doubts whether research published by top management journals will replicate (Goldfarb & King, 2016; Open Science Collaboration, 2015). In response, top management journals have started to encourage the submission of replication studies (Bettis et al., 2016). In response, more replication studies were conducted and published (SI SMJ) but the large gap between the number of replication studies needed to arrive at evidence-based theories remains.
We believe replication studies are currently rarely conducted for two underlying reasons: (1) remaining strong career incentive to focus on developing new theory and (2) lack of experience on how to design and execute replication studies. Doctoral programs can address both constraints by (a) requiring first and second-year doctoral students to conduct a replication study and (b) by providing instructions on how to conduct high-quality replications.
ARIM provides a platform to coordinate related activities across participating universities. It provides resources on how to teach replication to doctoral students and best practices on how to implement replication studies. In addition, ARIM will support the publication of student replication studies and incentives in the form of replication study competitions and awards. In the end, ARIM will contribute to overcoming the replication crisis in management research by empowering an increasing number of management scholars to conduct replication studies and by establishing an increasing stream of replication studies in the management literature.
Schwab, A., Aguinis, H., Bamberger, P., Hodgkinson, G. P., Shapiro, D. L., Starbuck, W. H., & Tsui, A. S. (2023). How replication studies can improve doctoral student education. Journal of Management Scientific Reports, 1(1), 18-41. https://doi.org/10.1177/27550311231156880
Aguinis H., Cascio W.F., Ramani R.S. (2020) Science’s Reproducibility and Replicability Crisis: International Business Is Not Immune. In: Eden L., Nielsen B., Verbeke A. (eds) Research Methods in International Business. JIBS Special Collections. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-22113-3_2
Bettis, R. A., Ethiraj, S., Gambardella, A., Helfat, C., & Mitchell, W. (2016). Creating repeatable cumulative knowledge in strategic management. Strategic Management Journal, 37(2), 257–261. https://doi.org/10.1002/smj.2477
Camerer, C. F., Dreber, A., Forsell, E., Ho, T. H., Huber, J., Johannesson, M., …Wu, H. (2016). Evaluating replicability of laboratory experiments in economics. Science, 351,1433-1436. https://doi.org/10.1126/science.aaf0918
Edlund, J. E., Cuccolo, K., Irgens, M. S., Wagge, J. R., & Zlokovich, M. S. (2021). Saving Science Through Replication Studies. Perspectives on Psychological Science, 174569162098438. https://doi.org/10.1177/1745691620984385
Ethiraj, S. K., Gambardella, A., & Helfat, C. E. (2016). Replication in strategic management. Strategic Management Journal, 37(11), 2191-2192. https://doi.org/10.1002/smj.2581
Fišar, M., Greiner, B., Huber, C., Katok, E., & Ozkes, A. I. (2024). Reproducibility in Management Science. Management Science, 70(3), 1343-1356. https://doi.org/10.1287/mnsc.2023.03556
Kraimer, M. L., Martin, X., Schulze, W., & Seibert, S. E. 2023. What does it mean to test theory? Journal of Management Scientific Reports, 1(1): 8-17. https://doi.org/10.1177/27550311231153484
Maula, M., & Stam, W. (2019). Enhancing rigor in quantitative entrepreneurship research. Entrepreneurship Theory and Practice, 44(6), 1059–1090. https://doi.org/10.1177/1042258719891388
Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015). Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? American Psychologist, 70(6), 487. https://doi.org/10.1037/a0039400
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. http://doi.org/10.1126/science.aac4716
Platt, J. R. (1964). Strong Inference: Certain systematic methods of scientific thinking may produce much more rapid progress than others. Science, 146(3642), 347-353. https://doi.org/10.1126/science.146.3642.347
Singh, K., Ang, S. H., & Leong, S. M. 2003. Increasing replication for knowledge accumulation in strategy research. Journal of Management, 29(4): 533-549. https://doi.org/10.1016/S0149-2063(03)00024-2
Stroebe, W., & Strack, F. (2014). The Alleged Crisis and the Illusion of Exact Replication. Perspectives on Psychological Science, 9(1), 59–71. https://doi.org/10.1177/1745691613514450
Landis, R. S., & Rogelberg, S. G. (2013). Our Scholarly Practices Are Derailing Our Progress: The Importance of “Nothing” in the Organizational Sciences. Industrial and Organizational Psychology, 6(3), 299–302. https://doi.org/10.1111/iops.12054
Hubbard, R., Vetter, D. E., & Little, E. L. 1998. Replication in strategic management: Scientific testing for validity, generalizability, and usefulness. Strategic Management Journal, 19(3): 243-254. https://doi.org/10.1002/(SICI)1097-0266(199803)19:3%3C243::AID-SMJ951%3E3.0.CO;2-0
Ioannidis, J. P. A. (2005). Why Most Published Research Findings Are False. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124
Benson, L., & Borrego, M. (2015). The Role of Replication in Engineering Education Research. Journal of Engineering Education, 104(4), 388–392. https://doi.org/10.1002/jee.20082