- Title
- Improving Statistical Analysis in Team Science: The Case of a Bayesian Multiverse of Many Labs 4
- Creator
- Hoogeveen, Suzanne; Berkhout, Sophie W.; Gronau, Quentin F.; Wagenmakers, Eric-Jan; Haaf, Julia M.
- Relation
- Advances in Methods and Practices in Psychological Science Vol. 6, Issue 3, p. 1-25
- Publisher Link
- http://dx.doi.org/10.1177/25152459231182318
- Publisher
- Sage
- Resource Type
- journal article
- Date
- 2023
- Description
- Team-science projects have become the “gold standard” for assessing the replicability and variability of key findings in psychological science. However, we believe the typical meta-analytic approach in these projects fails to match the wealth of collected data. Instead, we advocate the use of Bayesian hierarchical modeling for team-science projects, potentially extended in a multiverse analysis. We illustrate this full-scale analysis by applying it to the recently published Many Labs 4 project. This project aimed to replicate the mortality-salience effect—that being reminded of one’s own death strengthens the own cultural identity. In a multiverse analysis, we assess the robustness of the results with varying data-inclusion criteria and prior settings. Bayesian model comparison results largely converge to a common conclusion: The data provide evidence against a mortality-salience effect across the majority of our analyses. We issue general recommendations to facilitate full-scale analyses in team-science projects.
- Subject
- Bayes factor; Bayesian hierarchical modeling; replication; team science
- Identifier
- http://hdl.handle.net/1959.13/1489068
- Identifier
- uon:52610
- Identifier
- ISSN:2515-2459
- Rights
- © The Author(s) 2023. This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage). Request permissions for this article.
- Language
- eng
- Full Text
- Reviewed
- Hits: 721
- Visitors: 741
- Downloads: 26
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | ATTACHMENT02 | Publisher version (open access) | 1 MB | Adobe Acrobat PDF | View Details Download |