Show simple item record

dc.contributor.authorBotvinik-Nezer, Ren
dc.contributor.authorHolzmeister, Fen
dc.contributor.authorCamerer, CFen
dc.contributor.authorDreber, Aen
dc.contributor.authorHuber, Jen
dc.contributor.authorJohannesson, Men
dc.contributor.authorKirchler, Men
dc.contributor.authorIwanir, Ren
dc.contributor.authorMumford, JAen
dc.contributor.authorAdcock, RAen
dc.contributor.authorAvesani, Pen
dc.contributor.authorBaczkowski, BMen
dc.contributor.authorBajracharya, Aen
dc.contributor.authorBakst, Len
dc.contributor.authorBall, Sen
dc.contributor.authorBarilari, Men
dc.contributor.authorBault, Nen
dc.contributor.authorBeaton, Den
dc.contributor.authorBeitner, Jen
dc.contributor.authorBenoit, RGen
dc.contributor.authorBerkers, RMWJen
dc.contributor.authorBhanji, JPen
dc.contributor.authorBiswal, BBen
dc.contributor.authorBobadilla-Suarez, Sen
dc.contributor.authorBortolini, Ten
dc.contributor.authorBottenhorn, KLen
dc.contributor.authorBowring, Aen
dc.contributor.authorBraem, Sen
dc.contributor.authorBrooks, HRen
dc.contributor.authorBrudner, EGen
dc.contributor.authorCalderon, CBen
dc.contributor.authorCamilleri, JAen
dc.contributor.authorCastrellon, JJen
dc.contributor.authorCecchetti, Len
dc.contributor.authorCieslik, ECen
dc.contributor.authorCole, ZJen
dc.contributor.authorCollignon, Oen
dc.contributor.authorCox, RWen
dc.contributor.authorCunningham, WAen
dc.contributor.authorCzoschke, Sen
dc.contributor.authorDadi, Ken
dc.contributor.authorDavis, CPen
dc.contributor.authorLuca, ADen
dc.contributor.authorDelgado, MRen
dc.contributor.authorDemetriou, Len
dc.contributor.authorDennison, JBen
dc.contributor.authorDi, Xen
dc.contributor.authorDickie, EWen
dc.contributor.authorDobryakova, Een
dc.contributor.authorDonnat, CLen
dc.contributor.authorDukart, Jen
dc.contributor.authorDuncan, NWen
dc.contributor.authorDurnez, Jen
dc.contributor.authorEed, Aen
dc.contributor.authorEickhoff, SBen
dc.contributor.authorErhart, Aen
dc.contributor.authorFontanesi, Len
dc.contributor.authorFricke, GMen
dc.contributor.authorFu, Sen
dc.contributor.authorGalván, Aen
dc.contributor.authorGau, Ren
dc.contributor.authorGenon, Sen
dc.contributor.authorGlatard, Ten
dc.contributor.authorGlerean, Een
dc.contributor.authorGoeman, JJen
dc.contributor.authorGolowin, SAEen
dc.contributor.authorGonzález-García, Cen
dc.contributor.authorGorgolewski, KJen
dc.contributor.authorGrady, CLen
dc.contributor.authorGreen, MAen
dc.contributor.authorGuassi Moreira, JFen
dc.contributor.authorGuest, Oen
dc.contributor.authorHakimi, Sen
dc.contributor.authorHamilton, JPen
dc.contributor.authorHancock, Ren
dc.contributor.authorHandjaras, Gen
dc.contributor.authorHarry, BBen
dc.contributor.authorHawco, Cen
dc.contributor.authorHerholz, Pen
dc.contributor.authorHerman, Gen
dc.contributor.authorHeunis, Sen
dc.contributor.authorHoffstaedter, Fen
dc.contributor.authorHogeveen, Jen
dc.contributor.authorHolmes, Sen
dc.contributor.authorHu, C-Pen
dc.contributor.authorHuettel, SAen
dc.contributor.authorHughes, MEen
dc.contributor.authorIacovella, Ven
dc.contributor.authorIordan, ADen
dc.contributor.authorIsager, PMen
dc.contributor.authorIsik, AIen
dc.contributor.authorJahn, Aen
dc.contributor.authorJohnson, MRen
dc.contributor.authorJohnstone, Ten
dc.contributor.authorJoseph, MJEen
dc.contributor.authorJuliano, ACen
dc.contributor.authorKable, JWen
dc.contributor.authorKassinopoulos, Men
dc.contributor.authorKoba, Cen
dc.contributor.authorKong, X-Zen
dc.contributor.authorKoscik, TRen
dc.contributor.authorKucukboyaci, NEen
dc.contributor.authorKuhl, BAen
dc.contributor.authorKupek, Sen
dc.contributor.authorLaird, ARen
dc.contributor.authorLamm, Cen
dc.contributor.authorLangner, Ren
dc.contributor.authorLauharatanahirun, Nen
dc.contributor.authorLee, Hen
dc.contributor.authorLee, Sen
dc.contributor.authorLeemans, Aen
dc.contributor.authorLeo, Aen
dc.contributor.authorLesage, Een
dc.contributor.authorLi, Fen
dc.contributor.authorLi, MYCen
dc.contributor.authorLim, PCen
dc.contributor.authorLintz, ENen
dc.contributor.authorLiphardt, SWen
dc.contributor.authorLosecaat Vermeer, ABen
dc.contributor.authorLove, BCen
dc.contributor.authorMack, MLen
dc.contributor.authorMalpica, Nen
dc.contributor.authorMarins, Ten
dc.contributor.authorMaumet, Cen
dc.contributor.authorMcDonald, Ken
dc.contributor.authorMcGuire, JTen
dc.contributor.authorMelero, Hen
dc.contributor.authorMéndez Leal, ASen
dc.contributor.authorMeyer, Ben
dc.contributor.authorMeyer, KNen
dc.contributor.authorMihai, Gen
dc.contributor.authorMitsis, GDen
dc.contributor.authorMoll, Jen
dc.contributor.authorNielson, DMen
dc.contributor.authorNilsonne, Gen
dc.contributor.authorNotter, MPen
dc.contributor.authorOlivetti, Een
dc.contributor.authorOnicas, AIen
dc.contributor.authorPapale, Pen
dc.contributor.authorPatil, KRen
dc.contributor.authorPeelle, JEen
dc.contributor.authorPérez, Aen
dc.contributor.authorPischedda, Den
dc.contributor.authorPoline, J-Ben
dc.contributor.authorPrystauka, Yen
dc.contributor.authorRay, Sen
dc.contributor.authorReuter-Lorenz, PAen
dc.contributor.authorReynolds, RCen
dc.contributor.authorRicciardi, Een
dc.contributor.authorRieck, JRen
dc.contributor.authorRodriguez-Thompson, AMen
dc.contributor.authorRomyn, Aen
dc.contributor.authorSalo, Ten
dc.contributor.authorSamanez-Larkin, GRen
dc.contributor.authorSanz-Morales, Een
dc.contributor.authorSchlichting, MLen
dc.contributor.authorSchultz, DHen
dc.contributor.authorShen, Qen
dc.contributor.authorSheridan, MAen
dc.contributor.authorSilvers, JAen
dc.contributor.authorSkagerlund, Ken
dc.contributor.authorSmith, Aen
dc.contributor.authorSmith, DVen
dc.contributor.authorSokol-Hessner, Pen
dc.contributor.authorSteinkamp, SRen
dc.contributor.authorTashjian, SMen
dc.contributor.authorThirion, Ben
dc.contributor.authorThorp, JNen
dc.contributor.authorTinghög, Gen
dc.contributor.authorTisdall, Len
dc.contributor.authorTompson, SHen
dc.contributor.authorToro-Serey, Cen
dc.contributor.authorTorre Tresols, JJen
dc.contributor.authorTozzi, Len
dc.contributor.authorTruong, Ven
dc.contributor.authorTurella, Len
dc.contributor.authorvan ‘t Veer, AEen
dc.contributor.authorVerguts, Ten
dc.contributor.authorVettel, JMen
dc.contributor.authorVijayarajah, Sen
dc.contributor.authorVo, Ken
dc.contributor.authorWall, MBen
dc.contributor.authorWeeda, WDen
dc.contributor.authorWeis, Sen
dc.contributor.authorWhite, DJen
dc.contributor.authorWisniewski, Den
dc.contributor.authorXifra-Porxas, Aen
dc.contributor.authorYearling, EAen
dc.contributor.authorYoon, Sen
dc.contributor.authorYuan, Ren
dc.contributor.authorYuen, KSLen
dc.contributor.authorZhang, Len
dc.contributor.authorZhang, Xen
dc.contributor.authorZosky, JEen
dc.contributor.authorNichols, TEen
dc.contributor.authorPoldrack, RAen
dc.contributor.authorSchonberg, Ten
dc.date.accessioned2020-07-09T06:51:13Z
dc.date.issued2020-06-04en
dc.identifier.issn0028-0836en
dc.identifier.urihttp://hdl.handle.net/10026.1/15870
dc.description.abstract

Data analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses1. The flexibility of analytical approaches is exemplified by the fact that no two teams chose identical workflows to analyse the data. This flexibility resulted in sizeable variation in the results of hypothesis tests, even for teams whose statistical maps were highly correlated at intermediate stages of the analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Notably, a meta-analytical approach that aggregated information across teams yielded a significant consensus in activated regions. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset2–5. Our findings show that analytical flexibility can have substantial effects on scientific conclusions, and identify factors that may be related to variability in the analysis of functional magnetic resonance imaging. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for performing and reporting multiple analyses of the same data. Potential approaches that could be used to mitigate issues related to analytical variability are discussed. The results obtained by seventy different teams analysing the same functional magnetic resonance imaging dataset show substantial variation, highlighting the influence of analytical choices and the importance of sharing workflows publicly and performing multiple analyses.

en
dc.languageenen
dc.language.isoenen
dc.publisherSpringer Science and Business Media LLCen
dc.titleVariability in the analysis of a single neuroimaging dataset by many teamsen
dc.typeJournal Article
plymouth.author-urlhttps://www.researchgate.net/journal/1476-4687_Nature/publication/341530957_Variability_in_the_analysis_of_a_single_neuroimaging_dataset_by_many_teams/links/5ec60d77a6fdcc90d68933b3/Variability-in-the-analysis-of-a-single-neuroimaging-dataset-by-many-teams.pdf?_sg%5B0%5D=I74cCKM1R-1D-431Woc1xIyFBBNsi10jJkK-nE5_n3MRbd1Y9UHSWGLejT_sONNywgmNroNQ4BQrVNaFSXRXbw.G8j0Ofm1a02r9bi-bABnVUaXhNDE_KZZHY7Ve5LstragkeMa_w4Pk7VKL5yuOFVTofZpkIRHFrv-MpwhMJO8pw&_sg%5B1%5D=G8xBSJSa16I8pZtOga8nJg3rSsrnniqefUnPN4TSLLIV-uJjt1ApFG15mB-TgadjqmFCalIQgnE4CO-lFYWmsYIeNvaz9D-1BGoCVmwVSyWl.G8j0Ofm1a02r9bi-bABnVUaXhNDE_KZZHY7Ve5LstragkeMa_w4Pk7VKL5yuOFVTofZpkIRHFrv-MpwhMJO8pw&_sg%5B2%5D=WvUXBSK0CFm8dsXYSQgswqdP_qBUjp9IHYYYmsaAQhc4s43ktsKmJtgM00t-KTbGzmy5WOnrQTmG9kM.Fzjh1RSDktVYKgWg4jMrtXeviimfnty7uYus7U3CfMVdp78YsH7sGxEbS4uUP8zU0XPojjsu-y33QuCRTWnGqQ&_iepl=en
plymouth.journalNatureen
dc.identifier.doi10.1038/s41586-020-2314-9en
plymouth.organisational-group/Plymouth
plymouth.organisational-group/Plymouth/Faculty of Health
plymouth.organisational-group/Plymouth/Faculty of Health/School of Psychology
plymouth.organisational-group/Plymouth/REF 2021 Researchers by UoA
plymouth.organisational-group/Plymouth/REF 2021 Researchers by UoA/UoA04 Psychology, Psychiatry and Neuroscience
plymouth.organisational-group/Plymouth/Users by role
plymouth.organisational-group/Plymouth/Users by role/Academics
dcterms.dateAccepted2020-04-07en
dc.rights.embargodate2020-11-20en
dc.identifier.eissn1476-4687en
dc.rights.embargoperiodNot knownen
rioxxterms.versionofrecord10.1038/s41586-020-2314-9en
rioxxterms.licenseref.urihttp://www.rioxx.net/licenses/all-rights-reserveden
rioxxterms.licenseref.startdate2020-06-04en
rioxxterms.typeJournal Article/Reviewen


Files in this item

Thumbnail
Thumbnail
Thumbnail

This item appears in the following Collection(s)

Show simple item record


All items in PEARL are protected by copyright law.
Author manuscripts deposited to comply with open access mandates are made available in accordance with publisher policies. Please cite only the published version using the details provided on the item record or document. In the absence of an open licence (e.g. Creative Commons), permissions for further reuse of content should be sought from the publisher or author.
Theme by 
@mire NV