Optional Readings in Reproducibility

The following resources are all available from the Journal Articles folder under Resources in the Neuroimaging Workshops D2L site. These focus on reproducibility issues. BIDS is part of the solution, but these papers reveal that there is so much more to think about!

A classic paper, Gronenschild_2012_Freesurfer_Reproducibility.pdf, reveals that FreeSurfer analyses conducted on different operating systems have different results. This is exactly the reason that containerization is so important: when an application is built inside a container, it always runs the operating system that is installed in the container…even though you might run the container on Mac, Windows, Linux etc.
Kennedy_2019_ReproNim_Reproducibility discusses the large number of factors that influence reproducibility and an approach to making each individual paper completely reproducible by exposing all of the details of the processing. Like the Botvinik 2020 paper, it reveals that we have a long way to go.
Klapwijk_2021.pdf is a review that provides a wealth of information about factors that influence reproducibility and suggests approaches to resolving issues. The focus is on statistical power and the flexibility and transparency of data analysis. Don't be fooled by the apparent focus on developmental studies, most of what the authors have to say is broadly relevant.

BIDS 1 (10)