Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Best tutorial paper on reproducibility? #8

Open
matthew-brett opened this issue Mar 22, 2022 · 3 comments
Open

Best tutorial paper on reproducibility? #8

matthew-brett opened this issue Mar 22, 2022 · 3 comments

Comments

@matthew-brett
Copy link
Contributor

Hey @jbpoline - and y'all.

What is the best article / source for the students to read about reproducibility, do you think?

We previously suggested:

  • Donoho et al 2009 [DMR+09] (you can skip-read the sections on Sparselab, Symmlab and Spherelab);
  • Preeyanon et al 2014 [PPB14];
  • Wilson et al 2014 [WAB+14].

See: https://bic-berkeley.github.io/psych-214-fall-2016/day_00.html

Are there other, better references we can point them to, on the general problem of reproducibility?

@jbpoline
Copy link

I personally really like Wilson et al, but truly there are no one paper that talk about all aspects of reproducibility. Wilson et al focuses on software / coding aspects, but we should accompany this with data management aspects (eg, data annotation / provenance, I often have students listen to This snafu and statistical best practices (maybe some of the Ioannidis ones)

@matthew-brett
Copy link
Contributor Author

Thanks! Which Ioannidis ones were you thinking of?

@jbpoline
Copy link

sorry for the late reply, I think the Button et al 2013 is probably good for the power aspects, but there might be better ones for more general exposition (including winners curse, file drawer, p-hacking, etc). At the moment, I basically have one per topic.
1.Button, K. S. et al. Power failure: why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience 14, 365–376 (2013).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants