What is Worth Replicating? - SIPS 2020 Unconference session

Given that most research is original and we have limited resources available for replication, we need guidelines for study selection in replication research. But what makes a study worth replicating? In our unconference session at SIPS this year, we had the pleasure of discussing this problem with fifty-some enthusiastic scholars. Here is a quick summary of what they taught us. First off, we went into this session with our own prior beliefs about what makes a study worth replicating.

Fifty ways to leave your model

A method for calculating the number of alternative causal models, given a number of variables/nodes.

Meta-research at the Psychological Science Accelerator

Summary of unconference session at Tilburg Meta-research day 2019.

Mixed model equivalence test using R and PANGEA

How to calculate an equivalence test, and power for an equivalence test, for a fixed effect in a mixed effects model using R and PANGEA.

Proposing a theory committee at the Psychological Science Accelerator

(written in collaboration with Nicholas A. Coles) The Psychological Science Accelerator (PSA) is a global network of psychological laboratories that organizes large-scale empirical research projects. The organization aims “to accelerate the accumulation of reliable and generalizable evidence in psychological science” (Moshontz et al. 2018). To succeed in this mission, the PSA has created several committees that work together to address important challenges in producing high quality research, such as having access to an inferentially meaningful sample size, reducing the reliance on WEIRD participants, and improving the methodological quality of designs and analyses.