Does condensed matter physics need to worry about a replication crisis?

The workshop took place March 2, 2023. The videos are available below.

During the last decade, the social and biomedical sciences have been grappling with a “replication crisis,” in which a large fraction of published results cannot be verified or reproduced. The causes and solutions to this replication crisis are still not entirely clear, but generally its roots involve publication bias, the predominance of trendy research narratives, and unreliable or fraudulent manipulation of data.

Condensed matter physics, as a field, has largely been considered immune to replication crises by its practitioners, since its experiments tend to be data-rich as compared to those in the social or biomedical sciences. But many of the same root problems are also prevalent in condensed matter, so it is both reasonable and timely to consider the questions: do we need to worry about a replication crisis coming for us? Is it already here?

In this short workshop we will review the replication crisis as it has arisen in the social and medical sciences, then consider a few case studies of prominent recent results in condensed matter that have proven unreliable, and close with a panel discussion.

Program

What is a replication crisis and how do I know if I'm in one? Lessons from Psychology

Simine Vazire (University of Melbourne)

Extracting data from scientific publications

James Hamlin (University of Florida)

Non reproducible claims in Majorana research

Vincent Mourik (Forschungszentrum Jülich)

panel discussion

Panelists: - David Muller (Cornell University) - Igor Mazin (George Mason University) - Jessica Thomas (Physical Review) - Eugenie Reich (Pollock Cohen LLP) - Laurens Molenkamp (University of Würzburg)