21st May 2019
New podcast explores why ‘statistically significant’ is so misunderstood
‘Statistical significance’ is one of the most widely misunderstood phrases in science, according to a 2013 Scientific American article.
It’s a controversial topic. Probability values (p-values) have been used as a way to measure the significance of research studies since the 1920s, with thousands of researchers relying on them since. With this reliance, though, comes misunderstanding and, therefore, misuse.
This misunderstanding is what the latest episode of the How Researchers Changed the World podcast explores, in conversation with statistician Ron Wasserstein.
In particular, the podcast focuses on Ron’s research into the misuse of p-values as a measure of statistical significance, which culminated in his 2016 paper: ‘The American Statistical Association’s statement on P-values: Context, Process and Purpose.’
Significance tests and p-values are widely used, according to Ron, to remove ‘uncertainty’ from scientific research. But uncertainty exists everywhere, and scientific research is no exception. For Ron, uncertainty in research should be embraced and accepted.
“Significance tests and dichotomised p-values … have turned many researchers into what I’ll call ‘scientific snowbirds’, trying to avoid dealing with uncertainty by escaping to a happier place.” – Ron Wasserstein
With increasing use, and misuse, of p-values, statistics as a whole was starting to get a bad name. Some journals even banned the use of p-values and other statistical methods. So, Ron was tasked with leading the creation of a framework outlining how p-values should be used in research, which would be published as a statement by the American Statistical Association , a leading authority in the statistics world.
“We were challenged to do the ASA statement on p-values because of these attacks on statistics as a whole field of research.” – Ron Wasserstein
It wasn’t a simple task, but although the debate regarding p-values continues, the statement has had an impact on the research world beyond what Ron could ever have imagined…
The podcast is available on Apple Podcasts, Spotify, Stitcher and Android podcast providers – or head to www.howresearchers.com.
For more information, or to interview Ron Wasserstein, please contact: [email protected]
Presented by Dr Kaitlyn Regehr
Alongside the researcher, the podcast is presented by Dr Kaitlyn Regehr. Dr Kaitlyn Regehr is an academic scholar who specializes in digital and modern culture, gender studies, and new technology. She also regularly features on BBC World as a topic specialist.
12-week learning programs – supercharge your research career
Alongside the podcast are two 12-week learning programs for early and mid-career researchers. They’re delivered online, with one chapter by email each week. Over 12 weeks these chapters build into an indispensable guide.
The early career program covers everything you need to know to get your research published and build your profile as a researcher. The mid-career program is the go-to-guide for managing mid-career challenges, boosting the impact of your research, and enhancing your profile as a researcher.