Series 2: To p or not to p, will we ever let it p

Giusi Moffa

September 7, 2017


Figure from xkcd
The never ending saga of p-values

The ASA Statement on p-Values: Context, Process, and Purpose
with comments at
Supplemental Material to the ASA Statement on P-Values and Statistical Significance
was published in 2016 as an editorial in The American Statistician, with 21 comments from renowned statisticians, and a list of relevant references.

Meeting 1 - September 7th

  1. The ASA Statement on p-Values: Context, Process, and Purpose (Ronald L. Wasserstein & Nicole A. Lazar)

  2. Statistical Tests, P-values, Confidence Intervals, and Power: A Guide to Misinterpretations (Sander GREENLAND, Stephen J. SENN, Kenneth J. ROTHMAN, John B. CARLIN, Charles POOLE, Steven N. GOODMAN, and Douglas G. ALTMAN)
    This is a general introduction to the topic highlighting common misinterpretations, therefore it is a good place to start (if not as a refresher) before tackling the statement itself

Meeting 2 - September 21st

  1. Altman, Naomi: Ideas from multiple testing of high dimensional data provide insights about reproducibility and false discovery rates of hypothesis supported by p-values
  2. Benjamin, Daniel J, and Berger, James O: A simple alternative to p-values
  3. Benjamini, Yoav: It’s not the p-values’ fault
  4. Berry, Donald A: P-values are not what they’re cracked up to be
  5. Carlin, John B: Comment: Is reform possible without a paradigm shift?
  6. Cobb, George: ASA statement on p-values: Two consequences we can hope for
  7. Gelman, Andrew: The problems with p-values are not just with p-values

Meeting 3 - October 19th

  1. Goodman, Steven N: The next questions:Who, what, when, where, and why?
  2. Greenland, Sander: The ASA guidelines and null bias in current teaching and practice
  3. Ioannidis, John P.A.: Fit-for-purpose inferential methods: abandoning/changing P-values versus abandoning/changing research
  4. Johnson, Valen E.: Comments on the ASA Statement on Statistical Significance and P-values" and marginally significant p-values
  5. Lavine, Michael, and Horowitz, Joseph: Comment
  6. Lew, Michael J: Three inferential questions, two types of P-value

Meeting 4 - November 2nd

  1. Little, Roderick J: Discussion
  2. Mayo, Deborah G: Don’t throw out the error control baby with the bad statistics bathwater
  3. Millar,Michele: ASA statement on p-values: some implications for education
  4. Rothman, Kenneth J: Disengaging from statistical significance
  5. Senn, Stephen: Are P-Values the Problem?
  6. Stangl, Dalene: Comment
  7. Stark, P.B.: The value of p-values
  8. Ziliak, Stephen T: The significance of theASA statement on statistical significance and p-values