Null hypothesis significance testing (NHST) is like an immortal horse that some researchers have been trying to beat to death for over 50 years, but without any success. In this article we discuss the flaws in NHST, the historical background in relation to both Fisher’s and Neyman-Pearson’s statistical ideas, the common misunderstandings of what p < .05 actually means, and the APA Manual’s (2010) clear, but most often ignored, instructions to report effect sizes and interpret what they all mean in the real world. Also, we discuss how Bayesian statistics can be used to overcome some of the problems with NHST. We then analyze quantitative articles in two of the highest impact factor journals in sport and exercise psychology in the last three years (2012–2014) to determine if we have learned what we should have learned decades ago about the use and meaningful interpretations of the statistics we use. © 2015 Human Kinetics, Inc.