{"id":23319,"date":"2024-06-01T07:00:00","date_gmt":"2024-06-01T11:00:00","guid":{"rendered":"https:\/\/cehhs.utk.edu\/elps\/?p=23319"},"modified":"2024-05-17T11:06:32","modified_gmt":"2024-05-17T15:06:32","slug":"wait-i-cant-use-p-0-05","status":"publish","type":"post","link":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/","title":{"rendered":"Wait, I Can&#8217;t Use p &lt; 0.05?"},"content":{"rendered":"\n<p><strong>By Jake Working <\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile\" style=\"grid-template-columns:15% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"1695\" height=\"2560\" src=\"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/working_reformat-scaled.jpg\" alt=\"\" class=\"wp-image-23322 size-full\" srcset=\"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/working_reformat-scaled.jpg 1695w, https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/working_reformat-199x300.jpg 199w, https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/working_reformat-678x1024.jpg 678w, https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/working_reformat-768x1160.jpg 768w, https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/working_reformat-1017x1536.jpg 1017w, https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/working_reformat-1356x2048.jpg 1356w\" sizes=\"auto, (max-width: 1695px) 100vw, 1695px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p><strong>Introduction<\/strong>&nbsp;<\/p>\n\n\n\n<p>You might have heard the recent rumblings in the statistics world: null hypothesis significance testing, statistical significance, p-values, <em>our beloved p-value<\/em>, have been coming into question. Well, the statistical soundness of these methods is not being doubted, but their current use and interpretations in applied research have been.&nbsp;<\/p>\n<\/div><\/div>\n\n\n\n<div style=\"height:45px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>How did we get here? Why are interpretations of significance testing and p-values under fire? What does this mean for you, the applied researcher who uses these methods?<\/p>\n\n\n\n<p>The literature surrounding this topic is huge, so I will start to provide some background to these questions in this blog post by including a brief introduction to a few important articles. My name is Jake Working, and I am currently studying for my Ph.D. in Evaluation, Statistics, and Methodology at the University of Tennessee, Knoxville. Let\u2019s learn together.<\/p>\n\n\n\n<p><strong>How Did We Get Here?<\/strong><\/p>\n\n\n\n<p>Understanding the history of null hypothesis significance testing and p-values is just as important as crafting the future of these analytical methods. In this section, I direct you to check out Lee Kennedy-Shaffer\u2019s article \u201cBefore p &lt; 0.05 to Beyond p &lt; 0.05: Using History to Contextualize p-Values and Significance Testing\u201d (2019).<\/p>\n\n\n\n<p>Kennedy-Shaffer reminds us of the history of significance testing and the p-value, noting Sir Ronald Fisher\u2019s popularization of p &lt; 0.05 through historical and contextual lens. Fisher was advancing statistical methodology at the same time as statistic legends such as Karl Pearson (yes, that Pearson) and William Gosset (of Guinness \u201cstudent\u201d fame), who were all developing uses for significance testing. Fisher formed his suggested p &lt; 0.05 as a simple cut-off of significance in 1925. His reasoning was simple: \u201cp = 0.05, or 1 in 20, is 1.96 or nearly 2\u2026deviations exceeding twice the standard deviation are thus formally regarded as significant\u201d (Fisher, 1925, p. 47 in Kennedy-Shaffer, 2019, p. 84).<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:23% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"466\" height=\"349\" src=\"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/Screenshot-2024-04-23-124240.png\" alt=\"\" class=\"wp-image-23320 size-full\" srcset=\"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/Screenshot-2024-04-23-124240.png 466w, https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/Screenshot-2024-04-23-124240-300x225.png 300w\" sizes=\"auto, (max-width: 466px) 100vw, 466px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-text-align-center\"><em>Sir Ronald Fisher, circa 1946, thinking about p-values, <\/em><br><em>from University of Adelaide (<\/em><a href=\"https:\/\/digital.library.adelaide.edu.au\/dspace\/handle\/2440\/81670\" target=\"_blank\" rel=\"noreferrer noopener\"><em>source<\/em><\/a><em>)<\/em><\/p>\n<\/div><\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>Criticisms and alternatives to interpretations to significance testing have existed since the onset of null hypothesis significance testing. These include Neyman-Pearson\u2019s alpha (1933), Bayes\u2019 inverse probability, and Fisher himself even challenged the field against a fixed level of significance (Kennedy-Shaffer, 2019, pp. 85-86). So, what\u2019s the beef with p-values now?&nbsp;<\/p>\n\n\n\n<p><strong>Laying Down the Law<\/strong>&nbsp;<\/p>\n\n\n\n<p>As the discussion on p-values and other flaws in statistical reporting seemed to rekindle in the mid-2010s, the American Statistical Association decided to provide the scientific and research community with grounded direction on p-values. In this section, I urge you to read the very short, but impactful \u201c<em>ASA Statement on p-Values: Context, Process, and Purpose<\/em>\u201d by Ronald Wasserstein and Nicole Lazar (<a href=\"https:\/\/doi.org\/10.1080\/00031305.2016.1154108\" target=\"_blank\" rel=\"noreferrer noopener\">2016<\/a>).&nbsp;&nbsp;<\/p>\n\n\n\n<p>They articulated six simple principles on p-values:&nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"1\">\n<li>P-values can indicate how incompatible the data are with a specified statistical model\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a scientific threshold\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>Proper inference requires full reporting and transparency\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>A p-value, or statistical significance, does not measure the size of an effect or the importance of a result\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"6\">\n<li>By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis\u00a0<\/li>\n<\/ol>\n\n\n\n<p>These principles urge the researcher to contextualize and completely understand their data and analysis methods, making useless bright lines such as p &lt; 0.05. Rosnow and Rosenthal (1989) said it neatly: \u201c\u2026surely, God loves the .06 nearly as much as the .05\u201d (p. 1277).&nbsp;<\/p>\n\n\n\n<p><strong>Okay, so what do I do now?<\/strong>&nbsp;<\/p>\n\n\n\n<p>If you are a researcher, student, or just interested in statistical analysis, one thing you can do is to update your analytical habits. Check out this article by Wasserstein, Lazar, and Schirm: \u201c<em>Moving to a World Beyond \u2018p &lt; 0.05\u2019\u201d <\/em>(<a href=\"https:\/\/doi.org\/10.1080\/00031305.2019.1583913\" target=\"_blank\" rel=\"noreferrer noopener\">2019<\/a>) for context and suggestions.&nbsp;<\/p>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile\" style=\"grid-template-columns:23% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"289\" height=\"223\" src=\"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/Screenshot-2024-04-23-124404.png\" alt=\"\" class=\"wp-image-23321 size-full\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-text-align-center\"><em>Another Ronald, Ron Wasserstein, doing his best Fisher imitation, <\/em><br><em>from Amstat News (<\/em><a href=\"https:\/\/magazine.amstat.org\/blog\/2023\/06\/01\/my-asa-story-ron-wasserstein\/\" target=\"_blank\" rel=\"noreferrer noopener\"><em>source<\/em><\/a><em>)<\/em>\u00a0<\/p>\n<\/div><\/div>\n\n\n\n<div style=\"height:31px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>Included in their article is a mental framework to guide future use of these statistical methods they summarize into two sentences: \u201cAccept uncertainty. Be thoughtful, open, and modest\u201d (Wasserstein et al., 2019, p. 2). Their framework is helpful to set your mental state before delving into the <em>eight pages<\/em> of action items summarized from 43 different articles on this topic.&nbsp;&nbsp;<\/p>\n\n\n\n<p>Wasserstein et al. make it an easy read by summarizing each article into actionable bullet points and organizing the suggestions into five topic areas:&nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"1\">\n<li>Getting to a Post \u201cp &lt; 0.05\u201d Era\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>Interpreting and Using p\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>Supplementing or Replacing p\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>Adopting More Holistic Approaches\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>Reforming Institutions: Changing Publication Policies and Statistical Education\u00a0<\/li>\n<\/ol>\n\n\n\n<p><strong>Call to Action<\/strong>&nbsp;<\/p>\n\n\n\n<p>As it would be impossible to summarize everything from these articles into one blog post, I urge you to read the three articles in this post. You will better understand p-values and become a better researcher, evaluator, and statistician because of it.&nbsp;&nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"1\">\n<li>\u201cBefore p &lt; 0.05 to Beyond p &lt; 0.05: Using History to Contextualize p-Values and Significance Testing\u201d (Kennedy-Shaffer, 2019)\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u201cThe ASA Statement on p-Values: Context, Process, and Purpose\u201d (Wasserstein &amp; Lazar, 2016)\u00a0<\/li>\n<\/ol>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u201cMoving to a World Beyond p &lt; 0.05\u201d (Wasserstein et al., 2019)\u00a0<\/li>\n<\/ol>\n\n\n\n<p><strong>No need to abandon hypothesis testing and p-values, but be prepared to better understand these tools for what they are: statistical tools.<\/strong>&nbsp;<\/p>\n\n\n\n<div style=\"height:33px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><strong>References<\/strong>&nbsp;<\/p>\n\n\n\n<p>Kennedy-Shaffer L. (2019). Before p &lt; 0.05 to Beyond p &lt; 0.05: Using History to Contextualize p-Values and Significance Testing. <em>The American Statistician, 73<\/em>(Suppl 1), 82\u201390. <a href=\"https:\/\/doi.org\/10.1080\/00031305.2018.1537891\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1080\/00031305.2018.1537891<\/a>&nbsp;&nbsp;<\/p>\n\n\n\n<p>Rosnow, R.L. &amp; Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. <em>American Psychologist, 44<\/em>, 1276-1284.&nbsp;<\/p>\n\n\n\n<p>Wasserstein, R. L., &amp; Lazar, N. A. (2016). The ASA Statement on p-Values: Context, Process, and Purpose. <em>The American Statistician, 70<\/em>(2), 129-133. <a href=\"https:\/\/doi.org\/10.1080\/00031305.2016.1154108\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1080\/00031305.2016.1154108<\/a>&nbsp;&nbsp;<\/p>\n\n\n\n<p>Wasserstein, R. L., Schirm, A. L., &amp; Lazar, N. A. (2019). Moving to a World Beyond \u201cp&lt; 0.05\u201d. <em>The American Statistician, 73<\/em>(sup1), 1-19. <a href=\"https:\/\/doi.org\/10.1080\/00031305.2019.1583913\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1080\/00031305.2019.1583913<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>By Jake Working Introduction&nbsp; You might have heard the recent rumblings in the statistics world: null hypothesis significance testing, statistical significance, p-values, our beloved p-value, have been coming into question. Well, the statistical soundness of these methods is not being doubted, but their current use and interpretations in applied research have been.&nbsp; How did we [&hellip;]<\/p>\n","protected":false},"author":86,"featured_media":23325,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_eb_attr":"","inline_featured_image":false,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[44],"tags":[],"class_list":{"0":"post-23319","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-utkmadblog","8":"entry"},"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Wait, I Can&#039;t Use p &lt; 0.05? - Educational Leadership and Policy Studies<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Wait, I Can&#039;t Use p &lt; 0.05? - Educational Leadership and Policy Studies\" \/>\n<meta property=\"og:description\" content=\"By Jake Working Introduction&nbsp; You might have heard the recent rumblings in the statistics world: null hypothesis significance testing, statistical significance, p-values, our beloved p-value, have been coming into question. Well, the statistical soundness of these methods is not being doubted, but their current use and interpretations in applied research have been.&nbsp; How did we [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/\" \/>\n<meta property=\"og:site_name\" content=\"Educational Leadership and Policy Studies\" \/>\n<meta property=\"article:published_time\" content=\"2024-06-01T11:00:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2240\" \/>\n\t<meta property=\"og:image:height\" content=\"1260\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Jonah Hall\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jonah Hall\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/\"},\"author\":{\"name\":\"Jonah Hall\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#\\\/schema\\\/person\\\/6bfd2c32cad7f6a411dfcf7e5dd65055\"},\"headline\":\"Wait, I Can&#8217;t Use p &lt; 0.05?\",\"datePublished\":\"2024-06-01T11:00:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/\"},\"wordCount\":968,\"image\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/05\\\/New-MAD-Blog-Design-Final-2-2.jpg\",\"articleSection\":[\"Evaluation Methodology Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/\",\"name\":\"Wait, I Can't Use p &lt; 0.05? - Educational Leadership and Policy Studies\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/05\\\/New-MAD-Blog-Design-Final-2-2.jpg\",\"datePublished\":\"2024-06-01T11:00:00+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#\\\/schema\\\/person\\\/6bfd2c32cad7f6a411dfcf7e5dd65055\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/05\\\/New-MAD-Blog-Design-Final-2-2.jpg\",\"contentUrl\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/05\\\/New-MAD-Blog-Design-Final-2-2.jpg\",\"width\":2240,\"height\":1260},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wait-i-cant-use-p-0-05\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Wait, I Can&#8217;t Use p &lt; 0.05?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#website\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/\",\"name\":\"Educational Leadership and Policy Studies\",\"description\":\"University of Tennessee, Knoxville\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#\\\/schema\\\/person\\\/6bfd2c32cad7f6a411dfcf7e5dd65055\",\"name\":\"Jonah Hall\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/author\\\/jhall152\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Wait, I Can't Use p &lt; 0.05? - Educational Leadership and Policy Studies","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/","og_locale":"en_US","og_type":"article","og_title":"Wait, I Can't Use p &lt; 0.05? - Educational Leadership and Policy Studies","og_description":"By Jake Working Introduction&nbsp; You might have heard the recent rumblings in the statistics world: null hypothesis significance testing, statistical significance, p-values, our beloved p-value, have been coming into question. Well, the statistical soundness of these methods is not being doubted, but their current use and interpretations in applied research have been.&nbsp; How did we [&hellip;]","og_url":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/","og_site_name":"Educational Leadership and Policy Studies","article_published_time":"2024-06-01T11:00:00+00:00","og_image":[{"width":2240,"height":1260,"url":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2.jpg","type":"image\/jpeg"}],"author":"Jonah Hall","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jonah Hall","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/#article","isPartOf":{"@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/"},"author":{"name":"Jonah Hall","@id":"https:\/\/cehhs.utk.edu\/elps\/#\/schema\/person\/6bfd2c32cad7f6a411dfcf7e5dd65055"},"headline":"Wait, I Can&#8217;t Use p &lt; 0.05?","datePublished":"2024-06-01T11:00:00+00:00","mainEntityOfPage":{"@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/"},"wordCount":968,"image":{"@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/#primaryimage"},"thumbnailUrl":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2.jpg","articleSection":["Evaluation Methodology Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/","url":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/","name":"Wait, I Can't Use p &lt; 0.05? - Educational Leadership and Policy Studies","isPartOf":{"@id":"https:\/\/cehhs.utk.edu\/elps\/#website"},"primaryImageOfPage":{"@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/#primaryimage"},"image":{"@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/#primaryimage"},"thumbnailUrl":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2.jpg","datePublished":"2024-06-01T11:00:00+00:00","author":{"@id":"https:\/\/cehhs.utk.edu\/elps\/#\/schema\/person\/6bfd2c32cad7f6a411dfcf7e5dd65055"},"breadcrumb":{"@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/#primaryimage","url":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2.jpg","contentUrl":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2.jpg","width":2240,"height":1260},{"@type":"BreadcrumbList","@id":"https:\/\/cehhs.utk.edu\/elps\/wait-i-cant-use-p-0-05\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cehhs.utk.edu\/elps\/"},{"@type":"ListItem","position":2,"name":"Wait, I Can&#8217;t Use p &lt; 0.05?"}]},{"@type":"WebSite","@id":"https:\/\/cehhs.utk.edu\/elps\/#website","url":"https:\/\/cehhs.utk.edu\/elps\/","name":"Educational Leadership and Policy Studies","description":"University of Tennessee, Knoxville","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cehhs.utk.edu\/elps\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/cehhs.utk.edu\/elps\/#\/schema\/person\/6bfd2c32cad7f6a411dfcf7e5dd65055","name":"Jonah Hall","url":"https:\/\/cehhs.utk.edu\/elps\/author\/jhall152\/"}]}},"featured_image_src":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2-600x400.jpg","featured_image_src_square":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/05\/New-MAD-Blog-Design-Final-2-2-600x600.jpg","author_info":{"display_name":"Jonah Hall","author_link":"https:\/\/cehhs.utk.edu\/elps\/author\/jhall152\/"},"_links":{"self":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/posts\/23319","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/users\/86"}],"replies":[{"embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/comments?post=23319"}],"version-history":[{"count":0,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/posts\/23319\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/media\/23325"}],"wp:attachment":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/media?parent=23319"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/categories?post=23319"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/tags?post=23319"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}