{"id":3397,"date":"2023-09-27T12:41:48","date_gmt":"2023-09-27T12:41:48","guid":{"rendered":"https:\/\/www.figpii.com\/blog\/?p=3397"},"modified":"2024-06-04T10:13:11","modified_gmt":"2024-06-04T10:13:11","slug":"misconceptions-about-statistical-significance","status":"publish","type":"post","link":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/","title":{"rendered":"Common Misconceptions About Statistical Significance"},"content":{"rendered":"<p class=\"c3\"><span class=\"c1\">You&#8217;re swiping through a dating app, and you come across someone who looks like they&#8217;ve just stepped out of a magazine cover. You swipe right, and boom! It&#8217;s a match. You meet for coffee, only to discover you have little else in common. Just like in dating, relying on a single factor can be misleading.<\/span><\/p><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_74 ez-toc-wrap-left counter-hierarchy ez-toc-counter ez-toc-transparent ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#What_is_Statistical_Significance\" >What is Statistical Significance?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Common_Misconceptions_About_Statistical_Significance\" >Common Misconceptions About Statistical Significance<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Statistical_Significance_Guarantees_Success\" >Statistical Significance Guarantees Success<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Statistical_Significance_Implies_Causation\" >Statistical Significance Implies Causation<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Statistical_Significance_Equals_Practical_Significance\" >Statistical Significance Equals Practical Significance<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#A_Non-Significant_Result_Proves_Theres_No_Effect\" >A Non-Significant Result Proves There&#8217;s No Effect<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Statistical_Significance_Is_a_Binary_YesNo_Decision\" >Statistical Significance Is a Binary Yes\/No Decision<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Statistical_Significance_Doesnt_Change_with_Sample_Size\" >Statistical Significance Doesn&#8217;t Change with Sample Size<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Statistical_Significance_Eliminates_Bias\" >Statistical Significance Eliminates Bias<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Avoiding_Pitfalls_When_It_Comes_To_Statistical_Significance\" >Avoiding Pitfalls When It Comes To Statistical Significance<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Define_Clear_Objectives\" >Define Clear Objectives<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Choose_the_Right_Significance_Level\" >Choose the Right Significance Level<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Prioritize_Effect_Size\" >Prioritize Effect Size<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Understand_Statistical_Power\" >Understand Statistical Power<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Avoid_P-Hacking\" >Avoid P-Hacking<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Use_Confidence_Intervals\" >Use Confidence Intervals<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Replicate_and_Validate\" >Replicate and Validate<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Consider_External_Factors\" >Consider External Factors<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-19\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#Conclusion\" >Conclusion<\/a><\/li><\/ul><\/nav><\/div>\n\n<p class=\"c3\">In\u00a0<span class=\"c8\"><a class=\"c7\" href=\"https:\/\/www.figpii.com\/blog\/how-to-setup-and-run-an-a-b-test-a-step-by-step-guide\/\">A\/B testing<\/a><\/span><span class=\"c1\">, that single factor is often statistical significance\u2014a term many people use but don&#8217;t fully understand. It&#8217;s not just a buzzword; it&#8217;s a crucial metric that can guide important business decisions.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">In this article, we will debunk some common misconceptions about statistical significance, especially in A\/B testing.<\/span><\/p>\n<h2 id=\"h.l5bk61iir1xq\" class=\"c10\"><span class=\"ez-toc-section\" id=\"What_is_Statistical_Significance\"><\/span><span class=\"c9\">What is Statistical Significance?<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c3\"><span class=\"c1\">Before diving into the common misconceptions, it&#8217;s crucial to understand what statistical significance means.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">In the context of A\/B testing, statistical significance is a measure that indicates whether the difference in performance between two versions (A and B) is not due to random chance.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">It provides a level of confidence in the results, often expressed through a p-value, which is a probability that helps you determine the reliability of your findings.<\/span><\/p>\n<p class=\"c3\">In simpler terms, achieving statistical significance in an A\/B test means that you can be reasonably confident that the observed effect\u2014such as an increase in\u00a0<span class=\"c8\"><a class=\"c7\" href=\"https:\/\/www.figpii.com\/blog\/what-is-a-good-click-through-rate\/\">click-through rates<\/a><\/span><span class=\"c1\">\u00a0or user engagement\u2014is a real outcome, not just a fluke.<\/span><\/p>\n<h2 id=\"h.92kjp3gl8mrk\" class=\"c10\"><span class=\"ez-toc-section\" id=\"Common_Misconceptions_About_Statistical_Significance\"><\/span><span class=\"c9\">Common Misconceptions About Statistical Significance<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c3\"><span class=\"c1\">Statistical significance is like the first checkpoint in your A\/B testing journey. It&#8217;s the initial green light that says, &#8220;Hey, this change might be worth something!&#8221; But\u2014and it&#8217;s a big but\u2014it&#8217;s not the end of the road.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Statistical significance is crucial but not conclusive, and that&#8217;s why we&#8217;re diving into some common misconceptions next to give you a fuller picture of this complex relationship.<\/span><\/p>\n<ol class=\"c2 lst-kix_e05mr0qg1mlk-0 start\" start=\"1\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.g8tffffuq8ml\"><span class=\"ez-toc-section\" id=\"Statistical_Significance_Guarantees_Success\"><\/span><span class=\"c4\">Statistical Significance Guarantees Success<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">A statistically significant result is not a golden ticket to success. It&#8217;s more like a backstage pass\u2014it gets you closer to the action, but it doesn&#8217;t guarantee a great show.<\/span><\/p>\n<p class=\"c3\">Statistical significance tells you that the change you made in your A\/B test likely wasn&#8217;t due to random chance. But here&#8217;s what it doesn&#8217;t tell you: whether that change will improve user experience,\u00a0<span class=\"c8\"><a class=\"c7\" href=\"https:\/\/www.figpii.com\/blog\/11-tips-to-increase-your-ecommerce-stores-conversion-rate\/\">boost conversion rates<\/a><\/span><span class=\"c1\">, or impact your business metrics.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">For instance, you might find that a new website color scheme is statistically significant in increasing click-through rates. But what if those clicks don&#8217;t translate into sales? Or worse, what if the new color scheme annoys users and they leave negative reviews?<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">So, before you celebrate, remember that statistical significance is just one piece of the puzzle. It&#8217;s a good start, but it&#8217;s not the finish line.<\/span><\/p>\n<ol class=\"c2 lst-kix_e05mr0qg1mlk-0\" start=\"2\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.fph7zj96dur3\"><span class=\"ez-toc-section\" id=\"Statistical_Significance_Implies_Causation\"><\/span><span class=\"c4\">Statistical Significance Implies Causation<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">The age-old confusion between correlation and causation. It&#8217;s like thinking eating ice cream causes sunburns just because both happen more frequently in the summer. Sure, the numbers line up, but let&#8217;s not jump to conclusions!<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">In A\/B testing, it&#8217;s easy to believe that a statistically significant result automatically implies a cause-and-effect relationship. You see a low p-value and think, &#8220;Yes! Changing the call-to-action button to green caused more clicks!&#8221; But hold on, Sherlock, you might be solving the wrong mystery.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Statistical significance can tell you that there&#8217;s a relationship between two variables, but it doesn&#8217;t tell you the nature of that relationship. For all you know, the increase in clicks could be due to a completely different factor that coincided with your test.<\/span><\/p>\n<ol class=\"c2 lst-kix_e05mr0qg1mlk-0\" start=\"3\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.8eb35bpixq3d\"><span class=\"ez-toc-section\" id=\"Statistical_Significance_Equals_Practical_Significance\"><\/span><span class=\"c4\">Statistical Significance Equals Practical Significance<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">Picture this: You find a $1 bill on the street. Statistically significant? Sure, it&#8217;s a 100% increase in your street-found income. Practically significant? Well, unless you&#8217;re living in a world where $1 can buy you a mansion, probably not.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">The belief that statistical significance automatically translates to practical significance is like thinking you&#8217;re ready for the Olympics because you won a three-legged race at a family picnic. The two just aren&#8217;t the same.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">In A\/B testing, you might find that changing your website&#8217;s font size led to a statistically significant increase in time spent on the page. Great, right? But did that extra time spent lead to more sales, higher user engagement, or any other metric that genuinely matters to your business?<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">The key takeaway here is to always consider the magnitude of the effect. A tiny, statistically significant change may not be worth the time and resources to implement.<\/span><\/p>\n<ol class=\"c2 lst-kix_e05mr0qg1mlk-0\" start=\"4\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.ls7bueac0zjl\"><span class=\"ez-toc-section\" id=\"A_Non-Significant_Result_Proves_Theres_No_Effect\"><\/span><span class=\"c4\">A Non-Significant Result Proves There&#8217;s No Effect<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">Going on a date and not feeling an instant spark does not mean there&#8217;s zero chemistry. It could be that you&#8217;re both nervous and need more time to get to know each other.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Similarly, a non-significant result in an A\/B test is not definitive proof that your new feature or strategy has no effect. It may mean that you haven&#8217;t collected enough data or the effect is too small to detect with your current sample size.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">If you&#8217;re quick to dismiss a non-significant result, you might miss out on something that could become significant with a larger sample size or a more refined testing approach.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Also, context matters. Maybe your test was conducted during a holiday season when user behavior is atypical, or an external event temporarily skewed your results.<\/span><\/p>\n<ol class=\"c2 lst-kix_e05mr0qg1mlk-0\" start=\"5\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.uhvgrwhz3dzz\"><span class=\"ez-toc-section\" id=\"Statistical_Significance_Is_a_Binary_YesNo_Decision\"><\/span><span class=\"c4\">Statistical Significance Is a Binary Yes\/No Decision<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">Wouldn&#8217;t it be nice if complex business questions could be answered with a simple yes or no? Like, &#8220;Will this new CTA increase our click-through rates?&#8221; Unfortunately, statistical significance doesn&#8217;t offer that kind of black-and-white clarity.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Many people treat statistical significance as a light switch\u2014either on (yes, significant!) or off (no, not significant!). But in reality, it&#8217;s more like a dimmer switch with varying degrees of brightness.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Statistical significance is often determined by a p-value, usually set at the threshold of 0.05. But here&#8217;s the thing: A p-value of 0.049 doesn&#8217;t mean you&#8217;ve struck gold, and a p-value of 0.051 doesn&#8217;t mean you&#8217;re doomed. It&#8217;s more like a spectrum that represents the degree of confidence you can have in your results.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Moreover, statistical significance should be considered alongside practical significance. Just because a result is statistically significant doesn&#8217;t mean it&#8217;s practically meaningful. Sometimes, a result that&#8217;s not statistically significant could still have practical implications.<\/span><\/p>\n<ol class=\"c2 lst-kix_e05mr0qg1mlk-0\" start=\"6\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.b98a0ba13riu\"><span class=\"ez-toc-section\" id=\"Statistical_Significance_Doesnt_Change_with_Sample_Size\"><\/span><span class=\"c4\">Statistical Significance Doesn&#8217;t Change with Sample Size<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">A common misconception is that the sample size becomes irrelevant once statistical significance is achieved. This is incorrect.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">The sample size is essential in determining the reliability and validity of your A\/B test results.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">A larger sample size increases the likelihood of detecting smaller effects as statistically significant. However, it&#8217;s essential to note that even if an effect with a large sample size is statistically significant, it may be irrelevant to your business objectives.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Conversely, a small sample size may not provide enough data to detect an effect that could be significant, leading to a Type II error, where you fail to observe an effect that is present.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Sample size also affects the statistical power of your test, which is the ability to detect an effect if one exists. A larger sample size generally increases statistical power, making your results more reliable.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">However, it&#8217;s crucial to balance the need for statistical power with the resources required for data collection and analysis.<\/span><\/p>\n<ol class=\"c2 lst-kix_e05mr0qg1mlk-0\" start=\"7\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.h4xkm5jezdqy\"><span class=\"ez-toc-section\" id=\"Statistical_Significance_Eliminates_Bias\"><\/span><span class=\"c4\">Statistical Significance Eliminates Bias<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">Another misconception is the belief that achieving statistical significance in an A\/B test automatically eliminates bias. While statistical significance can provide a level of confidence in your results, it does not account for biases that may have been present in the test design or data collection process.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">For example, selection bias can occur if the sample groups in your A\/B test are not truly random. This can skew the results and lead to incorrect conclusions. Similarly, measurement bias can affect the validity of your findings. If the tools or methods used to collect data are flawed, even a statistically significant result can be misleading.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Therefore, achieving statistical significance is not a guarantee against bias. Proper experimental design, including randomization and control for confounding variables, is essential for minimizing bias in A\/B testing.<\/span><\/p>\n<h2 id=\"h.bq22r6amwzl1\" class=\"c10\"><span class=\"ez-toc-section\" id=\"Avoiding_Pitfalls_When_It_Comes_To_Statistical_Significance\"><\/span><span class=\"c9\">Avoiding Pitfalls When It Comes To Statistical Significance<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c3\"><span class=\"c1\">Having addressed common misconceptions about statistical significance, it&#8217;s crucial to focus on how to avoid these pitfalls in your A\/B testing efforts.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">This section will provide practical guidelines to ensure that your statistical significance interpretation is accurate and relevant to your business objectives.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0 start\" start=\"1\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.qovkinhhuw68\"><span class=\"ez-toc-section\" id=\"Define_Clear_Objectives\"><\/span><span class=\"c4\">Define Clear Objectives<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">The first step in avoiding pitfalls related to statistical significance is to define clear objectives for your A\/B test. Without a well-articulated goal, you risk misinterpreting the results or drawing conclusions that do not align with your business needs.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">For example, instead of a vague goal like &#8220;increase user engagement,&#8221; aim for something more specific, such as &#8220;increase the click-through rate on the &#8216;Sign Up&#8217; button by 15% within 30 days.&#8221;<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">By setting clear objectives, you establish a framework for interpreting your results. This lets you focus on metrics directly related to your goals and helps you differentiate between statistical and practical significance.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0\" start=\"2\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.psouox5nk2ae\"><span class=\"ez-toc-section\" id=\"Choose_the_Right_Significance_Level\"><\/span><span class=\"c4\">Choose the Right Significance Level<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">Selecting the appropriate significance level is another critical aspect of avoiding pitfalls in interpreting statistical significance. The significance level, often denoted by alpha (\u03b1), is the probability of rejecting the null hypothesis when it is true. Commonly set at 0.05, this threshold is not a one-size-fits-all criterion.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">The choice of significance level should be tailored to the specific context and objectives of your A\/B test. For example, if the cost of making a Type I error (false positive) is high\u2014such as implementing a costly new feature that turns out to be ineffective\u2014you may opt for a lower significance level like 0.01 to minimize this risk.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">It&#8217;s essential to consider the trade-offs involved in setting your significance level. A lower alpha reduces the risk of false positives but increases the chance of false negatives, and vice versa.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Therefore, your chosen significance level should align with your business objectives and the potential risks and rewards associated with the test.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0\" start=\"3\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.jy8vw87mywve\"><span class=\"ez-toc-section\" id=\"Prioritize_Effect_Size\"><\/span><span class=\"c4\">Prioritize Effect Size<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">Another essential factor to consider in your A\/B testing is the effect size, which measures the magnitude of the difference between groups. While statistical significance can indicate whether an effect exists, it does not provide information on the size or practical importance of that effect.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Focusing solely on p-values(statistical significance) can be misleading. For instance, even trivial differences can become statistically significant with a large enough sample size. However, these may not translate into meaningful changes that align with your business objectives.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">To avoid this pitfall, you must prioritize effect size alongside statistical significance. Incorporating effect size into your analysis also aids in determining the required sample size for achieving adequate statistical power, thereby increasing the reliability and validity of your A\/B test.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0\" start=\"4\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.g29mstj9hfw8\"><span class=\"ez-toc-section\" id=\"Understand_Statistical_Power\"><\/span><span class=\"c4\">Understand Statistical Power<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">Statistical power, or the ability of a test to detect an effect if one exists, is a crucial but often overlooked aspect of A\/B testing.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">A test with low statistical power increases the risk of committing a Type II error, where you fail to detect a real effect. This could lead to missed opportunities and incorrect conclusions about the efficacy of a change or feature.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Understanding statistical power involves considering your test&#8217;s sample size, effect size, and significance level. A larger sample size and a larger effect size generally increase the power, making it more likely that you will correctly reject a false null hypothesis.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">It&#8217;s essential to conduct a power analysis during the planning stage of your A\/B test to determine the required sample size for achieving adequate power.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0\" start=\"5\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.9ylmmwd64d7v\"><span class=\"ez-toc-section\" id=\"Avoid_P-Hacking\"><\/span><span class=\"c4\">Avoid P-Hacking<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">P-hacking, or the practice of manipulating your data or testing process to achieve statistical significance, is a serious issue that undermines the integrity of your A\/B test results.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">This can involve multiple comparisons, stopping the test once significance is achieved, or excluding specific data points to influence the outcome.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">P-hacking compromises the validity of your findings and can result in poor decision-making that negatively impacts your business objectives.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">If your results are not statistically significant, conducting a follow-up test or reevaluating your objectives is better than manipulating the data to achieve significance.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0\" start=\"6\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.yt1xmtqzgnbz\"><span class=\"ez-toc-section\" id=\"Use_Confidence_Intervals\"><\/span><span class=\"c4\">Use Confidence Intervals<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\">While p-values and significance levels are commonly used in A\/B testing, they don&#8217;t provide a complete picture of your results. This is where\u00a0<span class=\"c8\"><a class=\"c7\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\">confidence intervals<\/a><\/span><span class=\"c1\">\u00a0come into play.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">A confidence interval gives an estimated range of values within which the true population parameter will likely fall, offering a fuller understanding of the uncertainty associated with your test results.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Confidence intervals also allow you to assess the practical significance of your findings. If the confidence interval for the difference between the two groups includes zero, this suggests that the effect may not be practically meaningful, even if it is statistically significant.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0\" start=\"7\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.clswzor596w4\"><span class=\"ez-toc-section\" id=\"Replicate_and_Validate\"><\/span><span class=\"c4\">Replicate and Validate<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">One of the best ways to ensure the reliability of your A\/B test results is through replication and validation. A single test, no matter how well-designed, provides only a snapshot of performance under specific conditions.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Replicating the test can confirm the consistency of the results, increasing your confidence in their validity. Validation involves conducting similar but independent tests to corroborate your findings.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">For example, if an initial A\/B test shows that a new website layout increases user engagement, a follow-up test could examine whether these results hold true across different user demographics or during different seasons.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Replicating and validating your A\/B tests is a quality check, ensuring your results are reliable and generalizable.<\/span><\/p>\n<ol class=\"c2 lst-kix_wpngt9y1zths-0\" start=\"8\">\n<li class=\"c6 li-bullet-0\">\n<h3 id=\"h.z1omwhexj9e\"><span class=\"ez-toc-section\" id=\"Consider_External_Factors\"><\/span><span class=\"c4\">Consider External Factors<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c3\"><span class=\"c1\">The last but certainly not least point to consider is the influence of external factors on your A\/B test results. While statistical significance can provide valuable insights, it&#8217;s crucial to remember that your test doesn&#8217;t exist in a vacuum.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">External factors such as seasonality, market trends, and global events can impact user behavior and test outcomes.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">To account for these factors, conducting a contextual analysis alongside your A\/B test is advisable. This involves examining any external variables that could affect your results and, if possible, adjusting for them in your analysis.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">It&#8217;s also beneficial to run your test over different time frames or conditions to assess the robustness of your findings.<\/span><\/p>\n<h2 id=\"h.fz7u12834e5k\" class=\"c10\"><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span><span class=\"c9\">Conclusion<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c3\"><span class=\"c1\">Navigating the complexities of statistical significance in A\/B testing can be challenging, but it&#8217;s crucial for making informed decisions that align with your business objectives. Understanding common misconceptions and how to avoid them sets the stage for more reliable, valid, and actionable insights.<\/span><\/p>\n<p class=\"c3\"><span class=\"c1\">Remember, statistical significance is not a standalone metric but part of a broader analytical framework that includes clear objectives, appropriate significance levels, effect sizes, statistical power, and consideration of external factors.<\/span><\/p>\n<p class=\"c3\">So, the next time you&#8217;re faced with\u00a0<span class=\"c8\"><a class=\"c7\" href=\"https:\/\/www.figpii.com\/blog\/analyzing-ab-testing-results\/\">interpreting A\/B test results<\/a><\/span><span class=\"c1\">, take a holistic approach and consider all the elements that contribute to a robust analysis.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>You&#8217;re swiping through a dating app, and you come across someone who looks like they&#8217;ve just stepped out of a magazine cover. You swipe right, and boom! It&#8217;s a match. You meet for coffee, only to discover you have little else in common. Just like in dating, relying on a single factor can be misleading.<\/p>\n","protected":false},"author":9,"featured_media":3405,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_eb_attr":"","footnotes":""},"categories":[576],"tags":[],"class_list":{"0":"post-3397","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-cro"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Common Misconceptions About Statistical Significance - FigPii blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Common Misconceptions About Statistical Significance - FigPii blog\" \/>\n<meta property=\"og:description\" content=\"You&#8217;re swiping through a dating app, and you come across someone who looks like they&#8217;ve just stepped out of a magazine cover. You swipe right, and boom! It&#8217;s a match. You meet for coffee, only to discover you have little else in common. Just like in dating, relying on a single factor can be misleading.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/\" \/>\n<meta property=\"og:site_name\" content=\"FigPii blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/figpii.aii\/\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-27T12:41:48+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-06-04T10:13:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1703\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Usman Adepoju\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@figpii\" \/>\n<meta name=\"twitter:site\" content=\"@figpii\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Usman Adepoju\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"12 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/\"},\"author\":{\"name\":\"Usman Adepoju\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec\"},\"headline\":\"Common Misconceptions About Statistical Significance\",\"datePublished\":\"2023-09-27T12:41:48+00:00\",\"dateModified\":\"2024-06-04T10:13:11+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/\"},\"wordCount\":2511,\"publisher\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg\",\"articleSection\":[\"Conversion Rate Optimization (CRO)\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/\",\"url\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/\",\"name\":\"Common Misconceptions About Statistical Significance - FigPii blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg\",\"datePublished\":\"2023-09-27T12:41:48+00:00\",\"dateModified\":\"2024-06-04T10:13:11+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage\",\"url\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg\",\"contentUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg\",\"width\":2560,\"height\":1703},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.figpii.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Common Misconceptions About Statistical Significance\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#website\",\"url\":\"https:\/\/www.figpii.com\/blog\/\",\"name\":\"FigPii blog\",\"description\":\"Let it marinate\",\"publisher\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.figpii.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#organization\",\"name\":\"FigPii\",\"url\":\"https:\/\/www.figpii.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png\",\"contentUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png\",\"width\":104,\"height\":40,\"caption\":\"FigPii\"},\"image\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/figpii.aii\/\",\"https:\/\/x.com\/figpii\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec\",\"name\":\"Usman Adepoju\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g\",\"caption\":\"Usman Adepoju\"},\"url\":\"https:\/\/www.figpii.com\/blog\/author\/usman\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Common Misconceptions About Statistical Significance - FigPii blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/","og_locale":"en_US","og_type":"article","og_title":"Common Misconceptions About Statistical Significance - FigPii blog","og_description":"You&#8217;re swiping through a dating app, and you come across someone who looks like they&#8217;ve just stepped out of a magazine cover. You swipe right, and boom! It&#8217;s a match. You meet for coffee, only to discover you have little else in common. Just like in dating, relying on a single factor can be misleading.","og_url":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/","og_site_name":"FigPii blog","article_publisher":"https:\/\/www.facebook.com\/figpii.aii\/","article_published_time":"2023-09-27T12:41:48+00:00","article_modified_time":"2024-06-04T10:13:11+00:00","og_image":[{"width":2560,"height":1703,"url":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg","type":"image\/jpeg"}],"author":"Usman Adepoju","twitter_card":"summary_large_image","twitter_creator":"@figpii","twitter_site":"@figpii","twitter_misc":{"Written by":"Usman Adepoju","Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#article","isPartOf":{"@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/"},"author":{"name":"Usman Adepoju","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec"},"headline":"Common Misconceptions About Statistical Significance","datePublished":"2023-09-27T12:41:48+00:00","dateModified":"2024-06-04T10:13:11+00:00","mainEntityOfPage":{"@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/"},"wordCount":2511,"publisher":{"@id":"https:\/\/www.figpii.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage"},"thumbnailUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg","articleSection":["Conversion Rate Optimization (CRO)"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/","url":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/","name":"Common Misconceptions About Statistical Significance - FigPii blog","isPartOf":{"@id":"https:\/\/www.figpii.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage"},"image":{"@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage"},"thumbnailUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg","datePublished":"2023-09-27T12:41:48+00:00","dateModified":"2024-06-04T10:13:11+00:00","breadcrumb":{"@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#primaryimage","url":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg","contentUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/edge2edge-media-uKlneQRwaxY-unsplash-scaled.jpg","width":2560,"height":1703},{"@type":"BreadcrumbList","@id":"https:\/\/www.figpii.com\/blog\/misconceptions-about-statistical-significance\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.figpii.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Common Misconceptions About Statistical Significance"}]},{"@type":"WebSite","@id":"https:\/\/www.figpii.com\/blog\/#website","url":"https:\/\/www.figpii.com\/blog\/","name":"FigPii blog","description":"Let it marinate","publisher":{"@id":"https:\/\/www.figpii.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.figpii.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.figpii.com\/blog\/#organization","name":"FigPii","url":"https:\/\/www.figpii.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png","contentUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png","width":104,"height":40,"caption":"FigPii"},"image":{"@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/figpii.aii\/","https:\/\/x.com\/figpii"]},{"@type":"Person","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec","name":"Usman Adepoju","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g","caption":"Usman Adepoju"},"url":"https:\/\/www.figpii.com\/blog\/author\/usman\/"}]}},"_links":{"self":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts\/3397","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/comments?post=3397"}],"version-history":[{"count":5,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts\/3397\/revisions"}],"predecessor-version":[{"id":4479,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts\/3397\/revisions\/4479"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/media\/3405"}],"wp:attachment":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/media?parent=3397"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/categories?post=3397"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/tags?post=3397"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}