{"id":3363,"date":"2023-09-20T00:00:53","date_gmt":"2023-09-20T00:00:53","guid":{"rendered":"https:\/\/www.figpii.com\/blog\/?p=3363"},"modified":"2025-02-10T22:32:01","modified_gmt":"2025-02-10T22:32:01","slug":"understanding-confidence-intervals-and-their-importance","status":"publish","type":"post","link":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/","title":{"rendered":"Understanding Confidence Intervals and their Importance."},"content":{"rendered":"<p class=\"c9\"><span class=\"c4 c3\">Confidence intervals, often abbreviated as CIs, are essential statistical tools used to quantify the uncertainty associated with a sample statistic, such as a mean or proportion, and provide a range within which the true population parameter will likely fall.<\/span><\/p><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_74 ez-toc-wrap-left counter-hierarchy ez-toc-counter ez-toc-transparent ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#The_Significance_of_Confidence_Intervals_in_CRO_AB_Testing\" >The Significance of Confidence Intervals in CRO (A\/B Testing)<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Optimization_of_Resource_Allocation\" >Optimization of Resource Allocation<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Mitigation_of_False_PositivesNegatives\" >Mitigation of False Positives\/Negatives<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Avoidance_of_Premature_Decisions\" >Avoidance of Premature Decisions<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Quantifying_Uncertainty\" >Quantifying Uncertainty<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Confidence_in_Results_Validity\" >Confidence in Results Validity<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#How_do_confidence_intervals_help_in_interpreting_AB_testing_results\" >How do confidence intervals help in interpreting A\/B testing results?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Quantifying_the_Magnitude_of_Change\" >Quantifying the Magnitude of Change<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Distinguishing_Significance_from_Noise\" >Distinguishing Significance from Noise<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Avoiding_Premature_Celebrations_or_Panic\" >Avoiding Premature Celebrations (or Panic)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Understanding_Statistical_Significance\" >Understanding Statistical Significance<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Communicating_Results_Effectively\" >Communicating Results Effectively<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#What_are_the_pitfalls_of_not_using_confidence_intervals_in_AB_Testing\" >What are the pitfalls of not using confidence intervals in A\/B Testing<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Missed_Opportunities_for_Iteration\" >Missed Opportunities for Iteration<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Loss_of_Credibility\" >Loss of Credibility<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Ineffective_Resource_Allocation\" >Ineffective Resource Allocation<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Failure_to_Identify_Valuable_Changes\" >Failure to Identify Valuable Changes<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Risky_Decision-Making\" >Risky Decision-Making<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-19\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Misinterpretation_of_Noise_as_Signals\" >Misinterpretation of Noise as Signals<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-20\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#How_to_Calculate_Confidence_Intervals\" >How to Calculate Confidence Intervals<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-21\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Confidence_Level_and_Significance_Level_in_Confidence_Intervals\" >Confidence Level and Significance Level in Confidence Intervals<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-22\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#How_to_calculate_confidence_intervals\" >How to calculate confidence intervals<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-23\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_1_Data_Collection\" >Step 1: Data Collection<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-24\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_2_Choosing_a_Confidence_Level\" >Step 2: Choosing a Confidence Level<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-25\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_3_Calculate_the_Sample_Mean_x%CC%84\" >Step 3: Calculate the Sample Mean (x\u0304)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-26\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_4_Determine_the_Standard_Deviation\" >Step 4: Determine the Standard Deviation<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-27\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_5_Find_the_Standard_Error\" >Step 5: Find the Standard Error<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-28\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_6_Calculate_the_Z-Score_or_T-Score\" >Step 6: Calculate the Z-Score (or T-Score)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-29\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_7_Calculate_the_Margin_of_Error\" >Step 7: Calculate the Margin of Error<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-30\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_8_Calculate_the_Lower_and_Upper_Bounds\" >Step 8: Calculate the Lower and Upper Bounds<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-31\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Step_9_Apply_Results_in_the_CI_Formula\" >Step 9: Apply Results in the CI Formula<\/a><\/li><\/ul><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-32\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Interpreting_Confidence_Intervals\" >Interpreting Confidence Intervals<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-33\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#When_a_CI_includes_the_Null_Hypothesis\" >When a CI includes the Null Hypothesis<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-34\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Drawing_Conclusions_from_CI_results\" >Drawing Conclusions from CI results<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-35\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Challenges_associated_with_confidence_intervals\" >Challenges associated with confidence intervals<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-36\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Sample_Size_Limitations\" >Sample Size Limitations<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-37\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Multiple_Testing\" >Multiple Testing<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-38\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Extended_Duration_of_Testing\" >Extended Duration of Testing<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-39\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Seasonal_Variations\" >Seasonal Variations<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-40\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Segmentation_Complexity\" >Segmentation Complexity<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-41\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Interpretation_Complexity\" >Interpretation Complexity<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-42\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#Conclusion\" >Conclusion<\/a><\/li><\/ul><\/nav><\/div>\n\n<p class=\"c9\"><span class=\"c4 c3\">In simpler terms, they offer a degree of certainty about the reliability of an estimate derived from a sample of data.<\/span><\/p>\n<p class=\"c9\"><span class=\"c4 c3\">In practical terms, a confidence interval consists of two main components: a point estimate, which represents the sample statistic calculated from your data (e.g., the average conversion rate of visitors to a website), and a margin of error that defines a range around this estimate.<\/span><\/p>\n<p class=\"c9\"><span class=\"c4 c3\">Here&#8217;s a breakdown of the key elements of a confidence interval:<\/span><\/p>\n<ol class=\"c13 lst-kix_oeuo8h7erz26-0 start\" start=\"1\">\n<li class=\"c1 c18 li-bullet-0\"><strong><span class=\"c16\">Point Estimate<\/span><\/strong><span class=\"c4 c3\">: This is the calculated value you&#8217;re interested in estimating, such as the mean or proportion. For instance, if you want to know the average time visitors spend on your website, the point estimate would be the average based on the data collected.<\/span><\/li>\n<\/ol>\n<ol class=\"c13 lst-kix_oeuo8h7erz26-0\" start=\"2\">\n<li class=\"c1 c18 li-bullet-0\"><strong><span class=\"c16\">Margin of Error<\/span><\/strong><span class=\"c4 c3\">: The margin of error (MOE) is a measure of the uncertainty or variability in your estimate. The margin of error is like a safety net for your estimate. It measures how much your best guess (the point estimate) might be off by. The wider the confidence interval, the greater the uncertainty.<\/span><\/li>\n<\/ol>\n<p class=\"c9\"><span class=\"c4 c3\">For instance, if you estimate that the average time visitors spend on your website is 60 seconds and your MOE is \u00b15 seconds with 95% confidence, you&#8217;re pretty sure that the actual average time falls between 55 and 65 seconds.<\/span><\/p>\n<p class=\"c9\"><span class=\"c4 c3\">The bigger the MOE, the less confident you are about the exact number. So, smaller MOEs mean more precise estimates.<\/span><\/p>\n<p class=\"c9\"><span class=\"c3\">In\u00a0<\/span><span class=\"c2\"><a class=\"c19\" href=\"https:\/\/www.figpii.com\/blog\/what-are-the-steps-of-conversion-rate-optimization\/\">Conversion Rate Optimization<\/a><\/span><span class=\"c3\">\u00a0and\u00a0<\/span><span class=\"c2\"><a class=\"c19\" href=\"https:\/\/www.figpii.com\/blog\/how-to-do-ab-testing\/\">A\/B testing\u00a0<\/a><\/span><span class=\"c4 c3\">context, confidence intervals provide critical insights into the reliability of test results, helping you make https:\/\/www.figpii.com\/blog\/how-to-do-ab-testing\/informed decisions about website changes and the impact of those changes on user behavior.<\/span><\/p>\n<h2 id=\"h.pnpstqx3mjd5\" class=\"c14\"><span class=\"ez-toc-section\" id=\"The_Significance_of_Confidence_Intervals_in_CRO_AB_Testing\"><\/span><span class=\"c6 c3\">The Significance of Confidence Intervals in CRO (A\/B Testing)<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c9\"><span class=\"c3 c4\">Confidence intervals are the unsung heroes of A\/B testing within Conversion Rate Optimization (CRO). They play a pivotal role in decision-making and help optimize resource allocation, mitigate the risk of false positives and negatives, and ensure the validity of results.<\/span><\/p>\n<ol class=\"c13 lst-kix_uha5z8r965af-0 start\" start=\"1\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.bs2l62lh1ccx\"><span class=\"ez-toc-section\" id=\"Optimization_of_Resource_Allocation\"><\/span><span class=\"c0\">Optimization of Resource Allocation<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">In digital marketing, allocating resources wisely is paramount. Confidence intervals guide this allocation by indicating which variations in A\/B testing are statistically significant. This prevents wasted time and resources on changes that don&#8217;t yield meaningful improvements.<\/span><\/p>\n<ol class=\"c13 lst-kix_uha5z8r965af-0\" start=\"2\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.86mn2rpn4kzc\"><span class=\"ez-toc-section\" id=\"Mitigation_of_False_PositivesNegatives\"><\/span><span class=\"c0\">Mitigation of False Positives\/Negatives<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">Without confidence intervals, it&#8217;s easy to jump to conclusions prematurely. These intervals act as reality checks, helping you avoid false positives (thinking changes work when they don&#8217;t) and false negatives (thinking changes don&#8217;t work when they do). They provide a balanced perspective on the impact of changes.<\/span><\/p>\n<ol class=\"c13 lst-kix_uha5z8r965af-0\" start=\"3\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.a9gf0jmu3a5p\"><span class=\"ez-toc-section\" id=\"Avoidance_of_Premature_Decisions\"><\/span><span class=\"c0\">Avoidance of Premature Decisions<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">Impulsivity can be the enemy of data-driven decision-making. Confidence intervals promote a more systematic approach. They encourage patience by illustrating the level of uncertainty in your A\/B test results. Instead of hastily implementing changes that may or may not work, you can make informed decisions based on a solid understanding of the data.<\/span><\/p>\n<ol class=\"c13 lst-kix_uha5z8r965af-0\" start=\"4\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.qsp07k71gahd\"><span class=\"ez-toc-section\" id=\"Quantifying_Uncertainty\"><\/span><span class=\"c0\">Quantifying Uncertainty<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">Confidence intervals tell a story beyond the point estimate. They provide a range within which the true effect of changes is likely to lie. This quantification of uncertainty helps you understand the potential variability in outcomes and make decisions considering this uncertainty.<\/span><\/p>\n<ol class=\"c13 lst-kix_uha5z8r965af-0\" start=\"5\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.fh0pchetzgvi\"><span class=\"ez-toc-section\" id=\"Confidence_in_Results_Validity\"><\/span><span class=\"c0\">Confidence in Results Validity<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">C<\/span><span class=\"c3\">onfidence intervals reassure you that your A\/B test results are not just a product of random chance. When you see a significant difference between two variations, backed by a tight confidence interval, you can be confident that the observed effect is genuine and not a statistical fluke.<\/span><\/p>\n<h2 id=\"h.wgbdjht49vzr\" class=\"c14\"><span class=\"ez-toc-section\" id=\"How_do_confidence_intervals_help_in_interpreting_AB_testing_results\"><\/span><span class=\"c3 c6\">How do confidence intervals help in interpreting A\/B testing results?<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c9\"><span class=\"c2\"><a class=\"c19\" href=\"https:\/\/www.figpii.com\/blog\/analyzing-ab-testing-results\/\">Interpreting A\/B testing results<\/a><\/span><span class=\"c4 c3\"> is like deciphering a message from your website&#8217;s visitors. You&#8217;re seeking to understand whether the changes you&#8217;ve made (the variant B) have significantly improved compared to the original (the control A).<\/span><\/p>\n<p class=\"c9\"><span class=\"c4 c3\">This interpretation is where confidence intervals shine, as they act as your decoding key, providing insights into the meaning and reliability of your test results.<\/span><\/p>\n<ol class=\"c13 lst-kix_25id24qdim2p-0 start\" start=\"1\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.g02z127yc43e\"><span class=\"ez-toc-section\" id=\"Quantifying_the_Magnitude_of_Change\"><\/span><span class=\"c0\">Quantifying the Magnitude of Change<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Confidence intervals allow you to assess whether there&#8217;s a difference between the control and variant groups and the magnitude of that difference.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">In other words, they tell you how big or small the impact of your changes is likely to be. A narrow confidence interval suggests a precise estimate, indicating a substantial effect, while a wider interval signifies greater uncertainty and potentially a smaller effect.<\/span><\/p>\n<ol class=\"c13 lst-kix_25id24qdim2p-0\" start=\"2\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.5gnqico2ducq\"><span class=\"ez-toc-section\" id=\"Distinguishing_Significance_from_Noise\"><\/span><span class=\"c0\">Distinguishing Significance from Noise<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">A common pitfall in A\/B testing is mistaking random noise for a meaningful improvement. Without confidence intervals, you might see a slightly higher conversion rate in the variant and immediately conclude that it&#8217;s better.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">However, confidence intervals help you discern whether this difference is statistically significant or just a random fluctuation.<\/span><\/p>\n<ol class=\"c13 lst-kix_25id24qdim2p-0\" start=\"3\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.8rdl8u90lu18\"><span class=\"ez-toc-section\" id=\"Avoiding_Premature_Celebrations_or_Panic\"><\/span><span class=\"c0\">Avoiding Premature Celebrations (or Panic)<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Sometimes, when early results in A\/B testing appear favorable, there&#8217;s a rush to celebrate. Conversely, there might be panic if things don&#8217;t look great initially. Confidence intervals advocate for a more level-headed approach.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">They indicate how certain or uncertain you should be about the observed difference. Even if you see a lift in conversions, if the confidence interval is wide, it suggests you should exercise caution before making conclusions.<\/span><\/p>\n<ol class=\"c13 lst-kix_25id24qdim2p-0\" start=\"4\">\n<li class=\"c10 c17 li-bullet-0\">\n<h3 id=\"h.xxk2r3in9ks8\"><span class=\"ez-toc-section\" id=\"Understanding_Statistical_Significance\"><\/span><span class=\"c0\">Understanding Statistical Significance<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">The term &#8220;statistical significance&#8221; means that the observed difference between control and variant groups is unlikely to be due to random chance.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">Confidence intervals provide a direct way to understand this significance. It strongly indicates statistical significance if the confidence interval doesn&#8217;t overlap with zero (for positive effects) or excludes certain thresholds (e.g., a target conversion rate increase).<\/span><\/p>\n<ol class=\"c13 lst-kix_25id24qdim2p-0\" start=\"5\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.dgg4gi5ocm5g\"><span class=\"ez-toc-section\" id=\"Communicating_Results_Effectively\"><\/span><span class=\"c0\">Communicating Results Effectively<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">A\/B testing is rarely done in isolation; results are often communicated to stakeholders or team members.<\/span><\/p>\n<p class=\"c1\"><span class=\"c3\">Confidence intervals offer a clear and concise way to convey the reliability of your findings. You can confidently say, &#8220;We saw a 5% increase in conversions, with a 95% confidence interval of \u00b12%, which indicates a statistically significant improvement.&#8221;<\/span><\/p>\n<h2 id=\"h.7q4f13isx4f7\" class=\"c14\"><span class=\"ez-toc-section\" id=\"What_are_the_pitfalls_of_not_using_confidence_intervals_in_AB_Testing\"><\/span><span class=\"c6 c3\">What are the pitfalls of not using confidence intervals in A\/B Testing<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ol class=\"c13 lst-kix_5t4pm9p8pyw0-0 start\" start=\"1\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.neslxwqrrwkl\"><span class=\"ez-toc-section\" id=\"Missed_Opportunities_for_Iteration\"><\/span><span class=\"c0\">Missed Opportunities for Iteration<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">A\/B testing is often an iterative process. Confidence intervals help in assessing the impact of changes accurately. Without them, you might miss opportunities to refine and enhance your website gradually, resulting in missed conversion rate improvements over time.<\/span><\/p>\n<ol class=\"c13 lst-kix_5t4pm9p8pyw0-0\" start=\"2\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.eo8vqzh6qw0l\"><span class=\"ez-toc-section\" id=\"Loss_of_Credibility\"><\/span><span class=\"c0\">Loss of Credibility<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">When <a href=\"https:\/\/www.figpii.com\/blog\/analyzing-ab-testing-results\/\">A\/B test results<\/a> are communicated to stakeholders or clients, the absence of confidence intervals can lead to credibility issues. Decision-makers may question the validity of results, and trust in the optimization process can erode.<\/span><\/p>\n<ol class=\"c13 lst-kix_5t4pm9p8pyw0-0\" start=\"3\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.fo7f88kvabq1\"><span class=\"ez-toc-section\" id=\"Ineffective_Resource_Allocation\"><\/span><span class=\"c0\">Ineffective Resource Allocation<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Deciding where to allocate resources, such as development time or marketing budget, becomes easier with confidence intervals. Resources may be directed towards changes that lack statistical significance instead of focusing on improvements that could have a more substantial impact.<\/span><\/p>\n<ol class=\"c13 lst-kix_5t4pm9p8pyw0-0\" start=\"4\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.8fdnq8tky2bf\"><span class=\"ez-toc-section\" id=\"Failure_to_Identify_Valuable_Changes\"><\/span><span class=\"c0\">Failure to Identify Valuable Changes<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">A\/B testing is about identifying changes that genuinely improve user engagement or conversion rates. Without confidence intervals, there&#8217;s a risk of overlooking valuable modifications. Some changes might have a genuine impact but go unnoticed due to a lack of statistical rigor.<\/span><\/p>\n<ol class=\"c13 lst-kix_5t4pm9p8pyw0-0\" start=\"5\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.3x9t8v87tv3r\"><span class=\"ez-toc-section\" id=\"Risky_Decision-Making\"><\/span><span class=\"c0\">Risky Decision-Making<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">The absence of confidence intervals can lead to impulsive decisions. Marketers or CROs might implement changes based on initial positive results, only to realize later that these changes had no significant impact, resulting in wasted time and effort.<\/span><\/p>\n<ol class=\"c13 lst-kix_5t4pm9p8pyw0-0\" start=\"6\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.9qpkmj4g4l6o\"><span class=\"ez-toc-section\" id=\"Misinterpretation_of_Noise_as_Signals\"><\/span><span class=\"c0\">Misinterpretation of Noise as Signals<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Without confidence intervals, A\/B test results may be subject to misinterpretation. Small fluctuations in data can be mistaken for meaningful improvements or declines, leading to incorrect conclusions and potentially wasted resources on unwarranted changes.<\/span><\/p>\n<h2 id=\"h.iszi1wcd6tg8\" class=\"c14\"><span class=\"ez-toc-section\" id=\"How_to_Calculate_Confidence_Intervals\"><\/span><span class=\"c6 c3\">How to Calculate Confidence Intervals<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c9\"><span class=\"c4 c3\">The formula for calculating confidence intervals is:<\/span><\/p>\n<p class=\"c9\"><span class=\"c12 c16\">(CI) = \u00a0x\u0304\u00b1 Z(S \u00f7 \u221an)<\/span><\/p>\n<p class=\"c9\"><span class=\"c3\">Where:<\/span><\/p>\n<ul class=\"c13 lst-kix_td46ieyajvz9-0 start\">\n<li class=\"c1 c18 li-bullet-0\"><span class=\"c4 c3\">CI: Confidence Interval, the range within which the true population parameter is likely to fall.<\/span><\/li>\n<li class=\"c1 c18 li-bullet-0\"><span class=\"c4 c3\">X\u0304: Sample Mean, the average value calculated from your sample data.<\/span><\/li>\n<li class=\"c1 c18 li-bullet-0\"><span class=\"c4 c3\">Z: Z-Score, a critical value from the standard normal distribution, which corresponds to your chosen confidence level.<\/span><\/li>\n<li class=\"c1 c18 li-bullet-0\"><span class=\"c4 c3\">S: Sample Standard Deviation, a measure of how spread out your data is.<\/span><\/li>\n<li class=\"c1 c18 li-bullet-0\"><span class=\"c4 c3\">n: Sample Size, the number of data points in your sample.<\/span><\/li>\n<\/ul>\n<h3 id=\"h.lc3i562oiy3n\" class=\"c22\"><span class=\"ez-toc-section\" id=\"Confidence_Level_and_Significance_Level_in_Confidence_Intervals\"><\/span><span class=\"c0\">Confidence Level and Significance Level in Confidence Intervals<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p class=\"c9\"><span class=\"c4 c3\">When calculating confidence intervals, the significance level (often denoted as \u03b1) and the confidence level are important concepts to note.<\/span><\/p>\n<ol class=\"c13 lst-kix_ang1fdsfht57-0 start\" start=\"1\">\n<li class=\"c1 c18 li-bullet-0\"><span class=\"c16\">Significance Level (\u03b1)<\/span><span class=\"c3\">: This is the probability of making a Type I error, which is the chance of wrongly concluding that there is a significant difference when there isn&#8217;t one. Standard significance levels are <\/span><span class=\"c16\">0.05<\/span><span class=\"c3\">\u00a0(<\/span><span class=\"c16\">5%<\/span><span class=\"c3\">) and\u00a0<\/span><span class=\"c16\">0.01<\/span><span class=\"c3\">\u00a0(<\/span><span class=\"c16\">1%<\/span><span class=\"c4 c3\">).<\/span><\/li>\n<\/ol>\n<ol class=\"c13 lst-kix_ang1fdsfht57-0\" start=\"2\">\n<li class=\"c1 c18 li-bullet-0\"><span class=\"c16\">Confidence Level<\/span><span class=\"c3\">: The confidence level (<\/span><span class=\"c16\">often denoted as 1 &#8211; \u03b1<\/span><span class=\"c4 c3\">) is the complement of the significance level. It represents the probability that the calculated confidence interval contains the true population parameter.<\/span><\/li>\n<\/ol>\n<p class=\"c9\"><span class=\"c4 c3\">For example, a 95% confidence level implies that you are 95% confident that the true parameter falls within the calculated interval.<\/span><\/p>\n<p class=\"c9\"><span class=\"c4 c3\">To calculate a confidence interval, you&#8217;ll need to choose your desired confidence level (e.g., 95% or 99%), find the corresponding Z-score from a standard normal distribution table, calculate your sample mean and standard deviation, and determine your sample size.<\/span><\/p>\n<p class=\"c9\"><span class=\"c4 c3\">Then, you can plug these values into the formula to compute the confidence interval.<\/span><\/p>\n<h3 id=\"h.kvs2twcfod76\" class=\"c22\"><span class=\"ez-toc-section\" id=\"How_to_calculate_confidence_intervals\"><\/span><span class=\"c0\">How to calculate confidence intervals<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p class=\"c9\"><span class=\"c4 c3\">Calculating confidence intervals step by step is a practical process that involves several key stages. Let&#8217;s walk through each step with an example to illustrate the process.<\/span><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0 start\" start=\"1\">\n<li class=\"c20 c10 c18 li-bullet-0\">\n<h4 id=\"h.brfhm0rzjv76\"><span class=\"ez-toc-section\" id=\"Step_1_Data_Collection\"><\/span><span class=\"c11 c3\">Step 1: Data Collection<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Begin by collecting your data. In our example, let&#8217;s say you&#8217;re interested in estimating the average time (in minutes) users spend on your website per session. You collect a random sample of 50 sessions and record the time spent.<\/span><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"2\">\n<li class=\"c20 c10 c18 li-bullet-0\">\n<h4 id=\"h.ck2t3d2jxdpo\"><span class=\"ez-toc-section\" id=\"Step_2_Choosing_a_Confidence_Level\"><\/span><span class=\"c3 c11\">Step 2: Choosing a Confidence Level<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Next, decide on your desired confidence level. We&#8217;ll use a standard confidence level of 95% for this example.<\/span><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"3\">\n<li class=\"c10 c18 c20 li-bullet-0\">\n<h4 id=\"h.2zxbk5493hot\"><span class=\"ez-toc-section\" id=\"Step_3_Calculate_the_Sample_Mean_x%CC%84\"><\/span><span class=\"c11 c3\">Step 3: Calculate the Sample Mean (x\u0304)<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Calculate the mean (average) of your sample data. Let&#8217;s assume that the sample mean (x\u0304) is 8.5 minutes.<\/span><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"4\">\n<li class=\"c20 c10 c18 li-bullet-0\">\n<h4 id=\"h.oqulss1cqyrj\"><span class=\"ez-toc-section\" id=\"Step_4_Determine_the_Standard_Deviation\"><\/span><span class=\"c11 c3\">Step 4: Determine the Standard Deviation<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Calculate the standard deviation of your sample data. Let&#8217;s assume our example&#8217;s standard deviation (S) is 1.2 minutes.<\/span><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"5\">\n<li class=\"c20 c10 c18 li-bullet-0\">\n<h4 id=\"h.jjjtdk3uuggt\"><span class=\"ez-toc-section\" id=\"Step_5_Find_the_Standard_Error\"><\/span><span class=\"c11 c3\">Step 5: Find the Standard Error<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Standard error (SE) measures how much your sample mean might vary from the true population mean. Calculate it using the formula:<\/span><\/p>\n<p class=\"c9 c23\"><span class=\"c4 c3\">SE = S \/ \u221an \u00a0Where:<\/span><\/p>\n<ol class=\"c13 lst-kix_u7ddc1ddpde4-0 start\" start=\"1\">\n<li class=\"c7 li-bullet-0\"><span class=\"c4 c3\">S is the standard deviation (1.2 minutes in our case).<\/span><\/li>\n<li class=\"c7 li-bullet-0\"><span class=\"c4 c3\">n is the sample size (50 sessions).<\/span><\/li>\n<li class=\"c7 li-bullet-0\"><span class=\"c4 c3\">So, SE = 1.2 \/ \u221a50 \u2248 0.1696 minutes.<\/span><\/li>\n<\/ol>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"6\">\n<li class=\"c20 c10 c18 li-bullet-0\">\n<h4 id=\"h.86wv388ae6mj\"><span class=\"ez-toc-section\" id=\"Step_6_Calculate_the_Z-Score_or_T-Score\"><\/span><span class=\"c11 c3\">Step 6: Calculate the Z-Score (or T-Score)<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Determine the Z-score from a standard normal distribution table. For a 95% confidence level, the Z-score is approximately 1.96.<\/span><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"7\">\n<li class=\"c20 c10 c18 li-bullet-0\">\n<h4 id=\"h.i40wignrgl61\"><span class=\"ez-toc-section\" id=\"Step_7_Calculate_the_Margin_of_Error\"><\/span><span class=\"c11 c3\">Step 7: Calculate the Margin of Error<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Calculate the margin of error (MOE) using the formula:<\/span><\/p>\n<p class=\"c1\" style=\"text-align: center;\"><em><strong><span class=\"c4 c3\">MOE = Z \u00d7 SE<\/span><\/strong><\/em><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">In our example, MOE = 1.96 \u00d7 0.1696 \u2248 0.3324 minutes.<\/span><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"8\">\n<li class=\"c20 c10 c18 li-bullet-0\">\n<h4 id=\"h.uunsg3qisoa2\"><span class=\"ez-toc-section\" id=\"Step_8_Calculate_the_Lower_and_Upper_Bounds\"><\/span><span class=\"c11 c3\">Step 8: Calculate the Lower and Upper Bounds<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Now, compute the lower and upper bounds of your confidence interval:<\/span><\/p>\n<p class=\"c1\"><em><strong><span class=\"c5 c3\">Lower Bound = x\u0304 &#8211; MOE<\/span><\/strong><\/em><\/p>\n<p class=\"c1\"><em><strong><span class=\"c5 c3\">Upper Bound = x\u0304 + MOE<\/span><\/strong><\/em><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">For our example:<\/span><\/p>\n<p class=\"c1\"><strong><em><span class=\"c3 c5\">Lower Bound = 8.5 &#8211; 0.3324 \u2248 8.1676 minutes<\/span><\/em><\/strong><\/p>\n<p class=\"c1\"><strong><em><span class=\"c5 c3\">Upper Bound = 8.5 + 0.3324 \u2248 8.8324 minutes<\/span><\/em><\/strong><\/p>\n<ol class=\"c13 lst-kix_fdtv43crfuhs-0\" start=\"9\">\n<li class=\"c1 c18 li-bullet-0\">\n<h4><span class=\"ez-toc-section\" id=\"Step_9_Apply_Results_in_the_CI_Formula\"><\/span><span class=\"c4 c3\">Step 9: Apply Results in the CI Formula<\/span><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">You now have your lower and upper bounds. The confidence interval is the range between these two values:<\/span><\/p>\n<p class=\"c1\"><em><strong><span class=\"c4 c16\">CI = (8.1676 minutes, 8.8324 minutes)<\/span><\/strong><\/em><\/p>\n<p class=\"c9\"><span class=\"c4 c3\">This means you are 95% confident that the average time users spend on your website per session falls within this interval.<\/span><\/p>\n<h2 id=\"h.jwixaarvbus3\" class=\"c14\"><span class=\"ez-toc-section\" id=\"Interpreting_Confidence_Intervals\"><\/span><span class=\"c6 c3\">Interpreting Confidence Intervals<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"c9\"><span class=\"c4 c3\">Interpreting confidence intervals (CIs) is crucial for making informed decisions based on data. Let&#8217;s explore how to interpret CIs, including the lower and upper bounds, what it means when a CI includes the null hypothesis, and how to draw conclusions from CI results.<\/span><\/p>\n<p class=\"c9\"><span class=\"c16\">Lower Bound<\/span><span class=\"c4 c3\">: The lower bound of a CI represents the lowest plausible value for the parameter you&#8217;re estimating. In our previous example of website session times, the lower bound of the CI (e.g., 8.1676 minutes) suggests that you can be 95% confident that the true average session time is at least this long but may be longer.<\/span><\/p>\n<p class=\"c9\"><span class=\"c16\">Upper Bound<\/span><span class=\"c4 c3\">: Conversely, the upper bound represents the highest plausible value for the parameter. In our example, the upper bound (e.g., 8.8324 minutes) indicates that you can be 95% confident that the true average session time is at most this long but could be shorter.<\/span><\/p>\n<h3 id=\"h.x6id5s9rn142\" class=\"c22\"><span class=\"ez-toc-section\" id=\"When_a_CI_includes_the_Null_Hypothesis\"><\/span><span class=\"c3 c21\">W<\/span><span class=\"c0\">hen a CI includes the Null Hypothesis<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p class=\"c9\"><span class=\"c4 c3\">When a CI includes the null hypothesis value, it implies that the observed effect is not statistically significant. In other words, there is a high probability that the true parameter lies within the interval, including the possibility of no effect.<\/span><\/p>\n<p class=\"c9\"><span class=\"c3\">In our website example, if the null hypothesis stated that the average session time is 8 minutes, and your 95% CI ranged from 8.1676 to 8.8324 minutes, it would include the null hypothesis value, suggesting no statistically significant difference.<\/span><\/p>\n<h3 id=\"h.7az0mqxobezo\" class=\"c22\"><span class=\"ez-toc-section\" id=\"Drawing_Conclusions_from_CI_results\"><\/span><span class=\"c0\">Drawing Conclusions from CI results<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p class=\"c9\"><span class=\"c4 c3\">Interpreting CIs involves comparing them to predefined thresholds or hypotheses:<\/span><\/p>\n<p class=\"c9\"><strong><span class=\"c16\">Statistical Significance<\/span><\/strong><span class=\"c4 c3\">: A CI that does not include a predefined threshold (e.g., zero or a null hypothesis value) suggests statistical significance. For example, if the 95% CI for your A\/B test&#8217;s conversion rate increase does not include the null hypothesis value, it indicates a significant improvement.<\/span><\/p>\n<p class=\"c9\"><strong><span class=\"c16\">Practical Significance<\/span><\/strong><span class=\"c3\">: Even if a CI is statistically significant, you should also consider practical significance. Does the observed effect, though statistically real, matter in practice? If a 1%\u00a0<\/span><span class=\"c2\"><a class=\"c19\" href=\"https:\/\/www.figpii.com\/blog\/11-tips-to-increase-your-ecommerce-conversion-rate\/\">conversion rate increase<\/a><\/span><span class=\"c4 c3\"> in your A\/B test is statistically significant but won&#8217;t significantly impact your business, it might not be practically significant.<\/span><\/p>\n<p class=\"c9\"><strong><span class=\"c16\">Decision-Making<\/span><\/strong><span class=\"c4 c3\">: You can make informed decisions based on the CI results and their interpretation. If a CI for a website change&#8217;s impact on user engagement does not include the null hypothesis value and is practically significant, it might justify implementing that change.<\/span><\/p>\n<h2 id=\"h.xt26lhvxmpl9\" class=\"c14\"><span class=\"ez-toc-section\" id=\"Challenges_associated_with_confidence_intervals\"><\/span><span class=\"c3\">Challenges associated with confidence intervals<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ol class=\"c13 lst-kix_srmwtg6mleb1-0 start\" start=\"1\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.il2yp4z4iofz\"><span class=\"ez-toc-section\" id=\"Sample_Size_Limitations\"><\/span><span class=\"c0\">Sample Size Limitations<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">Imagine you&#8217;re conducting an A\/B test on a new website feature. One of the first challenges you might encounter is having a relatively small <\/span><span class=\"c2\"><a class=\"c19\" href=\"https:\/\/www.figpii.com\/blog\/what-is-a-sample-size-in-a-b-testing\/\">sample size<\/a><\/span><span class=\"c4 c3\">. A small sample size can result in wide CIs, making it harder to draw precise conclusions.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">It&#8217;s like trying to estimate the average height of people in a city by measuring just a handful of residents \u2013 your estimate won&#8217;t be very accurate. You might need to collect more data or extend the testing period to address this challenge.<\/span><\/p>\n<ol class=\"c13 lst-kix_srmwtg6mleb1-0\" start=\"2\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.ldyxy3dxpa5f\"><span class=\"ez-toc-section\" id=\"Multiple_Testing\"><\/span><span class=\"c0\">Multiple Testing<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">In A\/B testing, it&#8217;s common to run multiple experiments simultaneously. However, when you do this, you face a challenge called multiple testing. It&#8217;s like conducting several experiments at once \u2013 the more tests you run, the higher the chance of finding a statistically significant result by random chance alone.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">This can lead to false positives. You may need to adjust your confidence level or use statistical methods designed for multiple comparisons to combat this challenge.<\/span><\/p>\n<ol class=\"c13 lst-kix_srmwtg6mleb1-0\" start=\"3\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.bysahdovgqox\"><span class=\"ez-toc-section\" id=\"Extended_Duration_of_Testing\"><\/span><span class=\"c0\">Extended Duration of Testing<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Imagine you&#8217;re running an A\/B test on a seasonal product, like ice cream. You need to consider the challenge of testing duration. If you run the test during a slow ice cream season, your CIs might not accurately represent how the product performs during the summer peak.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">It&#8217;s like assessing the popularity of winter coats in July \u2013 the results won&#8217;t be representative. To overcome this challenge, you might need to run tests for an entire seasonal cycle or account for seasonal variations in your analysis.<\/span><\/p>\n<ol class=\"c13 lst-kix_srmwtg6mleb1-0\" start=\"4\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.bsfbpkbm41sl\"><span class=\"ez-toc-section\" id=\"Seasonal_Variations\"><\/span><span class=\"c0\">Seasonal Variations<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c4 c3\">Speaking of seasons, seasonal variations can pose another challenge. Think of it as trying to determine the average temperature in a city throughout the year. You&#8217;ll miss the seasonal patterns if you only look at a month.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">In A\/B testing, ignoring seasonal variations can lead to misleading CIs. To address this, you&#8217;d need to analyze data across different seasons or segment your analysis by season.<\/span><\/p>\n<ol class=\"c13 lst-kix_srmwtg6mleb1-0\" start=\"5\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.9k5omy675tp8\"><span class=\"ez-toc-section\" id=\"Segmentation_Complexity\"><\/span><span class=\"c0\">Segmentation Complexity<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">Imagine you&#8217;re a large e-commerce platform offering a wide range of products. The challenge here is segmentation complexity. Different products may perform differently, and creating CIs when running a\/b tests for each <\/span><span class=\"c2\"><a class=\"c19\" href=\"https:\/\/www.figpii.com\/blog\/ecommerce-product-page-optimization\/\">product category<\/a><\/span><span class=\"c4 c3\">\u00a0can be challenging.<\/span><\/p>\n<p class=\"c1\"><span class=\"c4 c3\">It&#8217;s akin to analyzing the performance of every type of vehicle in a car dealership \u2013 it&#8217;s a lot of work. To tackle this, you might need to prioritize segments or use advanced statistical methods to handle the complexity.<\/span><\/p>\n<ol class=\"c13 lst-kix_srmwtg6mleb1-0\" start=\"6\">\n<li class=\"c17 c10 li-bullet-0\">\n<h3 id=\"h.k7hq2ot4inlg\"><span class=\"ez-toc-section\" id=\"Interpretation_Complexity\"><\/span><span class=\"c0\">Interpretation Complexity<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<\/li>\n<\/ol>\n<p class=\"c1\"><span class=\"c3\">Lastly, interpreting CIs can be complex. Let&#8217;s say your <\/span><span class=\"c3\">A\/B test results<\/span><span class=\"c4 c3\"> produce overlapping CIs for two variants. It&#8217;s not immediately clear who&#8217;s the winner. To make informed decisions, consider other factors, like practical significance or user feedback.<\/span><\/p>\n<h2 id=\"h.hyime7ic4awc\" class=\"c14\"><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span><span class=\"c3\">Conclusion<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Confidence intervals are a critical tool in A\/B testing because they provide a clear and reliable measure of the precision of your results.<\/p>\n<p>Incorporating them into your analysis ensures a more robust and trustworthy decision-making process during your A\/B testing process.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Confidence intervals, often abbreviated as CIs, are essential statistical tools used to quantify the uncertainty associated with a sample statistic, such as a mean or proportion, and provide a range within which the true population parameter will likely fall. In simpler terms, they offer a degree of certainty about the reliability of an estimate derived<\/p>\n","protected":false},"author":9,"featured_media":3364,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_eb_attr":"","footnotes":""},"categories":[2,579],"tags":[],"class_list":{"0":"post-3363","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-ab-testing","8":"category-content"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Understanding Confidence Intervals and their Importance. - FigPii blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Understanding Confidence Intervals and their Importance. - FigPii blog\" \/>\n<meta property=\"og:description\" content=\"Confidence intervals, often abbreviated as CIs, are essential statistical tools used to quantify the uncertainty associated with a sample statistic, such as a mean or proportion, and provide a range within which the true population parameter will likely fall. In simpler terms, they offer a degree of certainty about the reliability of an estimate derived\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\" \/>\n<meta property=\"og:site_name\" content=\"FigPii blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/figpii.aii\/\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-20T00:00:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-10T22:32:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160-1024x575.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"575\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Usman Adepoju\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@figpii\" \/>\n<meta name=\"twitter:site\" content=\"@figpii\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Usman Adepoju\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"14 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\"},\"author\":{\"name\":\"Usman Adepoju\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec\"},\"headline\":\"Understanding Confidence Intervals and their Importance.\",\"datePublished\":\"2023-09-20T00:00:53+00:00\",\"dateModified\":\"2025-02-10T22:32:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\"},\"wordCount\":2759,\"publisher\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png\",\"articleSection\":[\"AB testing\",\"Content\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\",\"url\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\",\"name\":\"Understanding Confidence Intervals and their Importance. - FigPii blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png\",\"datePublished\":\"2023-09-20T00:00:53+00:00\",\"dateModified\":\"2025-02-10T22:32:01+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage\",\"url\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png\",\"contentUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png\",\"width\":1560,\"height\":876,\"caption\":\"Understanding confidence intervals and their importance.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.figpii.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Understanding Confidence Intervals and their Importance.\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#website\",\"url\":\"https:\/\/www.figpii.com\/blog\/\",\"name\":\"FigPii blog\",\"description\":\"Let it marinate\",\"publisher\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.figpii.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#organization\",\"name\":\"FigPii\",\"url\":\"https:\/\/www.figpii.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png\",\"contentUrl\":\"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png\",\"width\":104,\"height\":40,\"caption\":\"FigPii\"},\"image\":{\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/figpii.aii\/\",\"https:\/\/x.com\/figpii\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec\",\"name\":\"Usman Adepoju\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g\",\"caption\":\"Usman Adepoju\"},\"url\":\"https:\/\/www.figpii.com\/blog\/author\/usman\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Understanding Confidence Intervals and their Importance. - FigPii blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/","og_locale":"en_US","og_type":"article","og_title":"Understanding Confidence Intervals and their Importance. - FigPii blog","og_description":"Confidence intervals, often abbreviated as CIs, are essential statistical tools used to quantify the uncertainty associated with a sample statistic, such as a mean or proportion, and provide a range within which the true population parameter will likely fall. In simpler terms, they offer a degree of certainty about the reliability of an estimate derived","og_url":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/","og_site_name":"FigPii blog","article_publisher":"https:\/\/www.facebook.com\/figpii.aii\/","article_published_time":"2023-09-20T00:00:53+00:00","article_modified_time":"2025-02-10T22:32:01+00:00","og_image":[{"width":1024,"height":575,"url":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160-1024x575.png","type":"image\/png"}],"author":"Usman Adepoju","twitter_card":"summary_large_image","twitter_creator":"@figpii","twitter_site":"@figpii","twitter_misc":{"Written by":"Usman Adepoju","Est. reading time":"14 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#article","isPartOf":{"@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/"},"author":{"name":"Usman Adepoju","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec"},"headline":"Understanding Confidence Intervals and their Importance.","datePublished":"2023-09-20T00:00:53+00:00","dateModified":"2025-02-10T22:32:01+00:00","mainEntityOfPage":{"@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/"},"wordCount":2759,"publisher":{"@id":"https:\/\/www.figpii.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage"},"thumbnailUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png","articleSection":["AB testing","Content"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/","url":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/","name":"Understanding Confidence Intervals and their Importance. - FigPii blog","isPartOf":{"@id":"https:\/\/www.figpii.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage"},"image":{"@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage"},"thumbnailUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png","datePublished":"2023-09-20T00:00:53+00:00","dateModified":"2025-02-10T22:32:01+00:00","breadcrumb":{"@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#primaryimage","url":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png","contentUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/IMG_4160.png","width":1560,"height":876,"caption":"Understanding confidence intervals and their importance."},{"@type":"BreadcrumbList","@id":"https:\/\/www.figpii.com\/blog\/understanding-confidence-intervals-and-their-importance\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.figpii.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Understanding Confidence Intervals and their Importance."}]},{"@type":"WebSite","@id":"https:\/\/www.figpii.com\/blog\/#website","url":"https:\/\/www.figpii.com\/blog\/","name":"FigPii blog","description":"Let it marinate","publisher":{"@id":"https:\/\/www.figpii.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.figpii.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.figpii.com\/blog\/#organization","name":"FigPii","url":"https:\/\/www.figpii.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png","contentUrl":"https:\/\/www.figpii.com\/blog\/wp-content\/uploads\/2023\/09\/figpii-logo-purple.png","width":104,"height":40,"caption":"FigPii"},"image":{"@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/figpii.aii\/","https:\/\/x.com\/figpii"]},{"@type":"Person","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/ed6908a6c1d884db14e9c28fc837b5ec","name":"Usman Adepoju","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.figpii.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bbdd3896b2f568a544af94603f54223cfb9b91c41a1365212f8ffecc6006951e?s=96&d=mm&r=g","caption":"Usman Adepoju"},"url":"https:\/\/www.figpii.com\/blog\/author\/usman\/"}]}},"_links":{"self":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts\/3363","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/comments?post=3363"}],"version-history":[{"count":10,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts\/3363\/revisions"}],"predecessor-version":[{"id":5584,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/posts\/3363\/revisions\/5584"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/media\/3364"}],"wp:attachment":[{"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/media?parent=3363"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/categories?post=3363"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.figpii.com\/blog\/wp-json\/wp\/v2\/tags?post=3363"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}