A/B tests are very commonly performed by data analysts and data scientists. For this project, the goal is to understand the results of an A/B test run by an e-commerce website.
(Image is adapted from a copyright-free website: https://www.pexels.com/royalty-free-images/.)
The company has developed a new web page in order to try and increase the number of users who "convert," meaning the number of users who decide to pay for the company's product. Current work is to help the company understand if they should implement this new page, keep the old page, or perhaps run the experiment longer to make their decision.
| Table of Contents |
|---|
| Prerequisites 🔍📜 |
| Design 📐 |
| Conclusions 📌 |
| License 🔖 |
- Python 3.6.3
- Jupyter Notebook
- Anaconda-Navigator
Step One - Compare
Through mathematics calculation to find out the conversion rates difference between new and old pages.
Step Two - A/B test
Further examine with an A/B test to see if the results match arithmetic analyze.
Step Three - Country
Investigate the impact of countries on P-value and hypothesis.
- Through comparison, there is a decreasing of conversion rates in new pages versus old ones. A/B test confirmed new page's poorer performance, thus we don't have enough evidence to reject the null hypothesis, suggesting new pages has no advantages over old ones on conversion rates.
- We had also noticed that country did have some bearing on conversion rate, but not high enough to be statistically significant.
- In sum, I would suggest the e-commerce company at least not to consider the current new page, but trying to figure out the reason of its poor performance in order to launch another feasible page.
