Skip to content

This project performs an end-to-end A/B testing analysis on a marketing campaign dataset to evaluate the effectiveness of personalization strategies. Using Python and statistical methods, it compares conversion rates between control and test groups, calculates lift, and applies hypothesis testing to determine statistical significance.

Notifications You must be signed in to change notification settings

suryamr2002/Marketing-Campaign-A-B-Testing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

πŸ“Š Marketing Campaign Analysis using A/B Testing

This project performs a comprehensive A/B Testing-based statistical analysis of a marketing campaign to determine whether a personalized strategy is more effective than a generic approach. The analysis is done using Python and essential data science libraries, with detailed steps from data loading and cleaning to hypothesis testing and final business conclusions.


πŸ“Œ Objective

The primary goal of this project is to:

  • Evaluate the performance of two marketing strategies: Control (generic message) and Personalization (customized message).
  • Use statistical testing (A/B testing) to determine if there is a significant difference in conversion rates between the two.
  • Derive actionable insights for the marketing team based on statistical evidence.

🧾 Dataset Overview

The dataset simulates responses to two marketing campaigns sent to different customer segments.

  • Features include:
    • user_id: Unique identifier for each participant.
    • group: Control or Personalization.
    • converted: Binary value indicating whether the user converted (1) or not (0).

πŸ§ͺ Methodology

The project follows a structured data science approach:

1. Data Exploration & Cleaning

  • Load the dataset.
  • Check for missing or duplicate values.
  • Perform basic statistics on conversion rates.

2. Data Visualization

  • Visualize conversion distributions between control and personalization groups.
  • Use bar plots and boxplots to compare performance.

3. Hypothesis Testing

  • Null Hypothesis (Hβ‚€): There is no significant difference in conversion between Control and Personalization.
  • Alternative Hypothesis (H₁): Personalization leads to higher conversion rates.
  • Perform a two-sample t-test (independent) to validate hypotheses.

4. Lift & statistical significance

  • Measure the lift in performance.
  • Report p-values and statistical significance.

πŸ“‰ Key Results

  • Conversion Rate (Control) for dependent factors
  • Conversion Rate (Personalization) for dependent factors
  • Lift: for dependent factors
  • Conclusion: The personalization campaign performs significantly better than the generic campaign for each segment ( Email, Instagram, House ads, etc.)

βš™οΈ Technologies & Libraries Used

  • Python
  • Pandas – data manipulation
  • Matplotlib & Seaborn – visualization
  • NumPy – numerical operations
  • SciPy – statistical testing

πŸ“š Skills Applied

  • A/B Testing
  • Experimental Design
  • Hypothesis Testing
  • Data Cleaning & EDA
  • Statistical Significance Analysis
  • Visualization & Interpretation

πŸ“ˆ Business Implications

  • Personalized marketing increases conversion and should be prioritized.
  • A data-driven approach can guide campaign decisions and increase ROI.

πŸ“Ž How to Run

  1. Clone the repository:

    git gh repo clone suryamr2002/Marketing-Campaign-A-B-Testing
  2. Launch Jupyter Notebook and open the .ipynb file:

    jupyter notebook

πŸ“¬ Contact

Author: SURYA M.R πŸ“§ LinkedIn
πŸ“‚ GitHub Portfolio

About

This project performs an end-to-end A/B testing analysis on a marketing campaign dataset to evaluate the effectiveness of personalization strategies. Using Python and statistical methods, it compares conversion rates between control and test groups, calculates lift, and applies hypothesis testing to determine statistical significance.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published