Building the future of AB testing at carwow

graph on paper
Photo by Isaac Smith on Unsplash

AB testing at carwow

  1. Any results must be Trustworthy. Our metrics must be robust and reproducible, and the statistical analysis must be accurate and well presented
  2. Any reports must be Usable. We will require our dashboards to be used by all of our product teams and enable them to effortlessly analyse experiments and make clear informed decisions. We see visualisation and segmentation as vitally important
  3. We are a business that is evolving, entering and creating new markets, so the dashboards must be Extendable. It must be easy to introduce new metrics, segments, experimentation methods and analysis and new visualisations.
  4. We are a business that is growing massively, therefore it must be Scalable. We may need to collect and analyse data from tens of millions of users. Therefore we must ensure scalability is at the heart of our tool.
  5. It must run Efficiently. We should be able to refresh the data quickly, easily and routinely. We may want to perform deep dive analysis to quickly validate a new hypothesis. It also must store data and compute in the most efficient and effective way to minimise cost.
Our Learning & Experiment Analytics Platform (LEAP)

Meta: Our Experiment Meta Data

Metrics Dictionary

Data Collection

Statistics Engine

Visualisation

Let Mat walk you through our London offices

--

--

--

What happens in the Analytics and Data Science team here at carwow

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Logistic Regression: The Entry To The ML World

Roles and responsibilities of a Data scientist.

A Step-by-Step Introduction to Hyperparameter Tuning, Grid Search and Bayesian Optimization

Competing For Data Science Talent in Today’s Competitive Market

January 22–28: Update I

Data Warehouse vs Data Lake

Spotlight: Smera Palanivel

2021 Tüketici Fiyat Endeksi Analizi

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Analytics and Data Science @ carwow

Analytics and Data Science @ carwow

What happens in the Analytics and Data Science team here at carwow

More from Medium

Beyond AB Testing | Experimentation without A/B Testing — Switchbacks and Synthetic Control Group

A retrospective on building Veepee’s content personalisation project

Why Stop Using Google Analytics?

2 years of Strategy Communication, Execution, and Updates