Experiments

People

What we're building

  • No-code experiments / Visual editor

    A visual editor for experiments would allow users to test changes to their website / app without having to touch the code.

    Project updates

    No updates yet. Engineers are currently hard at work, so check back soon!

Roadmap

Here’s what we’re considering building next. Vote for your favorites or share a new idea on GitHub.

Recently shipped

No-code experiments now in public beta

One of our most requested features in now live, in public opt-in beta: no-code experiments.

No-code experiments enable you to run A/B tests, multivariate tests, and other experiments that modify your website without writing a single line of code. Instead, it's all done through the toolbar with a simple, codeless interface.

You can still create A/B experiments with code, obviously, but the no-code option is a great alternative for less technical users, or for just running simple experiments. If you want to quickly alter the colour of a headline or change some copy on your site, for example, no-code is a great option.

No-code experiments are currently in public opt-in beta while we actively work on them. That means they come with a few caveats and considerations like all betas, so it's worth checking the docs while we get things polished up!

Goals

Q4 2024 Objectives

This quarter, we're focusing on more feature improvements to help users create comprehensive and easy-to-analyze experiments. These improvements will make our product more mature and complete.

Objective 1: Finish HogQL rewrite

We will migrate Experiments to HogQL, making result calculations more reliable and performant. This will also enable the addition of new features listed below.

Objective 2: Multiple experiment goals supported + visualized

We will add support for multiple goal metrics in a single experiment, allowing them to be visualized together and making it easier to interpret results across all metrics simultaneously.

Objective 3: Reusable experiment metrics

We will add the ability to create metric sets that users can save and reuse. This will reduce friction, improve maintainability, and decrease the likelihood of errors.

Objective 4: Review and adjust methodology with a statistician

We will review our current methodology to ensure it is both accurate and easy for our users to understand.

Handbook

What this team does

We build PostHog's experimentation platform, allowing users run A/B tests and feature experiments easily in their apps. We help teams validate ideas, measure impact, and make informed decisions quickly and confidently.

Some of the things we're working on:

  • Experiments UI – an interface for setting up, managing, and analyzing experiments in PostHog.
  • Experimentation API – backend services that handle experiment creation, user assignment, and result analysis.
  • Statistical analysis – implementing statistical methods to ensure accurate interpretation of results.
  • Documentation – writing documentation and tutorials to help users get the most out of Experiments.

Slack channel

#team-experiments

Feature ownership

You can find out more about the features we (and the other teams) own here