Data/ML/AIGeneral

A/B Testing

Also written as Experimentation

Comparing two versions of a product feature by showing each to different user groups and measuring which performs better against a metric.

Think of it like

Like a restaurant testing two versions of a dish on different tables the same night, then keeping whichever one gets ordered — and finished — more.

Junior or senior?

Junior sounds like

Describes an A/B test they ran with an expected, unremarkable result.

Senior sounds like

Can describe one where the result actually surprised them.

Ask them

“Tell me about an A/B test you ran where the result surprised you.”