Measuring True Lift: Revenue Per Session vs Click-Through Rate
Click-through rate is an easy personalization metric to manipulate. Revenue per session gives a clearer view of whether the right products reach the right shoppers.
From the ParticularAudiance team, on per-shopper product ranking, catalog scale, and ecommerce personalization that moves revenue numbers.
Category pages suit catalogs with a few hundred products. As a catalog reaches the hundreds of thousands, the gap between what shoppers see and what you carry grows hard to manage.
Click-through rate is an easy personalization metric to manipulate. Revenue per session gives a clearer view of whether the right products reach the right shoppers.
A nightly batch model misses that a shopper just searched for hiking boots. A real-time model catches it, and that gap can appear in revenue per session within the first week.
Every new visitor starts with no purchase history. The cold start problem needs session signals from minute one, not a return visit.
A product added this morning has no click history, purchase data, or behavioral signal. A good ranking engine should not hide it.
Historical purchase data has value, but it gets stale. Session signals from the visit show what a shopper wants today.
Shopify's native search and recommendation features suit smaller catalogs. Once your SKU count passes 20,000, you need a ranking layer Shopify does not provide.
Before investing in a personalization engine, establish a clear before-and-after measurement framework.
A recommendation model trained last week cannot know about a collection launched yesterday. Staleness quietly builds across the catalog.
Most personalization A/B tests track the wrong measure. Conversion rate may look good on a dashboard, while revenue per session over a 30-day window shows whether the business improved.
Segmentation groups shoppers by shared traits and gives each group same products. Per-shopper personalization treats each session as its own context.
The first 30 days after connecting a product discovery engine reveal whether the system is learning your catalog.