I'm Head of Product at UX Pilot, an AI design tool, and last October we ran an experiment that broke a rule everyone in SaaS treats as gospel.
The rule: simplify onboarding. Strip it back, hide the advanced features, don't overwhelm the new user. Get them to one small win. It's in every activation playbook. We did the opposite, and the numbers were not close.
The signal in the data
Before touching anything, I looked at which behaviors in a user's first week correlated most with converting from free to paid. One stood out by a mile. Users who used Deep Design, our most powerful generation mode, in their first 7 days converted at 12.3%. Users who didn't converted at 1.3%.
That's an 845% relative difference between two groups of free users. The obvious question: is that correlation, or does experiencing the full power of the product actually cause people to pay?
The experiment
We turned Deep Design on by default for every first-time user, instead of leaving it as an advanced option they had to discover. The setup:
- Exposure: 120,000 users over 11 days.
- Method: a Bayesian A/B test at 95% confidence.
- Hypothesis: earlier exposure to the product's real power raises perceived quality, which raises conversion.
- Success bar: we set it at +10%.
We cleared the bar by more than 4x.
Why it worked
The standard advice isn't wrong because simplicity is bad. It's wrong because it optimizes for the wrong thing. A stripped-down first experience reduces confusion, but it also reduces the chance the user ever feels why your product is worth paying for. For a product whose entire value is power and speed, hiding the power is hiding the value.
This is the whole idea behind activation: the moment a user first experiences your core value. We had been delaying that moment in the name of a cleaner first screen. Moving it to the front of the experience is what moved the money.
Which behavior predicts your best users?
The Deep Design signal came from segmenting users by who loves the product. Run the Sean Ellis survey to find your very disappointed segment, then find the behavior they share.
Measure your PMF score free → 14-day free trial · No credit cardThe takeaway for your product
Don't assume free users need a smaller version of your product to convert. Sometimes the highest-leverage activation move is to let them feel the whole thing, immediately. The way to know is not to guess, it's to find the behavior your best users share and then test forcing it earlier.
Which brings it back to product-market fit. Activation and conversion are downstream of fit: they measure how well you deliver value to people who already want it. The Sean Ellis survey tells you whether that want exists and who holds it; experiments like this one tell you how to deliver it faster.
Track the fit behind the funnel
PMFtracker measures your PMF score and the very disappointed segment, so the activation experiments you run are aimed at delivering value to the users who actually want it.
Start Tracking PMF → Set up in 5 minutes · No credit card required