Ran a checkout upsell test on 16,000 checkouts.
No significant lift. "Failed test."
We cut it by day of week:
- Monday/Tuesday shoppers: $16.74 per checkout. 99% confidence.
Turned it on for start-of-week traffic only. $2.5M annualized.
The test didn't fail. It just wasn't specific enough.
Interesting audit last week: Denim brand. 31% abandonment after address entry vs. a healthy benchmark of 15%. And the strangest stat we've seen in any audit: returning customers converting WORSE than first-timers.
Free shipping at $125, just under average AOV. 55% of customers got it free vs. a 45% benchmark. Zero push to spend more. Shipping revenue at 2% of AOV vs. a 5% target.
They'd moved shipping from $5 to $6. No conversion drop. That's a signal screaming "keep going." Nobody followed it. No infrastructure to test further.
Ground and expedited showed nearly identical delivery windows to everyone. Why pay more to arrive the same day? They were charging extra for confusion.
So we got building: threshold test stepping $125 to $150, with $175 queued. Price sensitivity test on standard. Geo-segmented delivery dates. Upsells on high-attachment SKUs like belts and tees. Welcome incentive for first-time non-coupon customers.
The returning customer fix was sitting in plain sight: they had store credit waiting and nobody told them until a post-purchase email. We surfaced it at checkout. Reward people while it can still change the purchase.
Your data is full of signals like that $5 to $6 move. Most brands see them and walk right past.
Noon shoppers convert at 77.4%.
Midnight shoppers: 69.1%.
Same store. Same cart. Different hour.
AOV doesn't move. Coupons don't move. The only thing that changes is when they're shopping and apparently that's enough to cost you 11 points.
We call it Time-of-Day Segmentation. →
intercom.news/prettydamnquic…
One shirt is $19.99. The 3-pack is $49.99.
One tap to swap up, no going back to the product page.
Bundle offers in checkout turn "I'll grab one" into "actually, give me three."
Higher AOV without spending another cent on ads.
Shopify changing people’s checkout automatically
“Pay as guest” or “pay and save my info”
How do we disable this?
It’s absolutely obliterating mine and your CVR’s
"We A/B tested it and there was no lift."
Cool. How long did you run it? On which segment? At what time of day? With what AOV cohort?
Most "failed tests" aren't failed tests. They're underpowered tests run on the wrong audience.
The checkout is the only page on your site where the shopper has their credit card out.
It's also the page most brands touch the least.
Insane if you ask me.
Today, many of them hold this company up.
A few months ago we did it again, 9 new grads across engineering and CS.
Skill, curiosity, and grit beat formal experience every time.
Every Shopify brand is still competing with Amazon.
Not on ads. Not on products. On the checkout-to-delivery experience.
Amazon set the standard: personalized, fast, transparent. Shopify brands got static checkouts and siloed delivery.
The future of commerce is Amazonian experiences without Amazon.
3/4
Your checkout is guessing. Stop.
MAXX → autonomous AI operator. Analyzes your store, runs experiments, decides what to roll out.
Theme A/B Testing → 3.1x faster than manual.
Strategy Library → 200 tested plays, ranked for your catalog.
4/4
Your checkout is leaving money on the table. Pick it up.
Cashback ( 14% repeat), Subscription Upsells ( 6%), Multi-Tier Progress Bar ( 22%), Cart Control, Dynamic Reviews in checkout. Plus 7 more.
Read it before your competitors do:
prettydamnquick.com/product-…
5 recent checkout tweaks, and the real results:
1. Free shipping bar raised: ~$3.12M annualized
2. Free gift unlock at $X: ~$892K
3. Mid-tier shipping option added: ~$980K
4. Segmented upsell test: ~$742K
5. Trust content for first-timers: ~$502K
The biggest mistake is not testing in checkout at all.
Most "best practices" in eCommerce are just vibes.
Between us we analyzed 11,000 A/B tests to find out what actually works.
Join me @CaseyHill on April 30, we're going some tests and data live.
Free. 1 hour. No fluff.
luma.com/v1oqhfi7
Shopify makes checkout easy to set up.
That's the problem.
Easy means every store ends up looking the same. A first-time buyer from a paid ad gets the same checkout as a fifth-time customer on their phone at 11pm.
The brands actually growing don't run it that way. They segment. They test copy, offers, shipping logic. They keep rebuilding it to see what works best.
Because default is expensive.
Shopper types "SAVE20." Doesn't work.
Tries again. Caps lock. No caps. Opens Google.
Finds a dead Reddit thread. Closes the tab. Gone.
46% of shoppers bail when a code fails.
We just shipped the fix.