Soft-launch sample size: days and installs before a kill call
Analysis
By Isaac Turner, Measurement Editor — 1 min read
View author profile
Labelled synthetic lab for soft-launch kill timing using Wilson-style interval humility on retention, without inventing industry kill thresholds.
Kill calls often happen before statistical humility. Apple’s product page optimization flow even estimates whether a desired conversion lift can reach 90% confidence within 90 days given impressions — a reminder that sample size is a first-class input. This lab does not invent a universal soft-launch install target.
Define the calculation (labelled synthetic)
For a binary retention rate r = retains / installs, a simple Wilson interval at 95% confidence is:
- centre ≈
(p + z²/2n) / (1+z²/n)withp=r,z=1.96 - half-width grows quickly when
nis small
Decision rule for this teaching sheet: do not call a kill on D1 retention alone while the 95% Wilson half-width still exceeds a reader-set max_halfwidth (synthetic default 0.05).
Worked synthetic example
| Day | Installs | D1 retains | D1 rate | Approx 95% half-width | Kill allowed under rule? |
|---|---|---|---|---|---|
| 3 | 400 | 140 | 0.350 | ~0.047 | Borderline |
| 7 | 2000 | 700 | 0.350 | ~0.021 | Yes on width alone |
| 7 | 2000 | 500 | 0.250 | ~0.019 | Yes on width alone |
Width readiness is not the same as product readiness — payer quality and creative leakage still matter. Numbers are synthetic.
Limits
No AppsFlyer account export was used. No industry “median kill day” is claimed.
Research checked 20 September 2026. Local draft; human editorial review pending.
Featured
Related posts
measurement
·2 min read
When to freeze a cohort for payback review (and when not to)
measurement
media buying
·1 min read
Using predicted LTV in bids: disclosure checklist for the UA team
measurement
media buying
·1 min read
Blended ROAS targets that hide channel failure in F2P portfolios
measurement
·1 min read
Web-shop purchaser quality vs store IAP purchaser quality
More from the Measurement desk
measurement
·2 min read
Airbridge adds Amazon Ads as an app measurement channel
measurement
·1 min read
Web-shop attributed revenue in MMP vs payment-provider settlements
measurement
media buying
·2 min read
Web-shop LTV with VAT-inclusive prices versus store net proceeds (labelled synthetic)
measurement
media buying
·1 min read