Soft-launch sample size: days and installs before a kill call

Analysis

By Isaac Turner, Measurement Editor1 min read

View author profile
Soft-launch sample size: days and installs before a kill call

Labelled synthetic lab for soft-launch kill timing using Wilson-style interval humility on retention, without inventing industry kill thresholds.

Kill calls often happen before statistical humility. Apple’s product page optimization flow even estimates whether a desired conversion lift can reach 90% confidence within 90 days given impressions — a reminder that sample size is a first-class input. This lab does not invent a universal soft-launch install target.

Define the calculation (labelled synthetic)

For a binary retention rate r = retains / installs, a simple Wilson interval at 95% confidence is:

  • centre ≈ (p + z²/2n) / (1+z²/n) with p=r, z=1.96
  • half-width grows quickly when n is small

Decision rule for this teaching sheet: do not call a kill on D1 retention alone while the 95% Wilson half-width still exceeds a reader-set max_halfwidth (synthetic default 0.05).

Worked synthetic example

Reference table
DayInstallsD1 retainsD1 rateApprox 95% half-widthKill allowed under rule?
34001400.350~0.047Borderline
720007000.350~0.021Yes on width alone
720005000.250~0.019Yes on width alone

Width readiness is not the same as product readiness — payer quality and creative leakage still matter. Numbers are synthetic.

Limits

No AppsFlyer account export was used. No industry “median kill day” is claimed.

Download the artifact.

Research checked 20 September 2026. Local draft; human editorial review pending.

Featured

Related posts

measurement

·

2 min read

When to freeze a cohort for payback review (and when not to)

measurement

media buying

·

1 min read

Using predicted LTV in bids: disclosure checklist for the UA team

measurement

media buying

·

1 min read

Blended ROAS targets that hide channel failure in F2P portfolios

measurement

·

1 min read

Web-shop purchaser quality vs store IAP purchaser quality

More from the Measurement desk

measurement

·

2 min read

Airbridge adds Amazon Ads as an app measurement channel

measurement

·

1 min read

Web-shop attributed revenue in MMP vs payment-provider settlements

measurement

media buying

·

2 min read

Web-shop LTV with VAT-inclusive prices versus store net proceeds (labelled synthetic)

measurement

media buying

·

1 min read

View-through attribution windows on F2P rewarded and interstitial traffic