Magic Tavern: require placement evidence before making CTV a performance channel

Analysis

By UA Ledger staff3 min read

Magic Tavern: require placement evidence before making CTV a performance channel

Magic Tavern's Project Makeover case ties a new channel to a measurement requirement. That is a stronger starting point than buying connected-TV reach and trying to explain its contribution afterwards.

Magic Tavern's Project Makeover case ties a new channel to a measurement requirement. That is a stronger starting point than buying connected-TV reach and trying to explain its contribution afterwards.

What the public case establishes

Adjust describes Magic Tavern exploring CTV for Project Makeover, selecting CTV AdVision and choosing Smadex partly because it supported third-party measurement pixels. The case says placement-level reporting helped the team adjust spending and assess downstream revenue and engagement. Adjust case study.

This debrief analyses a public customer case published by a commercial supplier. It is not an original UA Ledger interview. The chronology below follows the supplier’s account; we did not inspect the advertiser’s dashboards or interview its staff.

The decision worth examining

A measurement pixel provides a recorded signal, not an automatic proof that an exposure caused a later install. Its value is that it makes a defined attribution workflow possible and exposes placement differences. The buying decision should require both transparent evidence about where delivery occurred and a separate plan for learning whether the channel changes business outcomes.

Keep the inventory record, crediting rule and downstream cohort definition adjacent in the review. A promising placement may be over-credited by a broad window or overlap heavily with other campaigns. An aggregate CTV result can hide that. The proposed worksheet therefore treats inventory transparency as an eligibility gate and incrementality as a later experimental question.

A usable next check

Before spending at scale, ask a potential partner to demonstrate a complete sample path from a test exposure record to an attributed outcome, with permitted identifiers and timestamps. Reconcile reported placements and invalid or missing fields. Then define a holdout or other defensible causal design for a bounded campaign rather than treating the successful data connection as the result.

Reference table
Test elementProposed specification
ControlAggregate CTV reporting with unclear placement lineage
VariantPlacement-level lineage under a declared crediting rule
ReadoutTraceable inventory, overlap and later independently designed lift
Stop or rejectReject inventory or attribution claims that cannot be reconciled to the agreed fields

Download the populated case worksheet. Its control, variant and decision rules are a proposed experiment, not an account of results already measured. Keep the source URL with the worksheet when circulating it so reported findings cannot become unattributed team benchmarks.

Evidence boundary

We did not inspect the partner's pixels, delivery logs or campaign allocation. The public case's outcomes remain supplier-reported. This is not evidence that every CTV impression can be deterministically matched to a person or that credited installs are incremental.

For background, see reading an mmp dashboard without fooling yourself and cohort quality checklist ua spend. These are existing archive discussions, not independent certification of this case. No first-hand campaign result is asserted.

Featured

Related posts

measurement

media buying

·

1 min read

Using predicted LTV in bids: disclosure checklist for the UA team

measurement

media buying

·

1 min read

Blended ROAS targets that hide channel failure in F2P portfolios

measurement

media buying

·

2 min read

Web-shop LTV with VAT-inclusive prices versus store net proceeds (labelled synthetic)

measurement

media buying

·

1 min read

View-through attribution windows on F2P rewarded and interstitial traffic

More from the Measurement desk

measurement

·

2 min read

Airbridge adds Amazon Ads as an app measurement channel

measurement

·

2 min read

When to freeze a cohort for payback review (and when not to)

measurement

·

1 min read

Web-shop purchaser quality vs store IAP purchaser quality

measurement

·

1 min read

Web-shop attributed revenue in MMP vs payment-provider settlements