We've shipped 15+ apps and run Meta ads for them, and for a long time we judged campaigns by Ads Manager ROAS. Comparing it with what actually landed in App Store Connect and Google Play changed how we buy. Here's what's specific to subscription apps, and the three checks we use now.
Ads Manager over-counts in four places. Click and view credit includes people who would have installed anyway, especially if your app already gets search traffic. On iOS, part of the results are modelled from aggregated SKAdNetwork data. If you optimize for trial starts, a result is a trial, and many trials never pay. And purchase value is usually the gross price, before the store's 15 to 30% cut and refunds. To see how much of a campaign's credit is view-through, use Compare attribution settings in the columns menu, or the SKAdNetwork view and click columns for iOS campaigns.
It under-counts in two. Trial-to-paid conversions often happen after the attribution window closes, so the payment that matters isn't credited. Renewals come weeks or months later and are never credited to the campaign. On a weekly or monthly plan, that can be most of the money.
So a campaign that looks profitable in Ads Manager can be losing money, and one that looks bad can be your best. You can't tell which from Ads Manager alone.
The first check is quick. Compare last month's Meta-reported purchases with the new paying customers in App Store Connect or Google Play for the same days. If Meta claims 120 purchases and the store shows 90 new payers in total, ads and organic together, Meta's count is inflated.
The second takes two weeks. Cut spend in one country and watch new paying customers there against similar countries you left alone. What disappears is what your ads were really adding.
The third changed how we buy. Group new subscribers by the week they first subscribed, free trials included, and add up what each week's group has paid you so far after the store's cut. If your app also sells without ads, subtract what it usually makes on its own first, which the country test helps you find. Divide by that week's Meta spend and look again at day 14, 30 and 90, next to older weeks at the same age. Weekly and annual plans fill in at very different speeds, so compare like with like.
We now make a cut or keep call on each week two weeks after it closes. Replayed over two years of our own apps, with only the data each day had, the weeks we'd have cut made back 55¢ per dollar by day 90. The weeks we'd have kept made back $1.51.
How do you judge Meta campaigns for subscription apps, and on what day do you make the call?