Cherry Picking
Your agency sends over the monthly report. It’s a clean deck — logo at the top, brand colors, a few charts trending upward. The account manager walks you through it on a call. Things are looking good. Momentum is building. There’s a slide about “learnings” from what didn’t work, but it’s vague and moves fast. The call ends and you feel okay about things.
Most clients do. They just didn’t have enough information to know otherwise.
That’s Cherry Picking — and it’s one of the most common techniques in agency reporting.
How It Works
Cherry Picking is the practice of selecting which metrics, campaigns, and time periods to feature in client reporting — and which ones to leave out, minimize, or reframe.
It doesn’t require lying. That’s what makes it effective. Every number in your report can be accurate. The manipulation is in the curation.
Every number in your report can be accurate. The manipulation is in the curation.
Here’s what it looks like in practice:
Selective metrics. Your paid search campaign drove a lot of clicks but almost no conversions. The report leads with click volume and click-through rate. Conversion rate and cost per acquisition are either absent or buried. Clicks are a real metric. They’re just not the one that matters for your business.
Selective time windows. Performance dipped in Q3 but recovered slightly in October. The report compares October to September — a two-month window that shows recovery — rather than to October of last year, which would show how far things have fallen. Both comparisons are accurate. Only one is honest.
Selective campaigns. You’re running four campaigns. Two are performing well, one is flat, one is quietly bleeding budget. The report goes deep on the two winners. The underperformers get a line item and a note about “ongoing optimization.”
Selective context. Your cost per lead went up 40% this quarter. The report attributes it to “market conditions” and includes an industry benchmark showing your competitors are also struggling. That may be true. It may also be obscuring the fact that the campaign strategy hasn’t changed in six months and should have.
The result is a client who feels informed but isn’t. Who renews because things seem fine. Who doesn’t ask the hard questions because the report didn’t give them a reason to.
How to Spot It
The clearest sign of Cherry Picking is reports that only ever look good.
Real marketing performance is messy. Some things work. Some things don’t. Some things work for a while and then stop. A reporting practice that consistently presents an upward story — month after month, quarter after quarter — isn’t reflecting reality. It’s managing perception.
Here are the specific questions to ask:
Questions to ask your agency:
Can I see the raw data? You should always have access to your own analytics platforms — Google Analytics, your ad accounts, whatever tools are in use. If you don’t have login credentials, ask for them. If the agency resists, that’s a serious problem.
What’s not in this report? Every reporting framework has choices baked in. Ask your agency to explain why they track the metrics they track. If the answer is vague, or if they get defensive, that’s information.
What does this look like year-over-year? Month-over-month comparisons are easy to manipulate by choosing the right window. Year-over-year comparisons are harder to game and usually more meaningful.
What’s the cost per [outcome that matters to my business]? Not cost per click. Not cost per impression. Cost per lead, cost per sale, cost per whatever actually moves your business forward. If your agency can’t give you a clean answer to this question, ask why.
What’s underperforming, and what’s the plan? A good agency will volunteer this. They’ll tell you what’s not working before you ask, and they’ll have a point of view on what to do about it. An agency practicing Cherry Picking will make you dig for it — and when you find it, the answer will be some version of “we’re monitoring it.”
How to Protect Yourself
Define success before the engagement starts. The best defense against Cherry Picking is agreeing on the metrics that matter before the agency has any incentive to avoid them. Put them in writing. Build them into the reporting template. If you don’t define success upfront, you’re giving the agency permission to define it retroactively — and they will define it in their favor.
Require a standard reporting template. Ask for the same metrics, in the same format, every month. This makes it much harder to quietly drop an underperforming metric or shift the comparison window without you noticing.
Own your own data access. Every platform your agency uses on your behalf — ad accounts, analytics, CRM integrations — should have you listed as an owner or admin, not just a viewer. Not because you’re going to manage it yourself, but because access is leverage. An agency that knows you can see everything has less room to curate what you see.
Every platform your agency uses on your behalf — ad accounts, analytics, CRM integrations — should have you listed as an owner or admin, not just a viewer.
Ask about the bad news first. Make it a habit. When the call starts, ask what’s not working. It reframes the conversation and signals that you’re paying attention. Agencies that are used to leading with wins will find this uncomfortable at first. Good ones will appreciate it.
Compare reports over time. Keep your monthly reports and read them against each other. If a metric featured prominently last month has quietly disappeared this month, ask where it went.
Cherry Picking is effective because most clients don’t have time to audit their reporting — and most agencies rely on it. The defense isn’t becoming a marketing expert. It’s knowing what questions to ask, and asking them consistently enough that the agency knows you’ll ask them every time.
That changes the dynamic.
Next up: The Walled Garden — who really owns your ad accounts, your content, and your data when the relationship ends.
Subscribe below to get each new post as it drops.
Taylor Harrill is the founder of PixelPickers, a digital marketing agency built on radical transparency, shared risk, and partnerships where both parties actually win. If that sounds interesting, he’s always up for a conversation.
