The Vanity Mirror: Why Your Marketing Report Always Looks Good
The report lands in your inbox on the first of the month. Impressions: up. Reach: up. Engagement rate: up. Your account manager walks you through it on a call, upbeat, confident. You hang up feeling like things are moving.
Three months later, the phone isn’t ringing any more than it was before.
You’ve been looking in a vanity mirror. And what it showed you wasn’t a lie — it just wasn’t real.
Cherry Picking is about what gets left out of reports. This is about what gets included that shouldn’t matter.
How It Works
The Vanity Mirror is the use of metrics that feel meaningful but have no direct connection to business outcomes. Impressions. Reach. Follower count. Engagement rate. Brand awareness scores. These are real measurements of real things. They’re just not measurements of the thing you actually care about: whether your business is growing.
Agencies lean on vanity metrics for a simple reason — they’re easy to produce and hard to argue with. If your goal is to drive more patients into a dental clinic, a 40% increase in Instagram reach sounds like progress. It might be. It might also be completely irrelevant. The number itself doesn’t tell you which.
Here’s how it plays out in practice:
Reach without conversion. Your social posts are reaching more people. Great. Are those people in your service area? Are they in a demographic that buys what you sell? Are any of them clicking through, calling, or walking in? Reach measures how many eyeballs hit your content. It says nothing about whether those eyeballs belong to anyone who matters to your business.
Engagement without intent. Your posts are getting likes and comments. People are engaging. But engagement on social media is driven mostly by entertainment, relatability, and novelty — not purchase intent. The post that got your highest engagement this month might have been a meme that attracted people who will never spend a dollar with you.
Impressions without context. An impression is counted every time your content is technically displayed on a screen, whether or not anyone actually looked at it. Impression counts can be inflated by content that appeared briefly in someone’s feed while they were scrolling at speed. The number is real. Its relationship to actual human attention is loose.
Follower growth without quality. Your follower count went up by 300 this month. Who are they? Where are they? Did your agency run a giveaway or a broad follow campaign that attracted people with no interest in your product? Follower count as a metric for business health is only useful if the followers are real, local, and relevant. That qualifier is rarely included in the report.
| What the report shows | What you should be asking |
|---|---|
| Impressions | How many of these people are in my service area — and did any of them take action? |
| Reach | Did anyone who saw this click, call, or walk in? |
| Engagement rate | Are the people liking and commenting likely to spend money with me? |
| Follower count | Who are these followers — are they local, relevant, and real? |
| Brand awareness score | How does this connect to leads or revenue? |
How to Spot It
The clearest sign of the Vanity Mirror is a report full of metrics that trend upward but can’t be connected to anything you’d actually call success.
Ask yourself: if every number in this report doubled next month, would my business be noticeably better off? If the honest answer is “I’m not sure,” the report is showing you the wrong numbers.
If every number in this report doubled next month, would my business be noticeably better off?
More specific tests:
Can you draw a line from this metric to revenue? Not a vague theoretical line. A real one. “We increased reach, which means more people know about us, which might mean more of them call eventually” is not a line — it’s a hope. A line looks like this: “We drove X clicks to the booking page, Y of them completed a booking, and each booking is worth $Z to you.”
Is the agency defining success or are you? If you never sat down at the start of the engagement and agreed on what success looks like — in terms of leads, sales, bookings, or revenue — then the agency will define it for you. And they’ll define it using metrics they can hit.
What’s missing from the report? Every report makes choices about what to include. Ask about what isn’t there. If you’re running a local service business and the report doesn’t include phone call tracking, form submissions, or website conversions, you’re not being shown the numbers that matter.
How to Protect Yourself
Define your outcomes before the engagement starts. The most important conversation you can have with a marketing agency is not about strategy or tactics — it’s about what success looks like in concrete, measurable terms. Write it down. Agree on it. Make it part of the contract if you can.
Good outcome metrics for most small businesses: inbound leads (calls, form fills, bookings), cost per lead, conversion rate from lead to sale, and revenue attributable to marketing activity. These are harder to hit than vanity metrics, which is exactly why they’re the right ones to require.
Ask for a direct line between activity and outcome. For every tactic the agency proposes, ask: how will we know if this is working? The answer should be specific. “We’ll see increased brand awareness” is not specific. “We’ll track calls from the campaign using a dedicated phone number, and report on call volume and conversion rate monthly” is specific.
Don’t let the agency own the analytics. Every platform your agency uses on your behalf should have you set up as an owner or admin — not just a viewer, not just a shared dashboard. If you own the data, you can ask your own questions of it. If the agency owns the data, you can only ask the questions they’ve prepared answers for.
Establish a baseline. Before any marketing work begins, document where you are: how many leads you’re getting per month, what your close rate is, what your average transaction value is. Without a baseline, there’s no way to measure whether anything improved. Agencies who discourage this conversation are telling you something.
Vanity metrics aren’t always used cynically. Sometimes they’re used because they’re easy to track and easy to report, and no one ever stopped to ask whether they mattered. But the effect is the same either way: you think you’re making progress while your actual business outcomes stay flat.
The mirror shows you what you want to see. That’s the whole problem.
The mirror shows you what you want to see. That’s the whole problem.
Next up: The Jargon Curtain — how agencies use complexity and language to keep you dependent and confused.
Subscribe below to get each new technique as it drops.
Taylor Harrill is the founder of PixelPickers, a digital marketing agency built on radical transparency, shared risk, and partnerships where both parties actually win. If that sounds interesting, he’s always up for a conversation.
