Google Finally Gave Us AI Search Data. It Tells Us Almost Nothing.

Google just rolled out its AI performance reports in Search Console to every site on earth. If you have spent the last year squinting at your traffic and wondering what AI Overviews were doing to it, this feels like the moment someone finally turned the lights on.

I want to talk you out of that feeling. A little.

Not because the data is useless. Because the story everyone is telling about it, that we can now measure our performance in AI search, is mostly wishful thinking dressed up as a feature release. New numbers on a screen are not the same thing as understanding. And this particular set of numbers is built to look more useful than it is.

Everyone is treating a thermometer like an MRI

Here is the belief I keep hearing this week: now that Search Console tracks AI Overviews and AI Mode impressions, we can finally optimize for AI search the way we optimized for regular search.

Okay. Compared to what, exactly?

The report tells you that your site appeared in AI experiences and roughly how often people clicked through. That is a temperature reading. It says the patient has a fever. It does not tell you why, where it came from, or what to do about it. A thermometer is not an MRI, and we should stop pretending Google handed us a diagnostic machine.

What you actually get is impressions and clicks tied to AI surfaces, folded into the same interface you already know. That is genuinely nice. It is also the least honest kind of data, the kind that feels precise because it comes with a chart, while hiding the fact that it answers none of the questions you actually have.

New numbers on a screen are not the same thing as understanding.

The question you have is not "did I show up in an AI answer." The question is "did showing up there help my business or quietly replace a visit that used to come to my site." The report does not touch that. It cannot. And most of the excited posts I have read this week skip right past it.

The blend is the whole problem

Let me be specific about what bothers me, because vague skepticism is just cynicism with better posture.

The way this data has been surfaced, AI clicks and impressions get blended into your overall Search performance rather than cleanly separated into their own bucket you can slice however you want. So when you look at your totals, AI activity is baked in. You are seeing a smoothie and being asked to tell me how many strawberries were in it.

Why does that matter? Because the entire game right now is understanding substitution. When an AI Overview answers someone's question at the top of the page, sometimes they click through to you. Often they don't, because they got what they needed. That second group is the one keeping marketers up at night, and it is exactly the group a blended impressions number is worst at revealing.

An impression in an AI Overview is not the same event as an impression in a classic blue link result. One might be a citation buried in a collapsed answer that nobody expands. The other might be the thing a person actually clicked. Counting them in the same column and calling it visibility is like counting a billboard nobody drove past and a billboard on Times Square as "two billboards." Technically true. Practically nonsense.

What the number quietly leaves out

Data has a way of directing your attention to whatever it can count and away from whatever it can't. That is not a bug. It is the nature of measurement, and it is the most dangerous thing about any new report.

So here is what this one does not show you, and what you will forget it doesn't show you within about a week of staring at it.

It does not show you the queries you lost entirely. If AI answers a question so completely that your page never even enters the running, that is not a low click through rate you can see. It is an absence. And absences do not appear in dashboards. They just look like a flat line where growth used to be.

It does not show you what happened inside the AI answer. Were you cited by name in a way that built trust? Were you paraphrased into a sentence that stripped your brand off entirely? Both can register as your content being "used." Only one of them does anything for you.

It does not show you the visits that never became sessions in the first place. Someone reads an AI summary of your pricing, your hours, your take on a topic, decides, and moves on. You were useful. You got nothing measurable. The report is silent on the most common outcome of the AI era.

Absences do not appear in dashboards. They just look like a flat line where growth used to be.

I am not saying Google is hiding this out of malice. I am saying the tool measures what is convenient to measure, and convenient is not the same as important. Never has been.

Why this feels familiar

We have run this exact play before. When Google moved everyone to GA4, half the industry treated the migration like an upgrade in understanding. It was not. It was a change in how things were counted, with a new vocabulary, a steeper learning curve, and a lot of people quietly recalibrating their sense of what "good" looked like because the numbers had shifted under them.

Some folks got smarter. Most just got new charts and the same old confusion, plus a few months of arguing about why their sessions didn't match.

The AI reports are going to follow the same arc. There will be a wave of screenshots. There will be a wave of hot takes about what the AI Overview numbers "reveal." And then, six months from now, most people will still be unable to answer the only question that pays the bills: is AI search making me money or costing it?

That is not a knock on the people. It is a knock on treating a data source as a strategy. A hammer is not a house. A report is not a plan.

How I would actually use it

Now let me be fair, because I promised you a point of view, not a sulk. The report is worth opening. It is just worth opening with the right expectations, which is a phrase that has saved more marketing budgets than any tactic I know.

Use it as a trend line, not a scoreboard. If your AI impressions are climbing while your clicks stay flat or fall, that is a signal worth investigating, not a verdict. It tells you the shape of the problem so you can go find the substance of it somewhere else.

Pair it with the stuff Google will never show you. That means your own first party data. What are people asking your sales team that they used to ask Google? What do new customers say when you ask how they found you and half of them shrug and say "I think I read about you somewhere"? That shrug is the AI era. Learn to hear it.

Watch behavior, not just visibility. If the visitors who do still arrive are more informed, further along, closer to buying, then AI answers might be doing your top of funnel work for you and sending you the warm ones. That would be a good thing hiding inside a scary looking traffic dip. You will never see it in an impressions column. You will only see it in what happens after the click.

And treat every number in that report as the start of a question rather than the end of one. The report says what. Your job is why. Google is not going to do that part, and honestly, you would not want a competitor's tool defining your reality for you anyway.

The trap dressed as a gift

Here is the thing I really want you to sit with. Free data from the platform you are trying to understand is never neutral. It shows you the version of the world the platform is comfortable with you seeing.

Google benefits when you believe AI search is measurable, manageable, and basically fine. A tidy report that says "look, you still have visibility" is reassuring. It keeps you invested. It keeps you optimizing. It keeps you from asking the harder question, which is whether the whole relationship between your site and search is being quietly rewritten while you admire the new charts.

I am not a conspiracy guy. I do not think there is a room where they plot this. I think incentives do the work quietly, the way water finds the low ground. The report will make you feel informed. Feeling informed and being informed are cousins, not twins, and the gap between them is where a lot of good businesses get blindsided.

Feeling informed and being informed are cousins, not twins.

What smart teams do with less

The clients I have watched handle this shift well have one thing in common, and it is not a better dashboard. It is that they stopped organizing their entire sense of performance around Google's account of it.

They built things Google's report cannot measure and cannot take. An email list of people who want to hear from them directly. A brand people search for by name instead of by category, which is the single strongest signal in a world of AI intermediaries, because AI still has to reckon with what people specifically ask for. Content that is genuinely worth citing, so that when an AI does answer with your material, your name rides along instead of getting scrubbed off.

None of that shows up cleanly in the new AI report either. That is the point. The most valuable work you can do right now is largely invisible to the tool everyone is celebrating this week. If you let the report define your priorities, you will spend your energy on what it can see, and starve the stuff that actually protects you.

So open it. Read it. Learn the shape of your AI visibility. Just don't confuse the map with the territory, and definitely don't confuse a thermometer with a cure.

Google gave us a new number. That is not the same as giving us an answer. The answer is still where it has always been, out in the messy world of real customers and real decisions, and no report is going to hand it to you on a chart.