How Do We Measure SEO Success in the Age of AI?

Today, many marketers and SEO teams share the same worry: How do we know whether organic search is still working now that AI summaries and Zero-Click results are everywhere?

For many years, the definition of “search success” was simple and familiar:

  • More free traffic from search engines
  • More sessions on the website
  • And the magic sentence: “We’re now #1 in the rankings.”

But now the picture has changed:

  • Traffic is flat or slightly declining
  • AI summaries are answering users directly.
  • A significant share of searches ends with no clicks at all.

So the famous question appears: “Has organic search died?”

The short answer: Search visibility hasn’t died… but the way we measure it is outdated.

Where Is the Real Problem?

The core problem isn’t the search channel or SEO itself. The problem lies in the dashboard, which still relies solely on old metrics.

In the past, we thought like this: ranking is the goal, clicks are the proof of success.

But today:

  • Many people get their answer directly on the results page or from an AI summary
  • A large share of searches end without a visit to a website.

If we only focus on traffic, it will look like search is “failing”, even though the channel is often still:

  • Putting your brand name in front of people
  • Influencing purchase decisions
  • Bringing customers who say, “We found you through a search.”

The game has changed… but most reporting hasn’t caught up yet.

AI Summaries and Zero-Click: How Should We Think About Them?

We need to change the mindset: “No click” does not mean “no impact”.

When an AI summary appears:

  • The user often reads the summary and moves on
  • Clicks go down
  • But your brand name or product may be mentioned inside the answer.
  • Or the summary may be built using content from your site.

This means:

  • Your brand is still earning trust and awareness, even if that value doesn’t appear as a “session” in your analytics.

That’s why it’s dangerous to judge the search channel only by the number of clicks.
We need to zoom out and look at:

  • Revenue
  • Pipeline and opportunities
  • Demand for the brand
  • Real engagement

 

The Story Behind the “Impressions Crash” and the change to ?num=100

There’s also a technical point that gave many marketers a headache:

What used to happen?

Google typically shows about 10 results per page.

For many years, many specialists and tools would add ?num=100 to the search URL to show around 100 results per page.

  • Analytics tools and rank trackers loved this approach.
  • Side effect: all 100 results were counted as impressions in reports
  • Even results on very low positions (that almost no real user scrolls down to)
  • And many of these “views” came from automated tools, not real people.

What did Google do recently?

Google effectively stopped supporting this way of loading 100 results at once. The way impressions are counted has become stricter and more closely aligned with reality.

The result:

  • Impressions dropped sharply in many reports
  • The average position started to look better.
  • But real clicks and visits stayed almost the same for many businesses.

In simple terms, the measurement method changed, not necessarily the channel’s performance.

How Do We Deal With This Change?

Three simple steps:

  1. Don’t panic.
    If clicks, leads, and revenue from organic search remain healthy, the issue is likely a change in how they’re counted, not the collapse of the channel.
  2. Draw a new line in the sand.
    Treat your charts as having two eras: “before the change” and “after the change”.
    Add a clear note in any report that goes to leadership.
  3. Use this moment to upgrade your reporting.
    Shift the conversation from “We lost 60% of our impressions!” to “Business outcomes from organic search are stable or improving… the old numbers were inflated in the first place.”

How Should We Measure Search Visibility Today?

Instead of starting from “traffic” and “rankings”, start from one simple question:

“If organic search performs extremely well for us this year… what changes in the business itself?”

The answers are usually things like:

  • We get better leads or more sales
  • Customer acquisition cost (CAC) goes down.
  • More people have heard of us before we contact them.

Once we define what should change in the business, we turn that into practical metrics.

We can group measurements into four main buckets:

  1. Revenue & pipeline
  2. Cost & efficiency
  3. Brand demand & visibility
  4. Engagement & intent

1) Revenue and Pipeline

Here we ask questions like:

  • How much revenue came from customers who said they first discovered us via search?
  • How many deals or leads started from an organic search visit?
  • At which stages of the customer journey did organic search contribute, even if it wasn’t the last click before purchase?

2) Cost and Efficiency

We compare search with other channels:

  • Is a qualified lead from organic search cheaper than one from paid ads?
  • What is our customer acquisition cost from organic vs. other channels?

3) Brand Demand and Visibility

Here we evaluate things like:

  • Is the number of people searching for our brand name increasing over time?
  • Are we visible on the main high-intent keywords in our category?
  • Are direct visits (people typing our URL directly) trending upward?

4) Engagement and Intent

Among visitors coming from search:

  • How many start a trial, sign up, or book a call?
  • Do they visit key pages like product, pricing, and comparisons?
  • Do they come back for a second and third visit?

When Can We Say the Search Channel Is “Working Well”?

If these four areas:

  • Revenue & pipeline
  • Cost & efficiency
  • Brand demand
  • Real engagement

Are in a good place, stable or improving, then the search channel is genuinely working for the business… even if the traffic chart in Google Analytics isn’t shooting up like a rocket. In the end, the real question is: Is organic search helping us make money, attract better customers, and grow efficiently?

A One-Page Report for Leadership

To keep the discussion with executives clear and simple, you can design a one-page report divided into four sections:

1) Business Outcomes

  • Revenue from customers who discovered us first via search
  • Value of opportunities (pipeline) created or influenced by organic search
  • Cost per qualified lead from organic vs. paid channels

2) Brand Demand and Reputation

  • Trend of branded search (last 3–6 months, for example)
  • Trend of direct traffic to the site
  • Are we visible on page one, or in AI/Smart Summaries, for our core topics?

3) Engagement and Conversion

  • Number of trials, sign-ups, and booked calls from search visitors
  • Number of repeat visits from the same users coming via search
  • Top 3–5 pages most often visited by people who later became customers.

4) Context and Explanation

A short note explaining:

  • The impact of AI summaries
  • Zero-Click behaviour
  • Changes in how impressions are counted

With a clear message: “These factors changed the way the numbers look, but what matters is: what has actually changed in our results?”

Once leadership sees this page, the conversation shifts from “Our impressions collapsed!” to “How much revenue is search generating, and at what cost?” which is the more important question.

How to Respond to an Executive Who Says: “Search Is Dead After AI”

You can answer calmly and logically: people still ask, research, and compare solutions.

The difference is that today they’re doing it across search engines and AI tools, not just by visiting websites. Our job is to make sure that when they ask those questions, we are the brand they see, and that those moments turn into real opportunities and revenue.”

Then support this with your own numbers:

  • A clear percentage of new revenue last quarter was search, which was part of the journey
  • A higher conversion rate from leads who found you via search compared to other sources
  • A lower cost per qualified customer from organic search than from paid campaigns

This way, you’re not defending “rankings” as a vanity number; you’re defending a profitable acquisition channel.

Three Simple Steps to Start Today

  1. Write an internal definition of success for organic search.
    For example:  “We consider organic search successful when it helps us generate higher revenue, better-quality leads, and a lower customer acquisition cost.” Share this sentence with the team so everyone is aligned.

  2. Ask for a redesigned search/SEO report.
    Ask your team or agency to:

    • Start the report with revenue, pipeline, and cost per lead.
    • Then cover: brand demand and engagement.
    • Keep traffic, rankings, and impressions as supporting context, not the headline.

  3. Add the question “How did you hear about us?” everywhere.
    On website forms, in sales calls, etc. Every month, collect the answers and review them together (marketing + sales). You’ll be surprised how often you hear: “I found you on Google” or “I saw one of your articles while I was searching.”

You don’t need to understand every technical detail of SEO. What you do need is a new perspective: less focus on clicks and more on tangible business outcomes. And keep asking:

“How is organic search helping us grow in a healthy, sustainable way?”

If you can answer that question with real numbers, then you’re measuring search the right way, even in the age of AI and Zero-Click search.

Podcast

Watch more Episodes

Ready to grow with intention and performance in mind

We design solutions that move you forward, and deliver measurable impact.