How search decides what to show

Understand discovery, indexing and ranking, then diagnose why a business page is missing, overlooked or attracting the wrong visitors.

By The SEO Blog editorial team Updated 3 min read
On this page
  1. Discovery: does the engine know the address?
  2. Crawling and indexing: can the page be understood?
  3. Ranking: useful for which search?
  4. A position is a measurement with conditions
  5. AI answers add another outcome to observe
  6. Choose the next task from the evidence

Search visibility has several stages. A search engine must find a page, access it, decide whether to index it and decide when it is useful to show. A business then needs that visitor to understand the offer and take a suitable next step.

Keeping those stages separate makes troubleshooting much easier. A blocked page and an indexed page that answers the wrong question need different work.

Discovery: does the engine know the address?

Links and sitemaps help search engines discover URLs. Discovery is not the same as a visit from a crawler. An address can be known before its content has been fetched.

Our first check is whether an important page is linked from a relevant part of the website. A service page hidden behind an internal search box may be difficult for people to find too. Include the intended public URL in a maintained sitemap, but do not treat submission as an instruction to rank it.

Read our sitemap guide for a practical check.

Crawling and indexing: can the page be understood?

Crawling fetches the page; indexing involves analysing its content and deciding how to store it. Google may also select a canonical version where several URLs represent similar content. Not every discovered or crawled page is indexed. Google's explanation of how Search works describes these stages.

For one important URL, inspect its status in Search Console. Check access errors, indexing instructions and the canonical Google selected. Compare the recorded crawl with the live page if you have recently made changes.

Do not diagnose every missing page as “low quality”. A mistaken noindex instruction, a failed server response or a duplicate URL requires a more specific explanation.

An indexed page can be relevant to one question and unsuitable for another. Google describes multiple systems, including language understanding, link analysis and passage ranking, in its ranking systems guide. That overview is not a public formula for assigning each signal a weight.

Keywords still help you state the subject. They are not a substitute for answering it. If a person searches for repair prices, a page describing company values may leave the buying question unanswered.

Our recommendation is to read the page alongside the query you want it to serve. Ask what a customer would still need to know: suitability, location, cost factors, availability, evidence or how to enquire. Improve the missing information before repeating the same term more often.

A position is a measurement with conditions

The results you see can depend on factors including the query, location and device. Keep those conditions in your records.

Search Console's average position aggregates impressions within the selected reporting scope. A rank tracker may instead report a sample collected at a specified time and location. Those are different measurements; neither represents every person's experience. Google's Performance report documentation explains its own metrics.

For a local business, distinguish a map result from an ordinary website result. See our Suffolk local SEO checklist.

AI answers add another outcome to observe

A citation in an AI answer is different from a conventional search position. Products vary in when they search, which sources they show and how their answers change. Do not assume one assistant's behaviour describes all of them.

Start with our AI citation guide, which separates documented access requirements from editorial recommendations and explains a repeatable way to sample mentions.

Choose the next task from the evidence

Our suggested order is:

  1. Page cannot be accessed: investigate the technical failure.
  2. Page is excluded unexpectedly: inspect the stated reason and canonical.
  3. Page is indexed but attracts unsuitable searches: reassess its purpose and wording.
  4. Relevant visitors arrive but do not enquire: examine the offer, proof and contact route.
  5. Enquiries arrive but do not become work: review suitability and follow-up with the business.

Record the change and the baseline. Allow for reporting delays, seasonality and other changes before claiming an effect. Our Fleetalyse measurement example shows why impressions, clicks and reported sales need to be interpreted separately.

The SEO basics reading path helps put this into order. For implementation, our sister agency Suffolk Web provides search support.

You might also like

Guides

Does blogging still work for businesses?

Decide whether your business needs a blog, choose useful topics and measure the result without turning publishing frequency into the go...

3 min read

The SEO Blog, in your inbox

A fresh perspective.
In your inbox.

Practical search explanations, evidence from real projects and a useful next step for your website. Receive article updates as we publish.

Read a sample article update →

Protected by Cloudflare Turnstile. If the security check does not load, refresh the page or contact us by email.

By subscribing, you agree to receive article updates. Confirm your email to join. Unsubscribe any time. Privacy notice.