Most site owners only think about indexing when traffic drops. By then a whole section of the site may have been missing from Google for months. A quick audit, done a few times a year, catches those gaps early. You don’t need an agency or a week of work. With a timer, a spreadsheet, and access to your site’s data, you can get a clear picture in half an hour.
Here is a routine broken into four short blocks.
Before you start the clock
Have these ready so you don’t waste time searching for them:
- Your XML sitemap URL (often /sitemap.xml or /sitemap_index.xml )
- Access to Google Search Console for the property
- A blank spreadsheet with tabs named “Numbers,” “Reasons,” “Samples,” and “To do”
If you don’t have Search Console set up, do that first. It’s the only place Google tells you directly how it sees your site, and the rest of this audit leans on it.
Minutes 0–5: Get your two baseline numbers
You need to compare what you want indexed against what Google has indexed.
Number one: pages you want in Google. Open your sitemap and count the URLs. Most sitemap plugins show a count per sub-sitemap, so add those up. If your sitemap includes pages you don’t care about (tag archives, thin author pages), note that, because it’s a problem in itself.
Number two: pages Google has indexed. In Search Console, open Indexing > Pages and write down the “Indexed” figure. You can also filter that report by sitemap to see how many of your submitted URLs made it in.
Put both numbers side by side. A small gap is normal. Google doesn’t promise to index every page it finds, and it decides what’s worth keeping. A large gap, say half your sitemap missing, tells you where the next 25 minutes should go.
Skip the site:yourdomain.com result count for this step. That number is a rough estimate and can swing a lot from one search to the next.
Minutes 5–15: Read the reasons, not just the totals
Scroll down the Pages report to the table of reasons pages aren’t indexed. This is the most useful part of the audit. Copy each reason and its count into your “Reasons” tab.
Group them into three buckets:
- Intentional. “Excluded by noindex tag,” “Alternate page with proper canonical tag,” “Page with redirect.” If these are pages you meant to keep out, they’re fine. Glance through the examples to make sure nothing important slipped in by mistake.
- Technical errors. “Not found (404),” “Server error (5xx),” “Blocked by robots.txt.” These usually point to something broken that you can fix directly.
- Google’s choice. “Crawled – currently not indexed” and “Discovered – currently not indexed.” Here Google knows the pages exist but hasn’t added them. That’s usually about quality, duplication, or how much attention the site gets from crawlers.
The third bucket is where most real indexing problems live, and it’s the hardest to fix, so pay attention to how big it is.
Minutes 15–25: Spot-check by page type
Totals hide patterns. Your blog posts might be fully indexed while your product or location pages are mostly ignored. To find that out, sample by template.
Pick five to ten URLs from each main page type on your site, such as:
- Blog posts
- Category or collection pages
- Product or service pages
- Landing pages built for ads or campaigns
Paste the full list into an indexation checker to see which ones Google currently has, then log the results in your “Samples” tab. You can use URL Inspection in Search Console for the same job, but it handles one URL at a time, which eats into a 30-minute budget fast.
Look at the result for each page type as a whole. If eight of ten blog posts are indexed but only two of ten product pages are, you’ve found the section that needs work. Then open a couple of the missing pages and ask honest questions: Is the content thin or nearly identical to other pages? Is the page linked from anywhere on the site, or only from the sitemap? Is there a stray noindex in the page source?
A quick way to check that last one is to view the source and search for:
<meta name=”robots” content=”noindex
Minutes 25–30: Write the to-do list
Now turn your notes into actions. Keep it short and ordered by impact:
- Fix technical errors first. Broken pages, wrong robots.txt rules, and accidental noindex tags are quick wins.
- Clean up the sitemap. Remove URLs you don’t actually want indexed so the sitemap reflects your real priorities.
- Strengthen weak sections. For page types Google keeps skipping, improve the content, merge near-duplicates, and add internal links from pages that are already indexed.
- Set to re-check date. Put a reminder on your calendar for four to six weeks out, then repeat the same samples so you can see whether things moved.
How often to repeat it
For most small and mid-sized sites, once a quarter is enough. Run an extra audit after a redesign, a migration, a CMS change, or a big batch of new pages, since those are the moments when indexing problems tend to show up.
Wrapping up
A site indexing audit doesn’t have to be a big project. Compare what you submitted with what got indexed, read the reasons Google gives, sample each page type, and leave with a short list of fixes. Google will always make the final decision on what it indexes, but this routine makes sure you’re not losing pages to problems you could have fixed yourself.