Crawl budget is the most over-discussed non-problem in SEO. For a blog with 80 posts, Google will happily crawl everything, nightly, without ceremony. But at some scale — thousands of URLs, faceted navigation, generated pages — the bot's daily allowance starts making editorial decisions on your behalf. That's when it matters.
The signs it's costing you
Three symptoms, all visible in Search Console. First: fresh or updated pages taking weeks to appear in the index. Second: the Crawl Stats report showing most requests hitting parameter URLs, filters or tag archives instead of content. Third: important pages sitting in "Discovered — not indexed" while junk gets crawled daily. Any one alone is suggestive; all three together is a diagnosis.
Where budgets actually leak
Faceted filters are the classic hemorrhage — a store with 5 attributes and 10 values per attribute can generate millions of crawlable URL combinations from one product set. Calendar pages that paginate forever, session IDs in URLs, and internal search results indexable by bots all leak the same way. Each wasted fetch is a fetch not spent on your money pages.
The fixes, in order of impact
Block worthless URL patterns in robots.txt (filters, sort orders, search results). Add noindex, follow to thin utility pages that must stay crawlable but never belong in the index. Kill infinite calendars. And clean the sitemap: it should contain only canonical, index-worthy, recently-changed URLs — a sitemap is a recommendation list, not an archive of everything that ever existed.
Below roughly a thousand URLs? Do nothing. Genuinely: nothing. Your crawl budget is not binding, and time spent optimizing it is time stolen from content. Above it, check the Crawl Stats report quarterly — the bot's attention is a resource, and resources deserve a budget owner.
