Crawl budget, explained
Search engines do not crawl every page every day. They balance how much your server can handle with how much they want your content.
For a small site of a few hundred pages, crawl budget is rarely a problem. It matters on large sites with thousands of URLs, filters, search pages and duplicates.
Things that waste crawl budget include redirect chains, broken links, endless filter combinations, duplicate pages and slow servers.
You can help bots by keeping a clean sitemap, fixing broken links, using canonical tags and blocking low value URLs in robots.txt.



