Crawl Budget Waste Finder
Find URLs that waste your crawl budget, free, right in your browser.
A free Chrome extension that finds URLs on your site quietly wasting your crawl budget, things like sort filters, tracking links, and session IDs.
Version 1.0.1 for Chrome, Edge and Brave. No account needed.

Why this matters
Search engines only spend so much time crawling your site. If a lot of that time goes to filter combinations, tracking parameters, or duplicate pages, your real content gets less attention. This tool shows you exactly which of those URLs are already protected with a canonical tag, noindex, or robots.txt rule, and which ones are wide open for a crawler to waste time on.
What it does
- Detects your site automatically from the tab you have open, no typing needed
- Scans your whole site in one click, up to 5,000 pages
- Sorts every URL with a query string into tracking, sort or filter, or pagination
- Checks each one against its canonical tag, meta robots tag, and robots.txt
- Gives you a simple waste score, the percent of URLs left open for crawlers
- Handles JavaScript heavy pages by opening a hidden tab when needed
- Flags pages blocked by anti bot systems separately, so they do not throw off your numbers
- Keeps running in the background even if you close the popup
- Saves progress automatically, and lets you resume after closing the browser
- Lets you export just one category or everything as an Excel file
- Lets you export a full PDF report
- Everything stays in your browser. Nothing is sent to any server
- Completely free, no account and no activation code needed
How to install Crawl Budget Waste Finder
It takes about a minute. You only do this once.
- Download the zip file with the button on this page and unzip it. You will get a folder called
crawl-budget-waste-finder. - Open the extensions page. In Chrome, type
chrome://extensionsin the address bar and press Enter. In Edge useedge://extensions, in Bravebrave://extensions. - Turn on Developer mode with the switch in the top right corner.
- Click Load unpacked and choose the unzipped folder (the one that contains
manifest.json). - Pin the icon from the puzzle piece menu in your toolbar, so it is always one click away.
What the permissions are for
Chrome shows these when you install. Here is what each one is used for.
| storage | Save your settings and scan results in your browser. |
|---|---|
| unlimitedStorage | Store results for large sites with thousands of pages. |
| downloads | Save Excel and PDF reports to your computer. |
| tabs | Read the address of the tab you have open, so it knows which site to scan. |
| scripting | Read links on pages that need JavaScript to show them. |
| Access to websites | Load the pages of the site you scan, the same way a crawler does. |
Questions
Is Crawl Budget Waste Finder free?
Yes. It is free to download and use, and the code is open source under the MIT license. You do not need an account, a subscription or an activation code.
Where are my results stored?
Your scan results and settings are saved in your own browser. The extension does not ask you to sign in, and you can delete everything by removing the extension.
Which browsers does it work in?
Google Chrome, and other browsers built on Chromium such as Microsoft Edge and Brave.
How do I fix the URLs it finds?
For each URL it shows whether it is already handled by a canonical tag, a noindex tag or a robots.txt rule. The ones marked as open are the ones to fix first.
How do I update it?
Download the latest zip from this page, replace the old folder with the new one, and click the reload button on the extensions page.
More free SEO extensions

Orphan Page Finder
Finds pages in your sitemap that no internal link points to.

Click Depth Mapper
Shows how many clicks each page is from your homepage.

Canonical Chain Tracer
Follows canonical tags and finds chains and loops.

Two MB Crawl Limit Monitor
Finds pages close to or over Googlebot's 2MB crawl limit.

Full Site Cache Auditor
Runs 54 checks on caching, CDN and DNS.

Full Site Security Auditor
Runs 47 security, DNS and CMS checks.