We've shipped two big improvements under the hood that make Brokenly faster and more reliable.
Faster, Smarter Crawling
The crawl engine has been rebuilt from the ground up. Links are now checked in parallel rather than one at a time, which means a typical affiliate site with hundreds of links goes from taking ~30 minutes down to just a few minutes. You'll also see live progress as the scan runs — pages found, links checked, and issues detected update in real time instead of showing zeros until completion.
The new engine also respects robots.txt, handles sitemaps more reliably, and applies per-host rate limiting so scans are polite to the sites they check.
More Accurate Amazon Health Checks
Amazon's product pages return HTTP 200 even when a product doesn't exist — which meant broken Amazon links were previously slipping through as healthy. Brokenly now verifies Amazon products directly against their real availability instead of trusting the HTTP response alone. We now correctly detect:
- Unavailable or discontinued products — flagged so you can update or remove the link
- Ghost products — items that never existed or have been fully delisted, now correctly marked as broken instead of out of stock
- Search result redirects — intentional links to Amazon search pages are treated as healthy, so you won't get false positives
These changes mean your broken link reports are significantly more accurate, especially if you run an Amazon affiliate site.