Brimm // crawler

The BrimmAudit crawler

Identifies itself · obeys robots.txt · rate-limits

BrimmAudit is the crawler Brimm uses to read a website and audit it — only when that site's owner asks us to, by submitting the URL.

How it identifies itself

Every request Brimm makes carries a user-agent that names us and links back to this page, so you can always tell it apart in your logs:

User-agent (default)Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0 Safari/537.36 BrimmAudit/1.0 (+https://brimmapp.com/bot)

The browser portion is kept so we can read sites that block unfamiliar clients outright; the BrimmAudit/1.0 token is the part that identifies us. Operators can switch Brimm to a fully transparent, non-browser user-agent if they prefer.

How to allow or block it

BrimmAudit obeys robots.txt. To control it by name, target the BrimmAudit token. For example, to block it entirely:

robots.txtUser-agent: BrimmAudit Disallow: /

We honour Disallow rules for any page we discover while crawling, and we honour a Crawl-delay you set. The one page we always read is the exact URL the owner submits to us for an audit, because that is a direct, owner-initiated request for that page.

How politely it crawls

Questions or problems

If BrimmAudit is causing trouble, or you want it to stop, email hello@brimmapp.com and we will sort it out quickly.