Crawlers & user agents

PintellyBot and Pintelly's other user agents

If you saw one of these in your server logs, this page explains who sent the request, why, how often, and how to stop it.

Our user agents

PintellyBot

User agent

PintellyBot/1.0 (+https://pintelly.com/bot)

What it does: Fetches pages, robots.txt and sitemaps of sites whose owners added them to Pintelly, to verify SEO findings server-side and run a technical audit (server response, content, SSL/TLS, redirects, security headers).
When it visits: Only for domains a Pintelly customer added. A single-page audit runs up to three times a day. Concurrency is capped per domain, and slow (over 3 s) or failing hosts automatically get a quarter of the normal crawl budget.
robots.txt: Respected. A User-agent: PintellyBot group is used if present, otherwise the * group. Blocked pages are not fetched.

Pintelly-Uptime

User agent

Pintelly-Uptime/1.0 (+https://pintelly.com/bot)

What it does: Uptime monitoring: requests one URL a Pintelly customer monitors and records the status code and response time. Only response headers are read.
When it visits: At the interval the customer set for that monitor (typically every minute or few minutes).
robots.txt: Not applied: the site owner set up the monitor for that URL.

Pintelly-Verifier

User agent

Pintelly-Verifier/1.0 (+https://pintelly.com/bot)

What it does: Domain ownership check: reads the homepage meta tag or /feedback-verify.txt to confirm a Pintelly customer controls the domain.
When it visits: Only when someone clicks verify in Pintelly; HTTPS first, then HTTP.
robots.txt: Not applied: a single request the domain owner started.

PintellySeoChecker

User agent

PintellySeoChecker/1.0 (+https://pintelly.com/bot)

What it does: Fetches one page when someone runs the free SEO checker on it. Its robots.txt and sitemap reads go out as PintellyBot.
When it visits: Only when a person submits that URL. Free checks are limited per site per day.
robots.txt: Read and reported in the result, because a person asked for that exact page.

PintellySiteCheck

User agent

PintellySiteCheck/1.0 (+https://pintelly.com/bot)

What it does: The free SSL, security headers, redirect, DNS and WHOIS checks: a TLS handshake, a few HTTP requests following redirects, or registry lookups.
When it visits: Only when a person submits that URL. Five free checks per site per day.
robots.txt: Not applied: each request is one URL a person asked for.

PintellyA11yCheck

User agent

Mozilla/5.0 … Chrome/… PintellyA11yCheck/1.0 (+https://pintelly.com/bot)

What it does: The free accessibility check. Opens the page in headless Chromium and uses it like a tester: presses Tab and single keys, opens menus, presses Escape, and submits one empty form. While that form is submitted every network request is blocked, so nothing is sent to your server.
When it visits: Only when a person submits that URL. Five free checks per site per day.
robots.txt: Not applied: each scan is one URL a person asked for.

Pintelly-Monitoring

User agent

Pintelly-Monitoring/1.0 (+https://pintelly.com/bot)

What it does: Looks up domain registration data (RDAP) at domain registries for customers' domain-expiry monitoring. It does not request your website.
When it visits: Periodically, for domains a Pintelly customer monitors.
robots.txt: Not applicable: the requests go to registries, not your site.

Any other request from Pintelly's servers to a website carries Pintelly/1.0 (+https://pintelly.com/bot).

Block or limit PintellyBot

Add a group for PintellyBot to your robots.txt. To keep it out of part of the site, list only those paths.

User-agent: PintellyBot
Disallow: /

User-agent: PintellyBot
Disallow: /account/
Disallow: /checkout/

The on-demand checks

The other user agents fetch only the URL someone typed into a Pintelly tool. To refuse them, block the user agent at your server or firewall; the result for that person will show the site as unreachable.

Something wrong?

If a Pintelly user agent misbehaves on your site, tell us with the time, the URL and the user agent from your logs.