Crawler

PathpipeBot

The robot that reads public job openings for pathpipe. Here is what it does and how to stop it.

Last updated 17 October 2026

Who it is

It identifies itself with the user agent PathpipeBot/1.0 (+https://pathpipe.app/bot).

It is run by the publisher of pathpipe (see the legal notice).

What it reads

Public job openings only: the job board APIs that applicant tracking systems publish for this purpose (Greenhouse, Lever, Ashby and similar), a few public job feeds, and company careers pages.

It never logs in, never submits forms and never collects personal data.

How often

Each board is refreshed a few times a day. It waits at least 0.8 seconds between two requests to the same host, honours Retry-After on HTTP 429, backs off on server errors, and stops calling a host that keeps rate-limiting it.

robots.txt

On company websites it follows robots.txt, including Crawl-delay. To block it, add this to your robots.txt:

Public ATS job board APIs are read as documented APIs. To be left out of those, email us.

User-agent: PathpipeBot
Disallow: /

Opt out or report a problem

Email [email protected] with the domain or board to exclude. Requests are handled within a few days.