NessReadyBot
User-agent: NessReadyBot/0.1 (+https://nessready.com/bot)
NessReadyBot fetches a small, bounded set of public pages and standard machine-readable
files (such as robots.txt, sitemap.xml, llms.txt,
/.well-known/ard.json) when a customer requests a report about a domain. It
reads at most a handful of pages per report and stores nothing publicly. Crawling honors
robots.txt: a User-agent: NessReadyBot group takes precedence over
*, with path-level Allow/Disallow (longest match, * and trailing
$ supported). Standard discovery files (robots.txt,
sitemap.xml, llms.txt, well-known paths) may still be fetched
directly, as they exist to be read — results go only to the customer who
requested the report.
Opt out: block the user-agent in your robots.txt
(User-agent: NessReadyBot / Disallow: /) or email
contact@nessready.com and we will exclude your
domain.