TvijoAuditBot crawler policy
TvijoAuditBot performs passive technical audits of public web pages so a site owner can see what search engines and AI assistants read. This page exists because a crawler that visits sites nobody asked it to visit owes them a plain explanation and a way to say no.
User agent
TvijoAuditBot/1.0 (+https://tvijo.com/en/crawler-policy)
What it requests
The homepage, robots.txt, up to two sitemap documents, llms.txt, at most twenty same-origin HTML pages and a sample of internal links. Nothing else: no ports, no subdomain enumeration, no forms, no logins, and it never calls the endpoints it discovers.
How to block it
Add a group for TvijoAuditBot in robots.txt with Disallow: / — it is read before anything else, and a blocked site is neither fetched nor published. Crawl-delay is honoured within reason.
How often
A visitor-triggered check runs once and reuses its result for a short window. Unverified domains are not re-checked more than once every 30 days.
What is stored
Derived metrics: scores, findings, page-level counters, a content hash and short evidence fragments. The pages themselves are not archived, and secret-shaped strings never appear on a public card.
Corrections and removal
Any domain card can be corrected or removed on request. Disputed cards leave the ranking immediately; personal and non-commercial domains are removed without discussion.
Contact
Write to the address on the contact page with the domain and the report link. Abuse reports about crawler behaviour are answered first.