Checklists
Robots.txt for AI crawlers: the complete config checklist (2026)
A tier-coded, browser-saved 22-item checklist for configuring robots.txt for GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and CCBot — without accidentally taking yourself out of Google search.