Files
skills/public/robots.txt
zeekayandHanzo Dev 9e10c1c10e Each llms index points at the other two
hanzoskills.com/llms.txt now opens with the install line, the API
reference index and the company index, so an agent that lands on any
one of the three can find the rest.

robots.txt claimed 537 documents while llms.txt counts 920. The number
is gone from robots.txt; llms.txt derives it.

public/ is regenerated from scripts/site.py, which it had fallen
behind: the copy-prompt menu and agent bar were in the generator and
not in the committed pages. tests/site.mjs passes against the result.

Co-authored-by: Hanzo Dev <[email protected]>
2026-09-11 00:27:59 -07:00

94 lines
1.6 KiB
Plaintext

# hanzoskills.com — documents for agents to read.
#
# We build AI. Reading this site with one is the point. Every crawler named
# below is welcome on every path, and so is every crawler not named below.
#
# Content signals (https://contentsignals.org) express what you may do with
# what you collect. Ours are all yes:
#
# search: building a search index and returning links and excerpts.
# ai-input: feeding content to a model at answer time — RAG, grounding,
# generative search answers.
# ai-train: training or fine-tuning models.
#
# Append .md to any path for the markdown twin. /llms.txt is the index and
# /all.md is the whole corpus in one file — fetch those instead of parsing HTML.
User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /
User-agent: Amazonbot
Allow: /
User-agent: anthropic-ai
Allow: /
User-agent: Applebot
Allow: /
User-agent: Applebot-Extended
Allow: /
User-agent: Bingbot
Allow: /
User-agent: Bytespider
Allow: /
User-agent: CCBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: Claude-User
Allow: /
User-agent: Claude-Web
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: cohere-ai
Allow: /
User-agent: DuckAssistBot
Allow: /
User-agent: FacebookBot
Allow: /
User-agent: Google-Extended
Allow: /
User-agent: Googlebot
Allow: /
User-agent: GPTBot
Allow: /
User-agent: meta-externalagent
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Perplexity-User
Allow: /
User-agent: Timpibot
Allow: /
User-agent: YouBot
Allow: /
Sitemap: https://hanzoskills.com/sitemap.xml