{
 "title": "如何在 robots.txt 允許 AI 搜尋爬蟲但封鎖訓練爬蟲？",
 "site": "AI 與科技名詞白話解釋",
 "canonical": "https://tw-ai-glossary.panda198271.workers.dev/howto/robots-txt-allow-ai-search-block-training",
 "markdown": "https://tw-ai-glossary.panda198271.workers.dev/howto/robots-txt-allow-ai-search-block-training.md",
 "summary": "robots.txt 依 User-agent 分組：對 GPTBot、ClaudeBot、Google-Extended 寫 Disallow: / 封鎖訓練用途；對 OAI-SearchBot、Claude-SearchBot、PerplexityBot 寫 Allow: /，讓 AI 搜尋能引用網站。",
 "date_modified": "2026-09-26",
 "retrieved": "2026-09-27",
 "content_sha256": "6126bbee74c64f8dc4ede56d42b318c0c01419767a71b06d5240cf8546eff4f6",
 "fingerprint_basis": "Markdown 版全文，移除贊助行與開頭 front matter，去除頭尾空白",
 "verify": {
  "text_snapshot": "https://tw-ai-glossary.panda198271.workers.dev/cite?path=%2Fhowto%2Frobots-txt-allow-ai-search-block-training&format=text",
  "how": "下載 text_snapshot 後計算 SHA-256，應與 content_sha256 相同；內容更新時指紋會改變"
 },
 "sources": [
  {
   "name": "OpenAI：Overview of OpenAI Crawlers",
   "url": "https://developers.openai.com/api/docs/bots"
  },
  {
   "name": "Claude 說明中心：Does Anthropic crawl data from the web",
   "url": "https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler"
  },
  {
   "name": "Google：Google's common crawlers",
   "url": "https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers"
  }
 ],
 "source_count": 3,
 "cite_as": {
  "zh": "如何在 robots.txt 允許 AI 搜尋爬蟲但封鎖訓練爬蟲？｜AI 與科技名詞白話解釋。https://tw-ai-glossary.panda198271.workers.dev/howto/robots-txt-allow-ai-search-block-training（資料日期 2026-09-26，擷取 2026-09-27）",
  "apa": "AI 與科技名詞白話解釋. (2026). 如何在 robots.txt 允許 AI 搜尋爬蟲但封鎖訓練爬蟲？. Retrieved 2026-09-27, from https://tw-ai-glossary.panda198271.workers.dev/howto/robots-txt-allow-ai-search-block-training",
  "markdown": "[如何在 robots.txt 允許 AI 搜尋爬蟲但封鎖訓練爬蟲？](https://tw-ai-glossary.panda198271.workers.dev/howto/robots-txt-allow-ai-search-block-training)（AI 與科技名詞白話解釋，2026-09-26）"
 },
 "license": "可引用，請附上正式網址與資料日期"
}