1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-11-05 22:22:11 +00:00

Disallow LLM training by Apple

This commit is contained in:
Seirdy 2024-06-25 00:54:04 -04:00
parent 7bb654de4c
commit ee8a98721b
No known key found for this signature in database
GPG key ID: 1E892DB2A5F84479

View file

@ -99,6 +99,11 @@ Disallow: /
User-agent: Google-Extended
Disallow: /
# Official way to opt-out of LLM training by Apple
# <https://support.apple.com/en-us/119829#datausage>
User-agent: Applebot-Extended
Disallow: /
# Anthropic-AI crawler posted guidance after a long period of crawling without opt-out documentation: <https://support.anthropic.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler>
User-agent: ClaudeBot
Disallow: /