fmaury/seirdy.one
1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-09-19 20:02:10 +00:00
Code Issues Projects Releases Wiki Activity

Disallow LLM training by Apple

Browse source
This commit is contained in:
Seirdy 2024-06-25 00:54:04 -04:00
parent 7bb654de4c
commit ee8a98721b
No known key found for this signature in database
GPG key ID: 1E892DB2A5F84479
1 changed files with 5 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
static/robots.txt
View file

@ -99,6 +99,11 @@ Disallow: /
User-agent: Google-Extended
Disallow: /
# Official way to opt-out of LLM training by Apple
# <https://support.apple.com/en-us/119829#datausage>
User-agent: Applebot-Extended
Disallow: /
# Anthropic-AI crawler posted guidance after a long period of crawling without opt-out documentation: <https://support.anthropic.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler>
User-agent: ClaudeBot
Disallow: /