fmaury/seirdy.one
1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-12-25 02:02:11 +00:00
Code Issues Projects Releases Wiki Activity

block Kangaroo Bot

Browse source
This commit is contained in:
Seirdy 2024-12-06 23:22:48 -05:00
parent e013420d56
commit 1581a1077d
No known key found for this signature in database
GPG key ID: 1E892DB2A5F84479
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
static/robots.txt
View file

@ -133,6 +133,10 @@ Disallow: /
User-agent: Webzio-extended
Disallow: /
# https://kangaroollm.com.au/kangaroo-bot/`
User-agent: Kangaroo Bot
Disallow: /
# I'm not blocking CCBot for now. It publishes a free index for anyone to use.
# Googe used this to train the initial version of Bard (now called Gemini).
# I allow CCBot since its index is also used for upstart/hobbyist search engines