fmaury/seirdy.one
1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-12-26 02:22:09 +00:00
Code Issues Projects Releases Wiki Activity

block Kangaroo Bot

Browse source
This commit is contained in:
Seirdy 2024-12-06 23:22:48 -05:00
parent e013420d56
commit 1581a1077d
No known key found for this signature in database
GPG key ID: 1E892DB2A5F84479
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
static/robots.txt
View file

@ -133,6 +133,10 @@ Disallow: /
User-agent: Webzio-extended User-agent: Webzio-extended
Disallow: / Disallow: /
# https://kangaroollm.com.au/kangaroo-bot/`
User-agent: Kangaroo Bot
Disallow: /
# I'm not blocking CCBot for now. It publishes a free index for anyone to use. # I'm not blocking CCBot for now. It publishes a free index for anyone to use.
# Googe used this to train the initial version of Bard (now called Gemini). # Googe used this to train the initial version of Bard (now called Gemini).
# I allow CCBot since its index is also used for upstart/hobbyist search engines # I allow CCBot since its index is also used for upstart/hobbyist search engines