mirror of
https://git.sr.ht/~seirdy/seirdy.one
synced 2024-12-25 18:22:09 +00:00
block Kangaroo Bot
This commit is contained in:
parent
e013420d56
commit
1581a1077d
1 changed files with 4 additions and 0 deletions
|
@ -133,6 +133,10 @@ Disallow: /
|
|||
User-agent: Webzio-extended
|
||||
Disallow: /
|
||||
|
||||
# https://kangaroollm.com.au/kangaroo-bot/`
|
||||
User-agent: Kangaroo Bot
|
||||
Disallow: /
|
||||
|
||||
# I'm not blocking CCBot for now. It publishes a free index for anyone to use.
|
||||
# Googe used this to train the initial version of Bard (now called Gemini).
|
||||
# I allow CCBot since its index is also used for upstart/hobbyist search engines
|
||||
|
|
Loading…
Reference in a new issue