1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-12-24 01:42:10 +00:00

robots: disallow some toxic bs

This commit is contained in:
Rohan Kumar 2022-04-22 21:45:15 -07:00
parent 8ddc2ec879
commit 3300d14f99
No known key found for this signature in database
GPG key ID: 1E892DB2A5F84479
3 changed files with 17 additions and 1 deletions

View file

@ -1,5 +1,21 @@
User-agent: *
Sitemap: https://seirdy.one/sitemap.xml
Disallow: /noindex/
Disallow: /misc/
Disallow: /webmentions/
User-Agent: TurnitinBot
Disallow: /
User-Agent: NPBot
Disallow: /
User-Agent: SlySearch
Disallow: /
User-Agent: Adsbot
Disallow: /
User-Agent: AdsBot
Disallow: /
Sitemap: https://seirdy.one/sitemap.xml

Binary file not shown.

Binary file not shown.