1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-11-30 15:22:09 +00:00
seirdy.one/static/robots.txt

22 lines
304 B
Text
Raw Normal View History

2020-11-30 21:06:44 +00:00
User-agent: *
2021-01-23 20:47:50 +00:00
Disallow: /noindex/
2021-06-11 22:09:43 +00:00
Disallow: /misc/
2021-01-23 20:47:50 +00:00
Disallow: /webmentions/
2022-04-23 04:45:15 +00:00
User-Agent: TurnitinBot
Disallow: /
User-Agent: NPBot
Disallow: /
User-Agent: SlySearch
Disallow: /
User-Agent: Adsbot
Disallow: /
User-Agent: AdsBot
Disallow: /
Sitemap: https://seirdy.one/sitemap.xml