6 commits

Author	SHA1	Message	Date
Seirdy	e0a683e5fc	Block AcademicBotRTU	2024-12-14 22:53:26 -05:00
Seirdy	b7eaf6ddd9	add nocache robots tag	2024-12-11 10:37:00 -05:00
Seirdy	d46e050433	Major omission of the word "no" ... Thanks solonovamax!	2024-12-10 22:56:47 -05:00
Seirdy	b731ec68d2	Update acknowledgement of jmjl to mention semrush	2024-12-10 00:51:43 -05:00
Seirdy	5e8e5ad760	Syndicate	2024-12-10 00:47:37 -05:00
Seirdy	0139e58f87	new page: scrapers i block ... Also remove the comments in robots.txt in favor of directing people to that page.	2024-12-10 00:37:54 -05:00