diff --git a/content/meta/scrapers-i-block.md b/content/meta/scrapers-i-block.md index fcc2281..78ef277 100644 --- a/content/meta/scrapers-i-block.md +++ b/content/meta/scrapers-i-block.md @@ -327,7 +327,7 @@ Reason Information : {{}}{{}}{{}} -### Open Web Search GenAI-targeted opt=out +### Open Web Search GenAI-targeted opt out Product tokens @@ -453,7 +453,7 @@ Regex filter Commentary : This robot used a _slightly_ different User-Agent string to reach my site than the one advertised on the crawling notice (I saw a -Dolma suffix in my logs). -## FriendlyCrawler +### FriendlyCrawler User-Agent strings @@ -462,7 +462,7 @@ User-Agent strings Information : {{}}{{}} by {{}} has good coverage of this bot. -## PerplexityBot +### PerplexityBot User-Agent strings