1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-11-27 14:12:09 +00:00
seirdy.one/content/notes/social-implications-of-crawler-neutrality.md

25 lines
1.7 KiB
Markdown
Raw Normal View History

---
title: "Social implications of crawler neutrality"
date: 2022-12-11T13:20:35-08:00
replyURI: "https://weirder.earth/@MerlinJStar/109496963818257286"
replyTitle: "Why I plan on getting away from LinkedIn by the end of 2023"
replyType: "SocialMediaPosting"
replyAuthor: "Merlin Star"
replyAuthorURI: "https://merlinjstar.com/"
2022-12-11 21:22:05 +00:00
syndicatedCopies:
- title: 'The Fediverse'
url: 'https://pleroma.envs.net/notice/AQVdsNiNG3MBsClnnM'
2022-12-11 21:45:27 +00:00
- title: 'The Mojeek Discourse'
url: 'https://community.mojeek.com/t/social-implications-of-crawler-neutrality/475'
---
You said something I'd like to draw attention to:
> I have been banned from LinkedIn temporarily myself 4 times for "looking at too many profiles". It is in their Terms and Conditions that they can ban you for that.
LinkedIn is aggressively anti-scraping for all the _wrong_ reasons. Bing (obviously), Google, Yandex, and some others get preferential treatment; Microsoft is incentivised to keep the number of non-Bing web indexes low. Companies that are both search engines _and_ platforms for user-generated content are incentivized to monopolize access to said content.
Unfortunately, its anti-scraping tactics blow back on users whose behavior is not sufficiently different from scrapers. Users with unreliable connections, who open many pages in advance while good connection lasts. Spoonies who take the "open now, review later" route. Privacy-conscious users on anonymized connections. The list goes on. It's funny how hoarding privilege tends to blow back on those without.
A diverse group of users will browse in diverse ways. Normalizing that behavior has consequences that show how Microsoft's pro-diversity messaging is, unsurprisingly, only as shallow as its bottom line.