1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-11-30 15:22:09 +00:00
seirdy.one/content/notes/social-implications-of-crawler-neutrality.md
Rohan Kumar 19797ba6b0
POSSE
2022-12-11 13:45:27 -08:00

1.7 KiB

title date replyURI replyTitle replyType replyAuthor replyAuthorURI syndicatedCopies
Social implications of crawler neutrality 2022-12-11T13:20:35-08:00 https://weirder.earth/@MerlinJStar/109496963818257286 Why I plan on getting away from LinkedIn by the end of 2023 SocialMediaPosting Merlin Star https://merlinjstar.com/
title url
The Fediverse https://pleroma.envs.net/notice/AQVdsNiNG3MBsClnnM
title url
The Mojeek Discourse https://community.mojeek.com/t/social-implications-of-crawler-neutrality/475

You said something I'd like to draw attention to:

I have been banned from LinkedIn temporarily myself 4 times for "looking at too many profiles". It is in their Terms and Conditions that they can ban you for that.

LinkedIn is aggressively anti-scraping for all the wrong reasons. Bing (obviously), Google, Yandex, and some others get preferential treatment; Microsoft is incentivised to keep the number of non-Bing web indexes low. Companies that are both search engines and platforms for user-generated content are incentivized to monopolize access to said content.

Unfortunately, its anti-scraping tactics blow back on users whose behavior is not sufficiently different from scrapers. Users with unreliable connections, who open many pages in advance while good connection lasts. Spoonies who take the "open now, review later" route. Privacy-conscious users on anonymized connections. The list goes on. It's funny how hoarding privilege tends to blow back on those without.

A diverse group of users will browse in diverse ways. Normalizing that behavior has consequences that show how Microsoft's pro-diversity messaging is, unsurprisingly, only as shallow as its bottom line.