fmaury/seirdy.one
1
0
Fork 0
mirror of https://git.sr.ht/~seirdy/seirdy.one synced 2024-11-10 00:12:09 +00:00
Code Issues Projects Releases Wiki Activity

New note: Social implications of crawler neutrality

Browse source
This commit is contained in:
Rohan Kumar 2022-12-11 13:20:35 -08:00
parent f3014682e2
commit 4614b22b77
No known key found for this signature in database
GPG key ID: 1E892DB2A5F84479
1 changed files with 19 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

19
content/notes/social-implications-of-crawler-neutrality.md Normal file
View file

@ -0,0 +1,19 @@
---
title: "Social implications of crawler neutrality"
date: 2022-12-11T13:20:35-08:00
replyURI: "https://weirder.earth/@MerlinJStar/109496963818257286"
replyTitle: "Why I plan on getting away from LinkedIn by the end of 2023"
replyType: "SocialMediaPosting"
replyAuthor: "Merlin Star"
replyAuthorURI: "https://merlinjstar.com/"
---
You said something I'd like to draw attention to:
> I have been banned from LinkedIn temporarily myself 4 times for "looking at too many profiles". It is in their Terms and Conditions that they can ban you for that.
LinkedIn is aggressively anti-scraping for all the _wrong_ reasons. Bing (obviously), Google, Yandex, and some others get preferential treatment; Microsoft is incentivised to keep the number of non-Bing web indexes low. Companies that are both search engines _and_ platforms for user-generated content are incentivized to monopolize access to said content.
Unfortunately, its anti-scraping tactics blow back on users whose behavior is not sufficiently different from scrapers. Users with unreliable connections, who open many pages in advance while good connection lasts. Spoonies who take the "open now, review later" route. Privacy-conscious users on anonymized connections. The list goes on. It's funny how hoarding privilege tends to blow back on those without.
A diverse group of users will browse in diverse ways. Normalizing that behavior has consequences that show how Microsoft's pro-diversity messaging is, unsurprisingly, only as shallow as its bottom line.