seirdy.one/linter-configs/htmltest.yml

DirectoryPath: "public"
IgnoreDirs:
  - "search"
CacheExpires: "120h" # 5 days
CheckFavicon: true
EnforceHTML5: true
IgnoreAltMissing: false
IgnoreAltEmpty: true # an empty alt makes presentation-role explicit, it's not a defect.
EnforceHTTPS: true
ExternalTimeout: 20
HTTPConcurrencyLimit: 128
IgnoreHTTPS:
  - "http://192.168.1"
  - "http://localhost:"
  - "http://wgq3bd2kqoybhstp77i3wrzbfnsyd27wt34psaja4grqiezqircorkyd.onion"
  - "http://bettermotherfuckingwebsite.com/"
  - "http://www.wall.org/~larry/"
  - "http://herpolhode.com/"
  - "http://io.netgarage.org/me/"
  - "http://linter.structured-data.org/"
  - "http://techrights.org/"
  - "http://www.tuxmachines.org/"
  - "http://xmlns.com/"
  - "http://nerdlistings.info/"
CheckExternal: true
IgnoreURLs:
  - "../music.txt"
  - "^gemini://"
  - "mailto:"
  - "git@git"
  - "http://[^/]*\\.onion"
  - "https://archive.is"
  - "https://archive.ph"
  - "https://archive.today"
  - "https://baccyflap.com/noai" # connection refused
  - "https://ogp.me/ns"
  - "https://xeiaso.net" # HTTP 416
  - "https://collector.seirdy.one/webmentions/"
  - "http://creativecommons.org/ns"
  - "https://seirdy.one/search/"
  # - "https://seirdy.one/.well-known/webfinger?resource=acct%3Aseirdy%40seirdy.one"
  - "https://seirdy.one/.well-known/webfinger" # inexplicable false positive
  - "https://strugee.net/" # refuses connection
  # - "https://forum.palemoon.org/viewtopic.php?f=1&t=25473" # manual check: blocks crawlers
  - "https://forum.palemoon.org/viewtopic.php"
  - "https://queue.acm.org/detail" # manual check: blocks crawlers
  # - "https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=830173" # manual check: 400 for some reason, using curl works fine.
  - "https://bugs.debian.org/cgi-bin/bugreport.cgi"
  - "https://www.science.org/content/blog-post/deliberately-optimizing-harm" # http 413, browser works fine.
  - "https://web.archive.org/" # the wayback machine itself.
  - "https://i.reddit.com/r/web_design/comments/k0dmpj/an_opinionated_list_of_best_practices_for_textual/gdmxy4u/"
  - "https://lnk.dk" # blocks htmltest
  - "https://www.fastcompany.com/90759792/with-google-dominating-search-the-internet-needs-crawl-neutrality" # blocks htmltest
  - "https://faq.whatsapp.com/general/security-and-privacy/answering-your-questions-about-whatsapps-privacy-policy" # my DNS filters block this domain, cbf to work around it just for htmltest
  - "https://doi.org/10.1515/popets-2017-0023" # redirects to a different domain which tends to block requests. DOI is generally good about keeping links alive; it's kinda the point of the service.
  # user has opted out of archiving
  - "https://herd.bovid.space/@garbados"
  - "https://make.wordpress.org/accessibility/handbook/markup/infinite-scroll/"
  - "https://www.reddit.com/user/Seirdy/" # reddit blocks htmltest
  - "https://io.netgarage.org/me/" # some clients give a TLS failure but recent browsers seem to work.
  - "https://openai.com/blog/openai-codex/" # false positive
OutputDir: "linter-configs/htmltest"
Check and fix broken links 2022-06-18 03:36:35 +00:00			`DirectoryPath: "public"`
			`IgnoreDirs:`
			`- "search"`
Fix more bad/dead links - Got permission from some more users to use archived/cached links for dead posts - found new updated links for others. - fixed brid.gy reddit backfeed due to case issue - some http-only sites have finally adopted TLS; update their links. 2024-05-28 04:30:40 +00:00			`CacheExpires: "120h" # 5 days`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`CheckFavicon: true`
			`EnforceHTML5: true`
Acknowledge dead link I don't use archive links to posts deleted by users who would rather not have their posts archived. Exclude this one from my broken link checker. 2022-11-20 19:27:24 +00:00			`IgnoreAltMissing: false`
			`IgnoreAltEmpty: true # an empty alt makes presentation-role explicit, it's not a defect.`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`EnforceHTTPS: true`
Strip more false positives from htmltest 2024-05-28 13:20:01 +00:00			`ExternalTimeout: 20`
speed up broken link check 2022-11-23 03:15:48 +00:00			`HTTPConcurrencyLimit: 128`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`IgnoreHTTPS:`
			`- "http://192.168.1"`
			`- "http://localhost:"`
			`- "http://wgq3bd2kqoybhstp77i3wrzbfnsyd27wt34psaja4grqiezqircorkyd.onion"`
			`- "http://bettermotherfuckingwebsite.com/"`
update http links for htmltest to skip 2024-04-24 20:09:35 +00:00			`- "http://www.wall.org/~larry/"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`- "http://herpolhode.com/"`
			`- "http://io.netgarage.org/me/"`
			`- "http://linter.structured-data.org/"`
			`- "http://techrights.org/"`
			`- "http://www.tuxmachines.org/"`
			`- "http://xmlns.com/"`
Fix nerdlistings link 2022-10-20 17:12:41 +00:00			`- "http://nerdlistings.info/"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`CheckExternal: true`
			`IgnoreURLs:`
			`- "../music.txt"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "^gemini://"`
			`- "mailto:"`
			`- "git@git"`
Add webmention URL re-writes This allows me to update a webmention URL if it breaks or changes and the admin didn't bother putting a re-direct in place. I shouldn't have needed to do this. Cool URLs don't change. 2022-11-18 04:16:57 +00:00			`- "http://[^/]*\\.onion"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://archive.is"`
broken link checker config updates 2022-11-07 18:47:43 +00:00			`- "https://archive.ph"`
			`- "https://archive.today"`
Fix broken links Remove moonshot pending link as the site cert seems expired and it looks abandoned 2024-05-24 22:15:59 +00:00			`- "https://baccyflap.com/noai" # connection refused`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://ogp.me/ns"`
Fix broken links Remove moonshot pending link as the site cert seems expired and it looks abandoned 2024-05-24 22:15:59 +00:00			`- "https://xeiaso.net" # HTTP 416`
move webmention endpoint to different subdomain 2023-12-08 07:53:25 +00:00			`- "https://collector.seirdy.one/webmentions/"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "http://creativecommons.org/ns"`
			`- "https://seirdy.one/search/"`
Relax htmltest a bit 2023-05-27 04:12:16 +00:00			`# - "https://seirdy.one/.well-known/webfinger?resource=acct%3Aseirdy%40seirdy.one"`
			`- "https://seirdy.one/.well-known/webfinger" # inexplicable false positive`
Fix broken links 2024-05-24 22:08:48 +00:00			`- "https://strugee.net/" # refuses connection`
Fix bad links 2022-08-12 04:30:20 +00:00			`# - "https://forum.palemoon.org/viewtopic.php?f=1&t=25473" # manual check: blocks crawlers`
			`- "https://forum.palemoon.org/viewtopic.php"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://queue.acm.org/detail" # manual check: blocks crawlers`
Fix bad links 2022-08-12 04:30:20 +00:00			`# - "https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=830173" # manual check: 400 for some reason, using curl works fine.`
			`- "https://bugs.debian.org/cgi-bin/bugreport.cgi"`
Fix broken links Got consent from some more fedi users :3 2024-05-26 06:28:43 +00:00			`- "https://www.science.org/content/blog-post/deliberately-optimizing-harm" # http 413, browser works fine.`
Auto-fix dead links 2022-08-25 03:16:20 +00:00			`- "https://web.archive.org/" # the wayback machine itself.`
Relax htmltest a bit 2023-05-27 04:12:16 +00:00			`- "https://i.reddit.com/r/web_design/comments/k0dmpj/an_opinionated_list_of_best_practices_for_textual/gdmxy4u/"`
auto clean dead links, linter conf update 2022-10-11 04:35:28 +00:00			`- "https://lnk.dk" # blocks htmltest`
Linter config update 2022-10-17 19:44:51 +00:00			`- "https://www.fastcompany.com/90759792/with-google-dominating-search-the-internet-needs-crawl-neutrality" # blocks htmltest`
broken link checker config updates 2022-11-07 18:47:43 +00:00			`- "https://faq.whatsapp.com/general/security-and-privacy/answering-your-questions-about-whatsapps-privacy-policy" # my DNS filters block this domain, cbf to work around it just for htmltest`
			`- "https://doi.org/10.1515/popets-2017-0023" # redirects to a different domain which tends to block requests. DOI is generally good about keeping links alive; it's kinda the point of the service.`
Acknowledge dead link I don't use archive links to posts deleted by users who would rather not have their posts archived. Exclude this one from my broken link checker. 2022-11-20 19:27:24 +00:00			`# user has opted out of archiving`
			`- "https://herd.bovid.space/@garbados"`
Fix bad/broken links 2024-05-27 09:09:42 +00:00			`- "https://make.wordpress.org/accessibility/handbook/markup/infinite-scroll/"`
Fix more bad/dead links - Got permission from some more users to use archived/cached links for dead posts - found new updated links for others. - fixed brid.gy reddit backfeed due to case issue - some http-only sites have finally adopted TLS; update their links. 2024-05-28 04:30:40 +00:00			`- "https://www.reddit.com/user/Seirdy/" # reddit blocks htmltest`
Strip more false positives from htmltest 2024-05-28 13:20:01 +00:00			`- "https://io.netgarage.org/me/" # some clients give a TLS failure but recent browsers seem to work.`
			`- "https://openai.com/blog/openai-codex/" # false positive`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`OutputDir: "linter-configs/htmltest"`