seirdy.one/linter-configs/htmltest.yml

DirectoryPath: "public"
IgnoreDirs:
  - "search"
CacheExpires: "120h" # 1 day
CheckFavicon: true
EnforceHTML5: true
IgnoreAltMissing: false
IgnoreAltEmpty: true # an empty alt makes presentation-role explicit, it's not a defect.
EnforceHTTPS: true
ExternalTimeout: 10
HTTPConcurrencyLimit: 128
IgnoreHTTPS:
  - "http://192.168.1"
  - "http://localhost:"
  - "http://wgq3bd2kqoybhstp77i3wrzbfnsyd27wt34psaja4grqiezqircorkyd.onion"
  - "http://bettermotherfuckingwebsite.com/"
  - "http://dtrace.org/"
  - "http://www.wall.org/~larry/"
  - "http://herpolhode.com/"
  - "http://io.netgarage.org/me/"
  - "http://linter.structured-data.org/"
  - "http://optipng.sourceforge.net/"
  - "http://renaissancechambara.jp/"
  - "http://techrights.org/"
  - "http://www.nathanmyhrvold.com/"
  - "http://www.tuxmachines.org/"
  - "http://xmlns.com/"
  - "http://nerdlistings.info/"
CheckExternal: true
IgnoreURLs:
  - "../music.txt"
  - "^gemini://"
  - "mailto:"
  - "git@git"
  - "http://[^/]*\\.onion"
  - "https://archive.is"
  - "https://archive.ph"
  - "https://archive.today"
  - "https://baccyflap.com/noai" # connection refused
  - "https://ogp.me/ns"
  - "https://xeiaso.net" # HTTP 416
  - "https://collector.seirdy.one/webmentions/"
  - "http://creativecommons.org/ns"
  - "https://seirdy.one/search/"
  # - "https://seirdy.one/.well-known/webfinger?resource=acct%3Aseirdy%40seirdy.one"
  - "https://seirdy.one/.well-known/webfinger" # inexplicable false positive
  - "https://strugee.net/" # refuses connection
  - "https://www.moonshot.forbiddenl0ve.net/index.php" # cert mismatch false positive
  # - "https://forum.palemoon.org/viewtopic.php?f=1&t=25473" # manual check: blocks crawlers
  - "https://forum.palemoon.org/viewtopic.php"
  - "https://queue.acm.org/detail" # manual check: blocks crawlers
  - "https://plausible.io/blog/google-floc#" # manual check: I block this domain
  # - "https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=830173" # manual check: 400 for some reason, using curl works fine.
  - "https://bugs.debian.org/cgi-bin/bugreport.cgi"
  - "https://www.science.org/content/blog-post/deliberately-optimizing-harm" # http 413, browser works fine.
  # - "https://forum.kuketz-blog.de/viewtopic.php?p=78202" # manual check: blocks crawlers
  - "https://forum.kuketz-blog.de/viewtopic.php"
  - "https://web.archive.org/" # the wayback machine itself.
  - "https://i.reddit.com/r/web_design/comments/k0dmpj/an_opinionated_list_of_best_practices_for_textual/gdmxy4u/"
  - "https://gitweb.torproject.org/tor-browser.git/tree/browser/components/securitylevel/SecurityLevel.jsm.id=ffdf" # Seems to block htmltest; check manually
  - "https://lnk.dk" # blocks htmltest
  - "https://www.fastcompany.com/90759792/with-google-dominating-search-the-internet-needs-crawl-neutrality" # blocks htmltest
  - "https://faq.whatsapp.com/general/security-and-privacy/answering-your-questions-about-whatsapps-privacy-policy" # my DNS filters block this domain, cbf to work around it just for htmltest
  - "https://doi.org/10.1515/popets-2017-0023" # redirects to a different domain which tends to block requests. DOI is generally good about keeping links alive; it's kinda the point of the service.
  - "https://docs.graycot.dev/s/MFowZsw_F" # DNSSEC issue
  # user has opted out of archiving
  - "https://herd.bovid.space/@garbados"
  - "https://make.wordpress.org/accessibility/handbook/markup/infinite-scroll/"
OutputDir: "linter-configs/htmltest"
Check and fix broken links 2022-06-18 03:36:35 +00:00			`DirectoryPath: "public"`
			`IgnoreDirs:`
			`- "search"`
Relax htmltest a bit 2023-05-27 04:12:16 +00:00			`CacheExpires: "120h" # 1 day`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`CheckFavicon: true`
			`EnforceHTML5: true`
Acknowledge dead link I don't use archive links to posts deleted by users who would rather not have their posts archived. Exclude this one from my broken link checker. 2022-11-20 19:27:24 +00:00			`IgnoreAltMissing: false`
			`IgnoreAltEmpty: true # an empty alt makes presentation-role explicit, it's not a defect.`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`EnforceHTTPS: true`
Relax htmltest a bit 2023-05-27 04:12:16 +00:00			`ExternalTimeout: 10`
speed up broken link check 2022-11-23 03:15:48 +00:00			`HTTPConcurrencyLimit: 128`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`IgnoreHTTPS:`
			`- "http://192.168.1"`
			`- "http://localhost:"`
			`- "http://wgq3bd2kqoybhstp77i3wrzbfnsyd27wt34psaja4grqiezqircorkyd.onion"`
			`- "http://bettermotherfuckingwebsite.com/"`
			`- "http://dtrace.org/"`
update http links for htmltest to skip 2024-04-24 20:09:35 +00:00			`- "http://www.wall.org/~larry/"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`- "http://herpolhode.com/"`
			`- "http://io.netgarage.org/me/"`
			`- "http://linter.structured-data.org/"`
			`- "http://optipng.sourceforge.net/"`
			`- "http://renaissancechambara.jp/"`
			`- "http://techrights.org/"`
			`- "http://www.nathanmyhrvold.com/"`
			`- "http://www.tuxmachines.org/"`
			`- "http://xmlns.com/"`
Fix nerdlistings link 2022-10-20 17:12:41 +00:00			`- "http://nerdlistings.info/"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`CheckExternal: true`
			`IgnoreURLs:`
			`- "../music.txt"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "^gemini://"`
			`- "mailto:"`
			`- "git@git"`
Add webmention URL re-writes This allows me to update a webmention URL if it breaks or changes and the admin didn't bother putting a re-direct in place. I shouldn't have needed to do this. Cool URLs don't change. 2022-11-18 04:16:57 +00:00			`- "http://[^/]*\\.onion"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://archive.is"`
broken link checker config updates 2022-11-07 18:47:43 +00:00			`- "https://archive.ph"`
			`- "https://archive.today"`
Fix broken links Remove moonshot pending link as the site cert seems expired and it looks abandoned 2024-05-24 22:15:59 +00:00			`- "https://baccyflap.com/noai" # connection refused`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://ogp.me/ns"`
Fix broken links Remove moonshot pending link as the site cert seems expired and it looks abandoned 2024-05-24 22:15:59 +00:00			`- "https://xeiaso.net" # HTTP 416`
move webmention endpoint to different subdomain 2023-12-08 07:53:25 +00:00			`- "https://collector.seirdy.one/webmentions/"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "http://creativecommons.org/ns"`
			`- "https://seirdy.one/search/"`
Relax htmltest a bit 2023-05-27 04:12:16 +00:00			`# - "https://seirdy.one/.well-known/webfinger?resource=acct%3Aseirdy%40seirdy.one"`
			`- "https://seirdy.one/.well-known/webfinger" # inexplicable false positive`
Fix broken links 2024-05-24 22:08:48 +00:00			`- "https://strugee.net/" # refuses connection`
Fix broken links Remove moonshot pending link as the site cert seems expired and it looks abandoned 2024-05-24 22:15:59 +00:00			`- "https://www.moonshot.forbiddenl0ve.net/index.php" # cert mismatch false positive`
Fix bad links 2022-08-12 04:30:20 +00:00			`# - "https://forum.palemoon.org/viewtopic.php?f=1&t=25473" # manual check: blocks crawlers`
			`- "https://forum.palemoon.org/viewtopic.php"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://queue.acm.org/detail" # manual check: blocks crawlers`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`- "https://plausible.io/blog/google-floc#" # manual check: I block this domain`
Fix bad links 2022-08-12 04:30:20 +00:00			`# - "https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=830173" # manual check: 400 for some reason, using curl works fine.`
			`- "https://bugs.debian.org/cgi-bin/bugreport.cgi"`
Fix broken links Got consent from some more fedi users :3 2024-05-26 06:28:43 +00:00			`- "https://www.science.org/content/blog-post/deliberately-optimizing-harm" # http 413, browser works fine.`
Fix bad links 2022-08-12 04:30:20 +00:00			`# - "https://forum.kuketz-blog.de/viewtopic.php?p=78202" # manual check: blocks crawlers`
			`- "https://forum.kuketz-blog.de/viewtopic.php"`
Auto-fix dead links 2022-08-25 03:16:20 +00:00			`- "https://web.archive.org/" # the wayback machine itself.`
Relax htmltest a bit 2023-05-27 04:12:16 +00:00			`- "https://i.reddit.com/r/web_design/comments/k0dmpj/an_opinionated_list_of_best_practices_for_textual/gdmxy4u/"`
auto clean dead links, linter conf update 2022-10-11 04:35:28 +00:00			`- "https://gitweb.torproject.org/tor-browser.git/tree/browser/components/securitylevel/SecurityLevel.jsm.id=ffdf" # Seems to block htmltest; check manually`
			`- "https://lnk.dk" # blocks htmltest`
Linter config update 2022-10-17 19:44:51 +00:00			`- "https://www.fastcompany.com/90759792/with-google-dominating-search-the-internet-needs-crawl-neutrality" # blocks htmltest`
broken link checker config updates 2022-11-07 18:47:43 +00:00			`- "https://faq.whatsapp.com/general/security-and-privacy/answering-your-questions-about-whatsapps-privacy-policy" # my DNS filters block this domain, cbf to work around it just for htmltest`
			`- "https://doi.org/10.1515/popets-2017-0023" # redirects to a different domain which tends to block requests. DOI is generally good about keeping links alive; it's kinda the point of the service.`
			`- "https://docs.graycot.dev/s/MFowZsw_F" # DNSSEC issue`
Acknowledge dead link I don't use archive links to posts deleted by users who would rather not have their posts archived. Exclude this one from my broken link checker. 2022-11-20 19:27:24 +00:00			`# user has opted out of archiving`
			`- "https://herd.bovid.space/@garbados"`
Fix bad/broken links 2024-05-27 09:09:42 +00:00			`- "https://make.wordpress.org/accessibility/handbook/markup/infinite-scroll/"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`OutputDir: "linter-configs/htmltest"`