seirdy.one/linter-configs/htmltest.yml

DirectoryPath: "public"
IgnoreDirs:
  - "search"
CacheExpires: "48h" # 2 days
CheckFavicon: true
EnforceHTML5: true
IgnoreAltMissing: false
IgnoreAltEmpty: true # an empty alt makes presentation-role explicit, it's not a defect.
EnforceHTTPS: true
ExternalTimeout: 20
HTTPConcurrencyLimit: 128
IgnoreHTTPS:
  - "http://192.168.1"
  - "http://localhost:"
  - "http://wgq3bd2kqoybhstp77i3wrzbfnsyd27wt34psaja4grqiezqircorkyd.onion"
  - "http://bettermotherfuckingwebsite.com/"
  - "http://dtrace.org/"
  - "http://emacspeak.sourceforge.net/"
  - "http://herpolhode.com/"
  - "http://io.netgarage.org/me/"
  - "http://linter.structured-data.org/"
  - "http://optipng.sourceforge.net/"
  - "http://renaissancechambara.jp/"
  - "http://techrights.org/"
  - "http://www.nathanmyhrvold.com/"
  - "http://www.tuxmachines.org/"
  - "http://xmlns.com/"
  - "http://nerdlistings.info/"
CheckExternal: true
IgnoreURLs:
  - "../music.txt"
  - "^gemini://"
  - "mailto:"
  - "git@git"
  - "http://[^/]*\\.onion"
  - "https://archive.is"
  - "https://archive.ph"
  - "https://archive.today"
  - "https://ogp.me/ns"
  - "https://seirdy.one/webmentions/"
  - "http://creativecommons.org/ns"
  - "https://seirdy.one/search/"
  - "https://fediring.net/(previous|next)" # redir
  # - "https://forum.palemoon.org/viewtopic.php?f=1&t=25473" # manual check: blocks crawlers
  - "https://forum.palemoon.org/viewtopic.php"
  - "https://queue.acm.org/detail" # manual check: blocks crawlers
  - "https://plausible.io/blog/google-floc#" # manual check: I block this domain
  # - "https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=830173" # manual check: 400 for some reason, using curl works fine.
  - "https://bugs.debian.org/cgi-bin/bugreport.cgi"
  # - "https://forum.kuketz-blog.de/viewtopic.php?p=78202" # manual check: blocks crawlers
  - "https://forum.kuketz-blog.de/viewtopic.php"
  - "https://web.archive.org/" # the wayback machine itself.
  - "https://gitweb.torproject.org/tor-browser.git/tree/browser/components/securitylevel/SecurityLevel.jsm.id=ffdf" # Seems to block htmltest; check manually
  - "https://lnk.dk" # blocks htmltest
  - "https://www.fastcompany.com/90759792/with-google-dominating-search-the-internet-needs-crawl-neutrality" # blocks htmltest
  - "https://faq.whatsapp.com/general/security-and-privacy/answering-your-questions-about-whatsapps-privacy-policy" # my DNS filters block this domain, cbf to work around it just for htmltest
  - "https://doi.org/10.1515/popets-2017-0023" # redirects to a different domain which tends to block requests. DOI is generally good about keeping links alive; it's kinda the point of the service.
  - "https://docs.graycot.dev/s/MFowZsw_F" # DNSSEC issue
  # user has opted out of archiving
  - "https://herd.bovid.space/@garbados"
OutputDir: "linter-configs/htmltest"
Check and fix broken links 2022-06-18 03:36:35 +00:00			`DirectoryPath: "public"`
			`IgnoreDirs:`
			`- "search"`
Acknowledge dead link I don't use archive links to posts deleted by users who would rather not have their posts archived. Exclude this one from my broken link checker. 2022-11-20 19:27:24 +00:00			`CacheExpires: "48h" # 2 days`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`CheckFavicon: true`
			`EnforceHTML5: true`
Acknowledge dead link I don't use archive links to posts deleted by users who would rather not have their posts archived. Exclude this one from my broken link checker. 2022-11-20 19:27:24 +00:00			`IgnoreAltMissing: false`
			`IgnoreAltEmpty: true # an empty alt makes presentation-role explicit, it's not a defect.`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`EnforceHTTPS: true`
speed up broken link check 2022-11-23 03:15:48 +00:00			`ExternalTimeout: 20`
			`HTTPConcurrencyLimit: 128`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`IgnoreHTTPS:`
			`- "http://192.168.1"`
			`- "http://localhost:"`
			`- "http://wgq3bd2kqoybhstp77i3wrzbfnsyd27wt34psaja4grqiezqircorkyd.onion"`
			`- "http://bettermotherfuckingwebsite.com/"`
			`- "http://dtrace.org/"`
			`- "http://emacspeak.sourceforge.net/"`
			`- "http://herpolhode.com/"`
			`- "http://io.netgarage.org/me/"`
			`- "http://linter.structured-data.org/"`
			`- "http://optipng.sourceforge.net/"`
			`- "http://renaissancechambara.jp/"`
			`- "http://techrights.org/"`
			`- "http://www.nathanmyhrvold.com/"`
			`- "http://www.tuxmachines.org/"`
			`- "http://xmlns.com/"`
Fix nerdlistings link 2022-10-20 17:12:41 +00:00			`- "http://nerdlistings.info/"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`CheckExternal: true`
			`IgnoreURLs:`
			`- "../music.txt"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "^gemini://"`
			`- "mailto:"`
			`- "git@git"`
Add webmention URL re-writes This allows me to update a webmention URL if it breaks or changes and the admin didn't bother putting a re-direct in place. I shouldn't have needed to do this. Cool URLs don't change. 2022-11-18 04:16:57 +00:00			`- "http://[^/]*\\.onion"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://archive.is"`
broken link checker config updates 2022-11-07 18:47:43 +00:00			`- "https://archive.ph"`
			`- "https://archive.today"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://ogp.me/ns"`
			`- "https://seirdy.one/webmentions/"`
			`- "http://creativecommons.org/ns"`
			`- "https://seirdy.one/search/"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`- "https://fediring.net/(previous\|next)" # redir`
Fix bad links 2022-08-12 04:30:20 +00:00			`# - "https://forum.palemoon.org/viewtopic.php?f=1&t=25473" # manual check: blocks crawlers`
			`- "https://forum.palemoon.org/viewtopic.php"`
Don't test dead wayback machine links 2022-06-19 20:44:51 +00:00			`- "https://queue.acm.org/detail" # manual check: blocks crawlers`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`- "https://plausible.io/blog/google-floc#" # manual check: I block this domain`
Fix bad links 2022-08-12 04:30:20 +00:00			`# - "https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=830173" # manual check: 400 for some reason, using curl works fine.`
			`- "https://bugs.debian.org/cgi-bin/bugreport.cgi"`
			`# - "https://forum.kuketz-blog.de/viewtopic.php?p=78202" # manual check: blocks crawlers`
			`- "https://forum.kuketz-blog.de/viewtopic.php"`
Auto-fix dead links 2022-08-25 03:16:20 +00:00			`- "https://web.archive.org/" # the wayback machine itself.`
auto clean dead links, linter conf update 2022-10-11 04:35:28 +00:00			`- "https://gitweb.torproject.org/tor-browser.git/tree/browser/components/securitylevel/SecurityLevel.jsm.id=ffdf" # Seems to block htmltest; check manually`
			`- "https://lnk.dk" # blocks htmltest`
Linter config update 2022-10-17 19:44:51 +00:00			`- "https://www.fastcompany.com/90759792/with-google-dominating-search-the-internet-needs-crawl-neutrality" # blocks htmltest`
broken link checker config updates 2022-11-07 18:47:43 +00:00			`- "https://faq.whatsapp.com/general/security-and-privacy/answering-your-questions-about-whatsapps-privacy-policy" # my DNS filters block this domain, cbf to work around it just for htmltest`
			`- "https://doi.org/10.1515/popets-2017-0023" # redirects to a different domain which tends to block requests. DOI is generally good about keeping links alive; it's kinda the point of the service.`
			`- "https://docs.graycot.dev/s/MFowZsw_F" # DNSSEC issue`
Acknowledge dead link I don't use archive links to posts deleted by users who would rather not have their posts archived. Exclude this one from my broken link checker. 2022-11-20 19:27:24 +00:00			`# user has opted out of archiving`
			`- "https://herd.bovid.space/@garbados"`
Check and fix broken links 2022-06-18 03:36:35 +00:00			`OutputDir: "linter-configs/htmltest"`