seirdy.one/scripts/xhtmlize-single-file.sh

#!/bin/sh
# copies an .html file to an equivalent .xhtml file, but replaces
# the meta charset with an XML declaration for compatibility with some
# XML tooling.
# Expects polygot XHTML(5) markup.
# Formats both the .html and .xhtml file.
# this means that every index.html file has an equivalent index.xhtml file.
# content negotiation allows an agent to pick html or xhtml.

# use xmllint to do the formatting.
# xmllint ruins inline CSS so delete the inline CSS and re-insert it.
# xmllint also adds extra whitespace around <pre><code> which we remove
# with "sd". I chose sd since it handles newlines well.
# It also decreases indents by one level

set -e -u

export html_file="$1"
export tmp_file="$html_file.tmp"
export xhtml_file=${html_file%*.html}.xhtml

cleanup() {
	rm -f "$tmp_file"
}
trap cleanup EXIT

trap cleanup EXIT
sed 7d "$html_file" | xmllint --format --encode UTF-8 --noent - | sd '^\t' '' >"$tmp_file"
{
	head -n7 "$tmp_file"
	cat tmp.css
	# shellcheck disable=SC2016 # these are regex statements, not shell expressions
	tail -n +8 "$tmp_file" \
		| sd '<pre(?: tabindex="0")?>\n\t*<(code|samp)( |>)' '<pre tabindex="0"><$1$2' \
		| sd '(?:\n)?</(code|samp)>\n(?:[\t\s]*)?</pre>' '</$1></pre>' \
		| sd '</span>.span itemprop="familyName"' '</span> <span itemprop="familyName"' \
		| sd '(</picture>|src="[^"]*" ?/>)<span itemprop="name" class="p-name fn n">' '$1 <span itemprop="name" class="p-name fn n">' \
		| sd '([a-z])<(data|time)' '$1 <$2'
} >>"$xhtml_file"

 # replace the html file with the formatted xhtml5 file, excluding the xml declaration
tail -n +2 "$xhtml_file" > "$html_file"

# remove the redundant charset declaration from the xhtml file. It's the
# first thing in the <head>
sed -i 5d "$xhtml_file" # busybox sed supports "-i"
xhtmlize: switch back to using xmllint Switch back to using xmllint, but now extract + replace the CSS to address the escaping. 2022-06-02 05:11:40 +00:00			`#!/bin/sh`
			`# copies an .html file to an equivalent .xhtml file, but replaces`
			`# the meta charset with an XML declaration for compatibility with some`
			`# XML tooling.`
			`# Expects polygot XHTML(5) markup.`
			`# Formats both the .html and .xhtml file.`
			`# this means that every index.html file has an equivalent index.xhtml file.`
			`# content negotiation allows an agent to pick html or xhtml.`

			`# use xmllint to do the formatting.`
			`# xmllint ruins inline CSS so delete the inline CSS and re-insert it.`
			`# xmllint also adds extra whitespace around <pre><code> which we remove`
			`# with "sd". I chose sd since it handles newlines well.`
Decrease markup indentation by one level 2022-06-05 05:36:55 +00:00			`# It also decreases indents by one level`
xhtmlize: switch back to using xmllint Switch back to using xmllint, but now extract + replace the CSS to address the escaping. 2022-06-02 05:11:40 +00:00
			`set -e -u`

			`export html_file="$1"`
Internal: improve scripts - I forgot to compress xhtml files. fix that. - Stylistic change: remove unnecessary brace expansions - Don't repeatedly append to a file; run commands in a different scope and write all at once. Move Nu HTML validator filtering into a shell script: - Return a bad exit code if validation errors are found after filtering - Remove null-ish values from the JSON output; the final output should be an empty string, since nothing should be reported. 2022-06-03 00:18:13 +00:00			`export tmp_file="$html_file.tmp"`
xhtmlize: switch back to using xmllint Switch back to using xmllint, but now extract + replace the CSS to address the escaping. 2022-06-02 05:11:40 +00:00			`export xhtml_file=${html_file%*.html}.xhtml`

			`cleanup() {`
			`rm -f "$tmp_file"`
			`}`
			`trap cleanup EXIT`

			`trap cleanup EXIT`
Decrease markup indentation by one level 2022-06-05 05:36:55 +00:00			`sed 7d "$html_file" \| xmllint --format --encode UTF-8 --noent - \| sd '^\t' '' >"$tmp_file"`
Internal: improve scripts - I forgot to compress xhtml files. fix that. - Stylistic change: remove unnecessary brace expansions - Don't repeatedly append to a file; run commands in a different scope and write all at once. Move Nu HTML validator filtering into a shell script: - Return a bad exit code if validation errors are found after filtering - Remove null-ish values from the JSON output; the final output should be an empty string, since nothing should be reported. 2022-06-03 00:18:13 +00:00			`{`
			`head -n7 "$tmp_file"`
			`cat tmp.css`
Automatically pull webring links during build 2022-06-07 16:39:32 +00:00			`# shellcheck disable=SC2016 # these are regex statements, not shell expressions`
Internal: improve scripts - I forgot to compress xhtml files. fix that. - Stylistic change: remove unnecessary brace expansions - Don't repeatedly append to a file; run commands in a different scope and write all at once. Move Nu HTML validator filtering into a shell script: - Return a bad exit code if validation errors are found after filtering - Remove null-ish values from the JSON output; the final output should be an empty string, since nothing should be reported. 2022-06-03 00:18:13 +00:00			`tail -n +8 "$tmp_file" \`
Another whitespace fix 2022-06-09 23:32:43 +00:00			`\| sd '<pre(?: tabindex="0")?>\n\t*<(code\|samp)( \|>)' '<pre tabindex="0"><$1$2' \`
Re-add support for <samp> in markdown 2022-06-09 01:17:33 +00:00			`\| sd '(?:\n)?</(code\|samp)>\n(?:[\t\s]*)?</pre>' '</$1></pre>' \`
More whitespace fixes 2022-06-03 04:48:23 +00:00			`\| sd '</span>.span itemprop="familyName"' '</span> <span itemprop="familyName"' \`
Various fixes for hidden service - Formatting fix for indieweb icon - Support searching directly on hidden service 2022-06-10 04:24:13 +00:00			`\| sd '(</picture>\|src="[^"]*" ?/>)<span itemprop="name" class="p-name fn n">' '$1 <span itemprop="name" class="p-name fn n">' \`
More whitespace fixes 2022-06-03 04:48:23 +00:00			`\| sd '([a-z])<(data\|time)' '$1 <$2'`
Internal: improve scripts - I forgot to compress xhtml files. fix that. - Stylistic change: remove unnecessary brace expansions - Don't repeatedly append to a file; run commands in a different scope and write all at once. Move Nu HTML validator filtering into a shell script: - Return a bad exit code if validation errors are found after filtering - Remove null-ish values from the JSON output; the final output should be an empty string, since nothing should be reported. 2022-06-03 00:18:13 +00:00			`} >>"$xhtml_file"`

			`# replace the html file with the formatted xhtml5 file, excluding the xml declaration`
xhtmlize: switch back to using xmllint Switch back to using xmllint, but now extract + replace the CSS to address the escaping. 2022-06-02 05:11:40 +00:00			`tail -n +2 "$xhtml_file" > "$html_file"`

Internal: improve scripts - I forgot to compress xhtml files. fix that. - Stylistic change: remove unnecessary brace expansions - Don't repeatedly append to a file; run commands in a different scope and write all at once. Move Nu HTML validator filtering into a shell script: - Return a bad exit code if validation errors are found after filtering - Remove null-ish values from the JSON output; the final output should be an empty string, since nothing should be reported. 2022-06-03 00:18:13 +00:00			`# remove the redundant charset declaration from the xhtml file. It's the`
			`# first thing in the <head>`
			`sed -i 5d "$xhtml_file" # busybox sed supports "-i"`