| Commit message (Collapse) | Author | Age | Files | Lines |
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
A pod now carries its catalogues, so a translation can be updated
rather than only retyped: providing the .pot and .po (the means of
maintaining it).
A directory walk, where every other thing the pod writer carries is
named. A catalogue set is whatever the translator has, and enumerating
.pot and .po files would mean the writer deriving the document's
languages a second time, from a second place, to say what it already
reads from the manifest.
Done once, on the last language, as the markup blocks are. The tree is
not language specific, so a pass for each language would re-read all of
it, 5.5 MB ten times over for live-manual, into an archive the next pass
overwrites.
Every name is checked before it is carried, by the rule the pod reader
applies to an archive it is handed. The writer is reading a directory
someone else may have filled, which is the reason the reader checks.
The cost is small, and it is the whole argument for compressing the
archive as a stream rather than per member:
uncompressed content 6972418 -> 13167489 +89%
the .sisupod 692942 -> 891388 +28.6%
5.5 MB of catalogues cost 198 KB, because the .po files largely repeat
markup already in the archive and whole-stream compression sees it.
Per-member deflate could not.
(assisted by Claude-Code)
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
sisupod using zstd compression recognised by first bytes.
<doc>.sisupod: spine reads one before it writes one, so when the name
changes (from .zip to .ssiupod) every pod already published stays
readable.
A .sisupod is one zstd frame wrapping the archive spine already builds.
The reader unwraps the bytes and hands the same archive to the same
parser, so every guard downstream is untouched: entry names, per-entry
and total size, path depth, escape and symlinks.
Which container it is comes from the first four bytes (rather than the
name). A pod published as a plain .zip reads as it always did, a
.sisupod reads, and either one renamed reads too. The suffix is still
recognised, both spellings, for the argument and for a url.
libzstd is declared rather than bound: provides the whole surface of
fifteen extern C prototypes (there is nothing to generate and no
upstream tree to track, which is the arrangement sqlite3 already has).
dub links it with "libs": [ "zstd" ]; nix needs zstd.out rather than
zstd, whose default output is the binaries and carries no library at
all.
A frame declares its uncompressed size in its own header, and for a pod
fetched over https that number is attacker controlled. The declared size
is checked against a ceiling before a buffer is asked for, a frame that
will not declare one is refused, and what comes out is checked against
what was promised. The ceiling is the extraction limit the archive
reader already applies, so the two bounds agree.
Measured: output built from a .sisupod is byte identical to output built
from the same pod's .zip, 359 files over text, html, epub, odt and .ssp
for three documents, live-manual's ten languages included. A truncated
frame is refused and the document skipped.
free_culture 2863504 -> 1099736 2.60x
the_wealth_of_networks 4294022 -> 1172649 3.66x
live-manual 6972418 -> 675970 10.31x
(assisted by Claude-Code)
|
| | |
|
| | |
|
| |
|
|
|
| |
- odd hilighting issue ... must result from my org config, but "fix"
makes things easier for me.
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
|
|
|
|
| |
- revert to using GCC14: (current) GCC 15
introduced nullptr in its headers, and DMD's
ImportC parser needs update to handle it,
monitor and update
- (nix ldc overlay, minor comsetic)
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
| |
- .env/ removed as unused & unmaintained
|
| |
|
|
| |
- plus minor housekeeping/tidy
|
| |
|
|
|
|
|
| |
- following nixpkgs pretty much
- ldc-1.40.1 (based on D 2.110.0)
- dub-1.39.0
- dtools-2.110.0 (overlay changes)
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
| |
- nixVersions.unstable no longer available
|
| |
|
|
|
| |
- src/sisudoc (replaces src/doc_reform)
- sisudoc spine (used more)
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
|
| |
- org import: reuse settings in another org file
using code block to evaluate other org file
spine_version_info_and_doc_header_including_copyright_and_license.org
|
| |
|
|
|
|
|
| |
- nixDirEnv (a copy of .envrc) used for flake.nix
(getting around an issue that arose when
building project; may revert to direct use of
.envrc)
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
| |
- fixes dub >= 1.31.0 build failure, attempted to
build in /homeless-shelter
|
| | |
|