perf: cut extraction time by ~46% on an HTTP capture, with byte-identical output - #420

Merged

JarryShaw merged 18 commits into

mainfrom

perf/hot-path-wins

Sep 17, 2026

Commits on Sep 16, 2026

perf: memoise charset detection, which was 30% of an HTTP extraction
JarryShaw
committed
fa0920f
perf: give FieldBase a __copy__, saving ~15% on every capture shape
JarryShaw
committed
5ce03cd
perf: read Field.length once per field instead of two to four times
JarryShaw
committed
0c13874
perf: stop Schema.__setattr__ re-entering itself once per field
JarryShaw
committed
0aca006
perf: take Schema.unpack's OptionField test once rather than twice
JarryShaw
committed
1794c43
docs: record the profiling pass -- measurements, wins, and ruled-out suspects
JarryShaw
committed
b949a6a
docs: correct the profiling notes' commit shas after the rebase
JarryShaw
committed
08d08d8
Revert "perf: take Schema.unpack's OptionField test once rather than twice"
JarryShaw
committed
faef5d6
docs: add the reassembly and flow-tracing findings, and the revert rationale
JarryShaw
committed
e37a8c7
docs: fix the revert commit's sha in the profiling notes
JarryShaw
committed
96705f9
docs: settle the test-count question in the profiling notes
JarryShaw
committed
081c802
perf: bound what the charset cache can retain, and de-personalise the notes
JarryShaw
committed
572f13b
Merge branch 'main' into perf/hot-path-wins
JarryShaw
authored
9b148f9
utilities: promote charset detection to pcapkit.utilities.chardet
JarryShaw
committed
427a89d
utilities: name the wrapper `detect`, matching the function it wraps
JarryShaw
committed
01a39eb
utilities: key the charset cache on a digest, so large values are cached too
JarryShaw
committed
9f1b56b

Commits on Sep 17, 2026

utilities: go back to lru_cache, keyed on the value
JarryShaw
committed
bcc9fea
Merge branch 'main' into perf/hot-path-wins
JarryShaw
authored
4c0747a

Navigation Menu

Uh oh!

perf: cut extraction time by ~46% on an HTTP capture, with byte-identical output - #420

perf: cut extraction time by ~46% on an HTTP capture, with byte-identical output#420
JarryShaw merged 18 commits into
mainfrom
perf/hot-path-wins

Commits on Sep 16, 2026

perf: memoise charset detection, which was 30% of an HTTP extraction

perf: give FieldBase a copy, saving ~15% on every capture shape

perf: read Field.length once per field instead of two to four times

perf: stop Schema.setattr re-entering itself once per field

perf: take Schema.unpack's OptionField test once rather than twice

docs: record the profiling pass -- measurements, wins, and ruled-out suspects

docs: correct the profiling notes' commit shas after the rebase

Revert "perf: take Schema.unpack's OptionField test once rather than twice"

docs: add the reassembly and flow-tracing findings, and the revert rationale

docs: fix the revert commit's sha in the profiling notes

docs: settle the test-count question in the profiling notes

perf: bound what the charset cache can retain, and de-personalise the notes

Merge branch 'main' into perf/hot-path-wins

utilities: promote charset detection to pcapkit.utilities.chardet

utilities: name the wrapper `detect`, matching the function it wraps

utilities: key the charset cache on a digest, so large values are cached too

Commits on Sep 17, 2026

utilities: go back to lru_cache, keyed on the value

Merge branch 'main' into perf/hot-path-wins