fix(tokenizer): never start a vocab load that can only be fetched - #34

Merged

zhanghanduo merged 7 commits into

mainfrom

fix/tokenizer-cold-cache-fetch-gate

Sep 6, 2026

Commits on Sep 6, 2026

fix(tokenizer): never start a vocab load that can only be fetched
zhanghanduo
committed
b783fd4
docs(changelog): name the fake-tiktoken test breakage found cold-running the harness suite
zhanghanduo
committed
a078738
fix(tokenizer): validate the requested vocab cache
zhanghanduo
committed
aec5323
docs(tokenizer): name the fallback estimator, and account for the new hash

zhanghanduo
and
claude
committed
612dc8e
test(tokenizer): make a stale cache pin fail a build

zhanghanduo
and
claude
committed
1bc6b12
fix(tokenizer): bound cache validation
zhanghanduo
committed
f29a806
feat(compact): expose the mini card's URL budget as max_card_urls
zhanghanduo
committed
2eab79a