Verify Morris source reconstruction - #711
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
project/source_reconstruction_manifest.jsonwith the stored Morris witness,morrislabel, exact chapter boundaries, and stated normalization rule for chapters 1 through 6texts/news_from_nowhere/chapter_*.mdfile to have a manifest entry, so a later chapter cannot bypass the checkNo Morris citation, Phi sentence, gloss, derived English, vocabulary entry, or grammar rule changes in this PR.
Evidence boundary
The checker reuses the established interlinear decoder only to read citation strings. It selects and normalizes the independently stored source itself, then compares the two complete streams without consulting certification counts or digests. The
gutenberg-wrapped-prose-v1rule rejoins hyphenated words broken by source-file line wrapping and collapses layout whitespace; spelling, punctuation, capitalization, and hyphens remain exact.Prose review
The reader-facing additions received the required Humanizer and Phi voice pass. The pass corrected an overbroad attribution in the root README: lexical validation and independent source reconstruction now have separate, accurately named responsibilities instead of one validator appearing to prove both.
Checks
python3 scripts/source_reconstruction.py(6 reconstructions, 1,054 citations, 75,243 normalized characters)python3 scripts/test_source_reconstruction.py(13 tests)python3 scripts/validate_examples.py(1,305 entries, 0 errors, 0 warnings)python3 scripts/validate_sentences.py(3,313 examples, 0 errors)python3 scripts/test_sentence_validator.py(25 tests)python3 scripts/test_vocabulary_schema.py(25 tests)python3 scripts/content_vocabulary_decisions.py --check(82 batches, 280 decisions)python3 scripts/test_content_vocabulary_decisions.py(8 tests)python3 scripts/test_name_forms.py(20 tests)python3 scripts/test_translation_layers.py(11 tests)python3 scripts/translation_process_status.py --check(20 translations)python3 scripts/test_translation_process_status.py(9 tests)python3 scripts/audit_phonetic_neighbors.py --output /tmp/phonetic_neighbors_ntp02.txtand baseline comparison (250 pairs, unchanged)python3 scripts/generate_reference.py(generated references unchanged)python3 scripts/build_site.pypython3 -m py_compile scripts/source_reconstruction.py scripts/test_source_reconstruction.pygit diff --check