From f933f9a0c1317876c85d335e03d8090df28085ab Mon Sep 17 00:00:00 2001 From: squid-protocol Date: Fri, 11 Sep 2026 18:42:05 -0400 Subject: [PATCH] docs: rosetta open-defect share is now 0.0% (0/2632), 94% in-band MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The cross-language consistency section in the root README and docs/validation.md carried the pre-close numbers (95% in-band, 0.1% / 3-of-2,633 open defects, and a named remaining-defect list). The live keyword-rosetta bias report now reads open-defect share 0.0% (0 of 2,632 comparable cells) and 94% average in-band (53 of 55 gated metrics ≥80%). Every remaining out-of-band cell is a ledger-validated variation (strictness stratum, language inherency, echo, or scoring choice), not an open engine defect. Refresh both docs and the weakest- metric callouts (cog_raw 76%, raw_arch_api 78%) to match; this is the README copy for epic #2812's D4 step 2. Co-Authored-By: Claude Opus 4.8 Claude-Session: https://claude.ai/code/session_01JaGQfW7WGbGXg54iyBg23j --- README.md | 18 +++++++++++------- docs/validation.md | 15 +++++++++------ 2 files changed, 20 insertions(+), 13 deletions(-) diff --git a/README.md b/README.md index 484e8e9e5..576c86d72 100644 --- a/README.md +++ b/README.md @@ -155,13 +155,17 @@ The chart colours each deviation by *cause*, not size: red is an open engine defect (a rule matching the wrong construct, or a scoring weight sitting inside a count); grey is a documented variation the ledger has validated — the language cannot express the construct, a deliberate scoring choice, or an echo of another -row. Current answer: on average 95% of languages sit within ±25% of the -cross-language median per gated metric (55 chartable metrics, 54 holding ≥80%), -and **0.1% (3 of 2,633 comparable cells) are open defects** — what remains is -named on the chart rather than hidden: `raw_arch_api` (2 cells) and -`func_complexity_gini` (1), the next score contracts' territory. -Every deviation is recorded in a validated ledger, the open defects are worked -by cause family under the [contract roadmap](docs/contract_roadmap.md), and +row. Current answer: on average 94% of languages sit within ±25% of the +cross-language median per gated metric (55 chartable metrics, 53 holding ≥80%), +and **the open-defect share is 0.0% (0 of 2,632 comparable cells)** — every +remaining out-of-band cell is a variation the ledger has validated (a strictness +stratum, a construct the language cannot express, an echo of another row, or a +deliberate scoring choice), not an open engine defect. The weakest metrics are +named rather than hidden — `cog_raw` holds 76% of languages in band, +`raw_arch_api` 78%, `reflection_metaprogramming` 82% — but their sub-band cells +are documented, not defects. +Every deviation is recorded in a validated ledger, the work is tracked by cause +family under the [contract roadmap](docs/contract_roadmap.md), and the defect classes found this way are [filed as GitGalaxy issues](https://github.com/squid-protocol/keyword-rosetta/blob/main/docs/findings_by_language.md). diff --git a/docs/validation.md b/docs/validation.md index 87d5f003e..0df601a8d 100644 --- a/docs/validation.md +++ b/docs/validation.md @@ -168,12 +168,15 @@ intent is identical by construction. Current results ([bias report](https://github.com/squid-protocol/keyword-rosetta/blob/main/docs/bias_report.md)): -across 59 gated metrics, on average **95% of languages land within ±25% of the -cross-language median** (54 of 55 chartable metrics hold at least 80% of -languages in band), and under the cause-based gate **0.1% of comparable cells -(3 of 2,633) are open engine defects**. The weakest metrics are named, not -hidden: `raw_arch_api` holds 76% of languages in the ±25% band, -`reflection_metaprogramming` 82%, `avg_func_args` and `cog_raw` 83%. Every known +across 59 gated metrics, on average **94% of languages land within ±25% of the +cross-language median** (53 of 55 chartable metrics hold at least 80% of +languages in band), and under the cause-based gate **the open-defect share is +0.0% — 0 of 2,632 comparable cells** are open engine defects; every remaining +out-of-band cell is a ledger-validated variation (a strictness stratum, a +construct the language cannot express, an echo, or a scoring choice). The +weakest metrics are named, not hidden: `cog_raw` holds 76% of languages in the +±25% band, `raw_arch_api` 78%, `reflection_metaprogramming` and +`risk_state_flux` 82%, `avg_func_args` 83%. Every known deviation is recorded in a validated [deviation ledger](https://github.com/squid-protocol/keyword-rosetta/blob/main/deviation_ledger.json), and the defect classes found this way are filed as GitGalaxy issues — see the