Skip to content

chore(release): qualify 8.5.0 offline and retain a regraded baseline - #81

Merged
vriesd merged 4 commits into
mainfrom
codex/planning-models-release
Sep 14, 2026
Merged

vriesd merged 4 commits into
mainfrom
codex/planning-models-release

Conversation

@vriesd

@vriesd vriesd commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Authorizes the reviewed 8.5.0 planning-model selector to release without a live
model campaign, after the operator was told the alternatives were a funded
campaign or holding the release.

What changed

  • The single hard-coded 8.4.0 picker exception becomes a fixed source-level
    registry of individually reviewed offline features. A record whose version and
    feature pair is absent is refused before any evidence is read, so it cannot
    nominate its own scope, borrow another feature's commit, or advance to a later
    version.
  • Adds planning-models-v1 for 8.5.0, frozen to the reviewed PR feat(models): add planning specialist and explicit model handoff #80 head
    c0064dc, covering 13 picker, planning, prompt-surface, guide and packaging
    paths. Everything else must satisfy the existing patch tooling allowance.
  • The baseline stays 8.3.0, the last release measured live. Offline releases
    never become baselines: chaining one onto another would let the newest
    measured evidence recede while each record still claimed a qualified parent.
  • Each feature now owns its baseline seal directory in source, so neither a
    release record nor --bundles can redirect a release to another seal.

Why a new seal was needed

The release grader closure covers prompt surfaces and guides, so PR #80's edits
to skills/flow-plan/SKILL.md and src/prompt-surfaces.ts invalidated the seal
retained for 8.4.0. That failure was already present on main before this
branch. The same original 8.3.0 campaign and canary were regraded into a seal
valid under current verifier sources. This retains existing evidence; it is not a
rerun and produces no new measurement.

Verification

  • Full contribution checks: 1,205 tests pass.
  • All 13 gated replays reproduced. Package smoke passes.
  • The real release initializer accepted the feature record, the exact candidate
    artifact, the frozen source comparison and the regraded baseline, and generated
    the disclosure notes. Initialization did not publish.

Disclosure

No live model eval or paid canary ran for this candidate. The generated notes
state that no release after 8.3.0 has been measured live.

🤖 Generated with Claude Code

vriesdcrv and others added 3 commits September 15, 2026 00:10
Generalize the single hard-coded 8.4.0 picker exception into a fixed
source-level registry of individually reviewed offline features, and add
planning-models-v1 for 8.5.0 frozen to the reviewed PR #80 head c0064dc.

The baseline stays 8.3.0, the last release measured by a live multi-provider
campaign and canary. Offline releases deliberately never become baselines:
chaining one onto another would let the newest measured evidence recede while
each record still claimed a qualified parent. Release notes now state that no
release after 8.3.0 has been measured live.

The registry is source, not configuration. A record whose version and feature
pair is absent is refused before any evidence is read, so it cannot nominate its
own scope, borrow another feature's commit, or advance to a later version.

No live model eval or paid canary was run for this candidate.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
The release grader closure covers prompt surfaces and guides, so PR #80's
changes to skills/flow-plan/SKILL.md and src/prompt-surfaces.ts invalidated the
seal retained for 8.4.0. Regrade the same original 8.3.0 campaign and canary
into a seal valid under current verifier sources. This retains existing
evidence; it is not a rerun and produces no new measurement.

Each authorized feature now owns its baseline directory in source, so neither a
release record nor --bundles can redirect a release to another seal.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.

…icates

Independent review replaced the automated one, which was out of quota. It found
no defect but two traps: verifyReleaseEvidence still passed a stale 8.4.0
baseline directory that the verifier now ignores, and no test covered a
duplicated in-list guidance path, the only bypass attempt that clears the schema
and is caught a layer down in assertPatchPaths.

Also assert the registry holds one entry per version and per feature, so a
lookup cannot be ambiguous.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@vriesd
vriesd merged commit 7da750c into main Sep 14, 2026
7 checks passed
@vriesd
vriesd deleted the codex/planning-models-release branch September 14, 2026 22:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants