Skip to content

Release 0.62.0 - #259

Merged
nasser1941 merged 1 commit into
mainfrom
release-0.62.0
Nov 7, 2026
Merged

nasser1941 merged 1 commit into
mainfrom
release-0.62.0

Conversation

@nasser1941

@nasser1941 nasser1941 commented Nov 6, 2026 •

Copy link
Copy Markdown
Owner

Release 0.62.0: what the automatic checks tell the model, plus two fixes found on 0.61.0's gate run.

#250, #252 and #254 change when the checks run and what the model is told, so this release goes through the gate (Releases in the contributing guide). The release candidate is this branch, built from its checkout, on the full dev slice at 32K with qwen3.6-35b, three attempts per task. It's compared with 0.60.0's full night on 4–5 November and with 0.61.0's runs on 5–6 November:

Within the noise against both. All 75 attempts ran, on the full slice with torch-tensor-parallelism back in. The run started at 08:29 on 7 November, in the daytime, at the maintainer's request. The model ran at 72–76 tokens/s every hour.

pass@1 went from 45% to 51% against 0.60.0, over the 25 tasks both ran (+5 points, noise ±10). Against 0.61.0 it went from 50% to 53%, over 24 tasks (+3 points, noise ±11).

0.60.0 0.61.0 0.62.0
Attempts that passed 34/75 33/62 38/75
Checks failed at least once 27 — 9
Stopped after replies that went nowhere 9 1 1
Attempts out of time 5 10 9
Model speed, median attempt 76 tokens/s 68 73

lcode bench --compare exits 0 against 0.60.0. Against 0.61.0, it was run with that release's two runs combined. No attempt crashed inside lcode.

Three things on the machine differ from the earlier runs, and the comparison has to allow for them: Ollama is now 0.40.15 (lcode update upgraded it), swap is now 32 GB instead of 8 GB, and the Linux kernel was updated.

Real tests before the night

All with qwen3.6-35b at 32K. Daytime speed limited them, so they show how lcode behaves, not scores or time.

Test Result
#250: django-12774, pytest-10051, build-cython-ext, 1 attempt each All 3 reached a check that stopped before its first test. The message appeared, and no note reached the model.
#250: real terminal, 3 small projects The checks run from the root after cd tests, and a change that really breaks the project still reaches the model
#252: a project with one failing test, and the model running pytest -q 2>&1 | tail -5 0.61.0 doesn't run the checks. This code runs them, and the failure goes back to the model.
#254: sparql-university, 2 attempts 1/2. Both ran the query on their own, so the new note hasn't fired with a real model yet.

pytest, ruff check, ruff format --check, basedpyright and mkdocs build --strict passed on each change. The same on this branch are running now.

This bumps __version__, the quickstart banner and the CHANGELOG (dated section and compare links).

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@nasser1941
nasser1941 merged commit 3f8f919 into main Nov 7, 2026
23 of 24 checks passed
@nasser1941
nasser1941 deleted the release-0.62.0 branch November 7, 2026 19:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant