Repository navigation
Count a SPARQL query it never ran like code it never ran - #254
Merged
Merged
Conversation
On the dev slice, 2 of 3 sparql-university attempts on 0.61.0 wrote solution.sparql and said they were done without running it. lcode now sends the model back once, and the note names rdflib. SQL files stay out: one can be a migration, and asking to run that could change a real database. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
# Conflicts: # CHANGELOG.md
# Conflicts: # CHANGELOG.md
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
For #242. On 0.61.0's gate run, 2 of 3
sparql-universityattempts wrotesolution.sparqland said they were done without running it, and the third tried and gave up when it found no Python. All 3 failed. The check for code it never ran (#245) left query files out, so nothing sent them back.What changes
.sparqlor.rqfile counts like a new code file: if no command since its last change ran it, lcode sends the model back once, to run it or to say plainly that it's untested.uvis installed, it says how to run Python in a throwaway environment, and that the package for a SPARQL query isrdflib.Left out on purpose
.sqlfiles. One can be a migration, and asking the model to run it could change a real database. A SPARQL query rarely has that risk.Testing
A new test covers the whole path with
FakeOllama: the query is written, the model says it's done, the note sends it back once, and it runs. The full suite,ruff,basedpyrightandmkdocs build --strictpass.With a real model (qwen3.6-35b at 32K), two attempts at
sparql-universityon this branch: 1 of 2 passed, and it was 0/3 on each of the last two nights. Both attempts ran the query on their own, one by installingrdfliband the other from a script, so the new note never fired, and this doesn't show what the note itself does. Only theFakeOllamatest covers that so far, and tonight's gate has three more attempts. Two attempts are also too few to credit this change for the pass.This changes what the model is told, so it goes through the next gate before it ships.
🤖 Generated with Claude Code