Skip to content

Tell which agent turn asked for a decision in cloudfall why - #78

Merged
shipmill-romamo[bot] merged 2 commits into
mainfrom
feat/why-cites-the-model
Oct 11, 2026
Merged

shipmill-romamo[bot] merged 2 commits into
mainfrom
feat/why-cites-the-model

Conversation

@romamo

@romamo romamo commented Oct 11, 2026

Copy link
Copy Markdown
Collaborator

cloudfall why answered what happened to a decision, but not what the agent was thinking when it asked for it. That lived in the investigation record, and the two were joined only by reading both by hand.

  • Each investigation step keeps the turn that made its call (optional in agent-investigation.schema.json; older records have none)
  • why --investigations DIR (default investigations, bound for MCP clients the same way as decisions) adds to the story the model, the endpoint, the alert, the turn, and that turn's reasoning with the response and request ids. The answer carries them as agent
  • A repeated call keeps the turn that asked first. A record from before turns were kept says so instead of guessing
  • A broken investigation record stops why with RECORD_INVALID (why_investigation_invalid)

Checked on a live Nemotron 3 Super replay run. The shop-logrotate story now reads "The agent nvidia/nemotron-3-super-120b-a12b at https://api.tokenfactory.nebius.com/v1/ asked for it in turn 2 of investigation …", then its reasoning, quoted with the Token Factory ids.

Full suite: 520 passed. ruff check and mypy are clean.

Next: the hosted demo shows this after a run (a separate PR once this is on main, since the demo pins Cloudfall by git rev).

🤖 Generated with Claude Code

https://claude.ai/code/session_01APTdZZw8Jw9PQF4TD55wMv

An investigation step now keeps the turn that made its call, and why
reads the investigation records beside the decisions: a decision an
agent asked for is told with the model, the endpoint, the alert, the
turn, and that turn's reasoning with the endpoint's response and
request ids. The record could already say what the model thought, but
only by reading two files by hand.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01APTdZZw8Jw9PQF4TD55wMv
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@shipmill-romamo
shipmill-romamo Bot merged commit 6b48078 into main Oct 11, 2026
1 check passed
@shipmill-romamo
shipmill-romamo Bot deleted the feat/why-cites-the-model branch October 11, 2026 18:43
romamo added a commit that referenced this pull request Oct 12, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01APTdZZw8Jw9PQF4TD55wMv
@shipmill-romamo shipmill-romamo Bot added this to the 0.7.0 milestone Oct 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant