Skip to content

Outcome metrics that steer allocation toward work that ships and sticks #6974

Closed as not planned

Description

@kyle-sexton

Capacity used is an input; the goal is merged work that stays merged. Decide which outcome signals to record per lane (merged changes, reverts, review findings after merge, needs-human escalations, reruns) and how they feed back into allocation and the filler queue.

Decisions (owner, 2026-10-16)

  • Published per-run fields: lane, outcome, duration, turns, models, tokens, estimated cost (labeled an estimate on subscription runs), and run link. The harness writes them after the run, outside the prompt.
  • Kept private: the role-to-account mapping, usage percentages and transcripts. Transcripts are tracked in feat(lanes): private, aggregatable store for lane transcripts #7676.

Activity

  1. added
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    wayfind: designWayfind decision item: design-space or domain-model decision; human in the loop.
    on Oct 11, 2026
  2. added
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 11, 2026
  3. github-actions commented on Oct 11, 2026

    @github-actions
    Contributor

    Thanks for the report. Automated triage handed this issue to a maintainer.

    Automated triage. A maintainer reviews it.

  4. removed
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 15, 2026
  5. kyle-sexton commented on Oct 25, 2026

    @kyle-sexton
    MemberAuthor

    Closing as not planned here: the work moves. #6970 is closed, so the open design (which outcome signals to record per lane, and how they steer allocation and the filler queue) is carried to the map, #6958: #6958 (comment). The per-run fields the lane-outcome record does not publish yet (duration, tokens, run link) are split to melodic-software/ci-workflows#885.

    To reopen: reopen this issue and say what is still missing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.wayfind: designWayfind decision item: design-space or domain-model decision; human in the loop.

    Fields

    No fields configured for Feature.

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions