Skip to content

Add agent CLI for capture, recording, and editing - #16

Merged
Marc-André Moreau (mamoreau-devolutions) merged 3 commits into
masterfrom
copilot/agent-cli
Oct 31, 2026
Merged

Marc-André Moreau (mamoreau-devolutions) merged 3 commits into
masterfrom
copilot/agent-cli

Conversation

@mamoreau-devolutions

@mamoreau-devolutions Marc-André Moreau (mamoreau-devolutions) commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Add jiffshot-cli and an embedded, per-user/session named-pipe control server so agents can inspect and operate desktop applications, capture screenshots and guides, and start, annotate, and finalize recordings.
  • Add headless document editing, live frame-aware recording annotations, scrolling capture, and shared video post-production with trimming, joining, timed overlays, and MP4/GIF export.
  • Support scripted sequences with typed result references and cleanup, package the CLI in portable, MSI, and MSIX distributions, expose silent-audio warnings, document capability boundaries, and add an IPC artifact workflow to CI.

Validation

  • cargo build --workspace --locked
  • cargo test --workspace --locked (151 passed; 3 ignored)
  • Opt-in cli_edits_artifacts_over_real_ipc_without_desktop_input passed with synthetic media.
  • cargo clippy --locked -p jiffshot-cli --all-targets --no-deps -- -D warnings
  • Built and inspected an unsigned x64 MSIX using the CI packaging step; it includes both executables and the host DLL. The missing-CLI guard and staged CLI help command also passed.

Physical camera/audio devices and scrolling-app capture were not exercised in this validation. Strict workspace Clippy still reports pre-existing warnings.

New jiffshot-control crate (JSON over a per-user, owner-only ACL named pipe
with protocol versioning), a control server embedded in the tray process
(screenshots, recording, step guides, window/UIA/OCR targeting, input, waits)
and the jiffshot-cli console client with auto-launch, scripts (run), typed
errors and exit codes. Packaged in the portable zip and MSI; docs/cli.md.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Add headless document sessions, live frame-aware recording annotations, recording controls, scrolling capture, typed script bindings, and shared video editing with timed overlays. Document capability boundaries and exercise artifact workflows through real IPC.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Include and verify the CLI in MSIX packages, and expose silent-audio indicators through recording status and final results.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@mamoreau-devolutions
Marc-André Moreau (mamoreau-devolutions) merged commit e48a92c into master Oct 31, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant