Skip to content

feat(runtime): support Modal secrets and live output - #611

Merged
jdchawla29 merged 9 commits into
mainfrom
codex/modal-runtime-secrets-logging
Aug 23, 2026
Merged

feat(runtime): support Modal secrets and live output#611
jdchawla29 merged 9 commits into
mainfrom
codex/modal-runtime-secrets-logging

Conversation

@jdchawla29

@jdchawla29 jdchawla29 commented Aug 23, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • attach native modal.Secret objects to direct Modal image runtimes
  • stream raw environment stdout and stderr for SDK-owned Subprocess, Docker, Modal, and Daytona runtimes
  • collapse runtime session transfer onto provisioned runtimes and remove the RuntimeSession wrapper

Breaking change

RuntimeSession is removed. Custom provisioned runtimes should implement snapshot_session(session_id) and restore_session(session_id, archive) directly on Runtime.

Validation

  • ruff check on all modified Python files
  • strict ty check on all modified Python files
  • pytest -q hud/eval/tests — 226 passed
  • git diff --check

A billable live Modal canary was not run.


Note

Medium Risk
Public runtime API change for custom providers, plus new Modal secret attachment and live log streaming that can affect teardown and what appears on the local terminal. Not auth/payment-critical, but custom runtimes and secret handling need review.

Overview
SDK-owned local evals now stream raw environment stdout/stderr to the terminal (Subprocess, Docker, Modal, Daytona). Hosted runtimes still keep that output on the trace.

ModalRuntime can attach native modal.Secret objects on image sandboxes so secret values never pass through the local process. Secrets are rejected for Docker-in-Docker Compose because they would not reach main.

Breaking: RuntimeSession is gone. Session file transfer lives on the provisioned Runtime as snapshot_session / restore_session. Rollout uses those methods when handing actor files to an independent verifier.

Reviewed by Cursor Bugbot for commit 2ee3558. Bugbot is set up for automated code reviews on this repo. Configure here.

@jdchawla29
jdchawla29 marked this pull request as ready for review August 23, 2026 02:02

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: aa955c128a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread hud/eval/runtime/core.py

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using high effort and found 2 potential issues.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit aa955c1. Configure here.

Comment thread hud/eval/runtime/modal.py Outdated
Comment thread hud/eval/runtime/daytona.py Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 4107b3f319

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread hud/eval/runtime/local.py Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d5a60de43d

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread hud/utils/process.py Outdated
Comment thread hud/eval/runtime/local.py Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5063841f4b

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread hud/utils/process.py Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: eab347feb3

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread hud/utils/process.py Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: fca82f72a9

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread hud/eval/run.py
Comment thread hud/eval/runtime/local.py Outdated
@jdchawla29
jdchawla29 merged commit 6e097c0 into main Aug 23, 2026
8 checks passed
@jdchawla29
jdchawla29 deleted the codex/modal-runtime-secrets-logging branch August 23, 2026 06:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant