Skip to content

feat(proxy): add discovery-driven application TLS passthrough - #4957

Open
TaylorMutch wants to merge 3 commits into
feat/4668-discovery-readers/TaylorMutchfrom
feat/4954-sandbox-proxy/TaylorMutch
Open

TaylorMutch wants to merge 3 commits into
feat/4668-discovery-readers/TaylorMutchfrom
feat/4954-sandbox-proxy/TaylorMutch

Conversation

@TaylorMutch

@TaylorMutch TaylorMutch commented Oct 27, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Add the optional openshell-sandbox-proxy discovery consumer. It uses exact TLS SNI and unexpired discovered routes to relay application TLS directly to owning supervisors, keeping payloads off the gateway.

Based on main at 9f3c9560d. Stacked on feat/4668-discovery-readers/TaylorMutch.

Related Issue

Closes #4954. Part of RFC 0017.

Changes

  • Consume snapshots and watches through the Rust SDK client for the separate openshell.v1.ServiceDiscovery service.

  • Support one workspace, selected workspaces, or all active workspaces with discovery-only credentials.

  • Bound route caches, connections, ClientHello parsing, retries, and setup deadlines; atomically replace validated snapshots.

  • Close affected streams on withdrawal, installation replacement, expiry, or authorization loss; reload credentials/trust on reconnect.

  • Add health/readiness/metrics, container and release wiring, and a standalone Helm chart with deployment and workspace-scope regression cases.

Release Notes

Testing

  • Rebased onto main 9f3c9560d; standalone URL runtime passed 2,772 server tests (45 PostgreSQL-dependent tests skipped), 652 core tests, 336 Kubernetes-driver tests, and 300 supervisor tests.
  • Combined auth/discovery/proxy stack passed 2,803 server tests (46 PostgreSQL-dependent tests skipped), all nine proxy tests, and the additional server test targets. Strict all-target Clippy passed for core, server, Kubernetes driver, supervisor, and proxy.
  • TypeScript CI passed: generation/proto lint, lint, type checks, 207 tests, coverage, and build. Full Helm unit suites, rendered-TOML validation, resource coherence/ownership/scaling checks, Markdown/Mermaid lint, generated docs, and Rust formatting passed.
  • All eight app-listener/gateway-routing/service-auth startup combinations verified with the real gateway and base_url.
  • Live isolated k3d app-listener E2E passed in dedicated and shared modes, including HTTP/WebSockets, Host/SNI validation, network-policy isolation, withdrawal/re-exposure, dedicated gateway-outage expiry, graceful shared owner takeover preserving workload identity/process/memory, and explicit gateway fallback with the listener disabled. Matching gateway/supervisor/sandbox images were built locally; temporary releases were cleaned up.

Live tests exercised supervisor Pod-IP routing with Host/SNI, rather than public DNS or an external ingress controller. New-head CI is pending.

Qualification limits

Live Kubernetes qualification covers dedicated/shared supervisors, graceful shared-owner replacement, gateway outage, and policy isolation. Hashed URL/public-port behavior is covered by unit tests. Whole-node failure, real network partitions, metric-driven HPA, sustained production load, external ingress/DNS automation, and published release artifacts remain unqualified. Installation-status presentation (#4670) remains separate work. The example Kubernetes HTTPRoute controller remains a separate compatibility POC.

Checklist

  • Follows Conventional Commits
  • Commits are signed off (DCO)
  • Relevant implementation, configuration, and API documentation updated

PR dependency order: #4956 → #4963 → #4964 → #4957.

@copy-pr-bot

copy-pr-bot Bot commented Oct 27, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions

Copy link
Copy Markdown

@TaylorMutch
TaylorMutch added this pull request to stack #4942 October 27, 2026 02:54
@TaylorMutch
TaylorMutch force-pushed the feat/4953-authoritative-app-urls/TaylorMutch branch from a6d0833 to e6e1927 Compare October 27, 2026 03:15
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from d51549f to 6d0cb1e Compare October 27, 2026 03:15
@TaylorMutch
TaylorMutch force-pushed the feat/4953-authoritative-app-urls/TaylorMutch branch from e6e1927 to 2574b9a Compare October 27, 2026 05:42
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 6d0cb1e to 151ee71 Compare October 27, 2026 05:42
@TaylorMutch
TaylorMutch removed this pull request from stack #4942 October 27, 2026 05:45
@TaylorMutch
TaylorMutch changed the base branch from feat/4953-authoritative-app-urls/TaylorMutch to feat/4668-discovery-readers/TaylorMutch October 27, 2026 05:45
@TaylorMutch
TaylorMutch added this pull request to stack #4965 October 27, 2026 05:46
@TaylorMutch
TaylorMutch removed this pull request from stack #4965 October 27, 2026 05:47
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 6d1fb23 to 9b730e6 Compare October 27, 2026 06:24
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 151ee71 to 7624c50 Compare October 27, 2026 06:24
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 9b730e6 to 8fef4ac Compare October 27, 2026 06:25
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 7624c50 to 5415439 Compare October 27, 2026 06:25
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 8fef4ac to 8d568c1 Compare October 27, 2026 06:46
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 5415439 to 8b71a26 Compare October 27, 2026 06:46
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 8d568c1 to de13e31 Compare October 27, 2026 21:06
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch 2 times, most recently from 7cae154 to 299e56b Compare October 28, 2026 17:05
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from de13e31 to 05974d6 Compare October 28, 2026 17:05
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 299e56b to 2fa7511 Compare October 28, 2026 22:52
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch 2 times, most recently from a6e0702 to 159961a Compare November 4, 2026 18:52
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 88817f9 to 149f12f Compare November 4, 2026 18:52
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 159961a to fe417d2 Compare November 4, 2026 21:56
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch 2 times, most recently from 3726423 to f7625e7 Compare November 4, 2026 22:22
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from fe417d2 to 6f7d700 Compare November 4, 2026 22:22
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from f7625e7 to 93c7f1e Compare November 6, 2026 17:27
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 6f7d700 to f337bf1 Compare November 6, 2026 17:27
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 93c7f1e to be3684a Compare November 6, 2026 18:48
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from f337bf1 to bc80c84 Compare November 6, 2026 18:48
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from be3684a to 4c5a56d Compare November 6, 2026 22:02
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch 2 times, most recently from 052c76c to e8603a5 Compare November 9, 2026 19:08
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch 2 times, most recently from 90ed107 to 00048e2 Compare November 10, 2026 08:41
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from e8603a5 to 89ea75b Compare November 10, 2026 08:41
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 00048e2 to c1f9745 Compare November 12, 2026 20:17
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 89ea75b to 8df72ee Compare November 12, 2026 20:17
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from c1f9745 to af29413 Compare November 13, 2026 21:15
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 8df72ee to a18cc74 Compare November 13, 2026 21:15
@purp purp added area:runtime Sandbox execution, isolation, supervision, policy enforcement, networking, and provider lifecycle. topic:authnz Authentication, authorization, identity, sessions, credential protection, and policy integrity. topic:documentation Architecture docs, READMEs, project website updates, and automated documentation generation. topic:kubernetes Kubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration. topic:networking General network transport, connectivity, and proxy behavior. labels Nov 15, 2026
Route application TLS directly to discovered supervisor listeners, with
bounded caches and connections, expiry and withdrawal, health endpoints,
container/release packaging, and a standalone Helm chart.

Support one workspace, a finite selected set, or all active workspaces
through exclusive CLI and Helm settings. Validate complete snapshot scope
before atomic cache replacement and retain credential reload on reconnect.

Closes #4954
Refs #4668, #4669

Signed-off-by: Taylor Mutch <taylormutch@gmail.com>
Signed-off-by: Taylor Mutch <taylormutch@gmail.com>
Signed-off-by: Taylor Mutch <taylormutch@gmail.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:runtime Sandbox execution, isolation, supervision, policy enforcement, networking, and provider lifecycle. topic:authnz Authentication, authorization, identity, sessions, credential protection, and policy integrity. topic:documentation Architecture docs, READMEs, project website updates, and automated documentation generation. topic:kubernetes Kubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration. topic:networking General network transport, connectivity, and proxy behavior. topic:operability Installing/configuring deployments, upgrades, backup/restore, diagnostics, and maintenance. topic:reliability High availability, recovery, retries, graceful degradation, and correctness across restarts.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants