Skip to content

Resolve job project-environment paths relative to bundle YAML - #6983

Open
yiweidai-db wants to merge 10 commits into
mainfrom
yiweidai-db/stack/codex/bundle-project-environment-upstream
Open

yiweidai-db wants to merge 10 commits into
mainfrom
yiweidai-db/stack/codex/bundle-project-environment-upstream

Conversation

@yiweidai-db

@yiweidai-db yiweidai-db commented Oct 7, 2026 •

Copy link
Copy Markdown

🥞 Stacked PR

Use this link to review incremental changes.


Changes

Resolve project_environment relative to the YAML file that defines it, using the existing file-path handling.

For project_environment: ../pyproject.toml in resources/job.yml, the Jobs API request changes from ../pyproject.toml to /Workspace/.../files/pyproject.toml. This uses the same YAML-relative base as notebook_path.

Why

Jobs needs the uploaded project file's workspace path to read the environment. SDK and generated schema support already landed in #6928.

Replaces #6909 with a branch in databricks/cli so CI can obtain its JFrog OIDC credentials.

Tests

  • Path visitor and path-translation unit tests passed.
  • Acceptance tests passed for validation and mocked Jobs create/update requests, with deployment history both enabled and disabled. The snapshot checks notebook_path and project_environment for YAML-relative paths.
  • Scoped Go lint with Go 1.26.8, Go formatting, and shell syntax checks passed.

This PR was written with Codex.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 3d4c1f9

Run: 37848745983

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 276 17 5:29
✅​ aws-windows-latest-4core-16gb 278 15 4:04
✅​ azure linux-2core-8gb 275 17 5:20
✅​ azure-windows-latest-4core-16gb 277 15 3:25
✅​ gcp linux-2core-8gb 276 17 5:19
✅​ gcp-windows-latest-4core-16gb 278 15 4:29
Top 6 slowest tests (at least 2 minutes):
duration env testname
4:27 gcp-windows-latest-4core-16gb TestAccept
4:04 gcp linux-2core-8gb TestAccept
4:01 aws-windows-latest-4core-16gb TestAccept
3:59 aws linux-2core-8gb TestAccept
3:59 azure linux-2core-8gb TestAccept
3:23 azure-windows-latest-4core-16gb TestAccept

@yiweidai-db
yiweidai-db force-pushed the yiweidai-db/stack/codex/bundle-project-environment-upstream branch 2 times, most recently from e5ac305 to af1df31 Compare October 7, 2026 20:29
Comment thread acceptance/bundle/environments/project_environment/script
Comment thread bundle/config/mutator/paths/job_paths_visitor.go Outdated
Comment thread bundle/config/mutator/translate_paths_test.go Outdated
@yiweidai-db
yiweidai-db force-pushed the yiweidai-db/stack/codex/bundle-project-environment-upstream branch from 93d6b16 to 3d4c1f9 Compare October 8, 2026 21:42

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants