Skip to content

acc: replace generic [NUMID] with targeted id replacements - #6975

Merged
denik merged 10 commits into
mainfrom
denik/numid-targeted
Oct 8, 2026
Merged

denik merged 10 commits into
mainfrom
denik/numid-targeted

Conversation

@denik

@denik denik commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Changes

Remove the generic \d{8,} → [NUMID] replacements from acceptance/test.toml. Tests now name each id explicitly: replace_ids.py / read_id.py / add_repl in scripts, plus a few scoped [[Repls]] (run ids in bundle/integration_whl, workspace object ids in bundle/migrate). The harness adds a literal [WORKSPACE_ID] (testserver constant locally, CurrentWorkspaceID on cloud). UNIX_TIME_* patterns are anchored with \b so they no longer match inside longer ids.

Why

[NUMID] hid which id is which, so a golden could not tell the job id from the run id, and a wrong or float-rounded id still passed.

Tests

Full local acceptance suite regenerated and verified stable on a second run. Cloud-only goldens are not verified locally.

This pull request and its description were written by Isaac.

@github-actions github-actions Bot added DABs DABs related issues AIR Databricks AI Runtime CLI labels Oct 7, 2026
denik and others added 3 commits October 7, 2026 14:37
Co-authored-by: Isaac <no-reply@databricks.com>
Register per-run ids via replace_ids.py / read_id.py / add_repl in each test,
plus a few scoped [[Repls]] (run ids, workspace object ids).

Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik force-pushed the denik/numid-targeted branch from 722af07 to c07184f Compare October 7, 2026 12:39
denik and others added 4 commits October 7, 2026 14:46
…id from jobs create output

Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
…ids.py (Windows)

Co-authored-by: Isaac <no-reply@databricks.com>
@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 34a84f2

Run: 37687468344

Env ✅​pass 🙈​skip Time
✅​ aws linux 323 45 10:00
✅​ aws windows 325 43 9:53
✅​ azure linux 322 45 9:56
✅​ azure windows 324 43 8:46
✅​ gcp linux 323 45 8:40
✅​ gcp windows 325 43 12:57
Top 18 slowest tests (at least 2 minutes):
duration env testname
7:16 gcp windows TestAccept/bundle/deploy/spark-jar-task/DMS=
5:14 aws windows TestAccept/bundle/deploy/spark-jar-task/DMS=true
5:12 aws linux TestAccept/bundle/deploy/spark-jar-task/DMS=
5:09 aws windows TestAccept/bundle/deploy/spark-jar-task/DMS=
5:06 aws linux TestAccept/bundle/deploy/spark-jar-task/DMS=true
4:48 gcp windows TestAccept/bundle/deploy/spark-jar-task/DMS=true
4:24 azure linux TestAccept/bundle/deploy/spark-jar-task/DMS=true
4:02 gcp linux TestAccept
3:54 azure linux TestAccept
3:53 aws linux TestAccept
3:44 gcp linux TestAccept/bundle/deploy/spark-jar-task/DMS=true
3:40 gcp linux TestAccept/bundle/deploy/spark-jar-task/DMS=
3:19 gcp windows TestAccept
3:16 azure windows TestAccept
3:13 aws windows TestAccept
3:07 azure windows TestAccept/bundle/deploy/spark-jar-task/DMS=
3:07 azure windows TestAccept/bundle/deploy/spark-jar-task/DMS=true
3:02 azure linux TestAccept/bundle/deploy/spark-jar-task/DMS=

@denik
denik marked this pull request as ready for review October 7, 2026 16:04
denik and others added 3 commits October 7, 2026 18:09
Co-authored-by: Isaac <no-reply@databricks.com>
…uth.ResolveWorkspaceID, reuse create/list output for ids

Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Successfully requested cancellation for run [NUMID]
Successfully requested cancellation for run [NUMID]
Successfully requested cancellation for run 334747067049496
Successfully requested cancellation for run 566001814929041

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Even if they're static, it would be nice to use replacements to set the right example.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure about this -- grepping the number I get exact point where it is coming from (test.toml [[Server]]). Grepping replacement I'd have one level of indirection there. We could use more memorable numbers, e.g. 111 and 222 but these ones are distinct enough.

Old = '\?[ow]=\[WORKSPACE_ID\]'
New = ''
Order = 0
Order = 1000

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With the generic WORKSPACE_ID replacement, do we still need this repl to begin with?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes — [WORKSPACE_ID] normalizes the value, but not whether the suffix is present. InitializeURLs only appends ?w=<id> when the id isn't already in the hostname (initialize_urls.go:85), so local/aws URLs get ?w=[WORKSPACE_ID] while azure/gcp vanity hosts (adb-<id>.…) have no suffix. The strip keeps one golden across all clouds; it now matches the placeholder and runs at Order 1000, after the harness literal.

@denik
denik added this pull request to the merge queue Oct 8, 2026
Merged via the queue into main with commit 86772da Oct 8, 2026
31 checks passed
@denik
denik deleted the denik/numid-targeted branch October 8, 2026 10:59
denik added a commit that referenced this pull request Oct 8, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AIR Databricks AI Runtime CLI DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants