Skip to content

ci: give five Postgres- and setup-bound tests room in the duration budget - #1659

Closed
zibi-pplx wants to merge 1 commit into
mainfrom
zibi/ci-duration-budget-headroom
Closed

zibi-pplx wants to merge 1 commit into
mainfrom
zibi/ci-duration-budget-headroom

Conversation

@zibi-pplx

Copy link
Copy Markdown
Collaborator

Summary

Merging this stops a slow runner from failing the Rust tests job on test durations when every test passes. On #1553's run, all 12,433 tests passed, and five then ran just past their bounds (ci/test-duration-budget.toml):

  • No exception yet, 4.7 s against the 4 s failure bound: pplx-space-node-mgr service::artifact_fs::receive::tests::receive_keeps_destination_identity_through_scrub_and_publication and pplx-space-spaced-guest-worker::embedding embedding. Each gets one at the file's own formula, 1.5 times the slowest time, rounded up: 8 s.
  • Already listed, just over: three pplx-space-db-migrate bootstrap tests at 7.0 s (ceiling 7) and 5.7 s (ceilings 5). Each bootstraps its own Postgres database and applies every migration, setup the file names as unshortenable. Their ceilings go to the same formula: 11 s and 9 s.

Validation

  • The file parses with tomllib. Every exception stays above fail_seconds, which the check requires.
  • CI on this head.

Severity and risk

Severity: low. A pull request with passing tests fails on a slow runner.

Risk: a real slowdown in these five tests would go unnoticed up to their new ceilings. Roll back by reverting this PR.

Not covered

Raising the three db-migrate ceilings goes against the file's "never raise a ceiling" rule. Making them faster instead would mean sharing one migrated database across tests that each prove a fresh bootstrap. If that's preferred, this PR can shrink to the two new exceptions.

AI assistance: an AI coding agent drafted this change and description; the author reviewed them.

…dget

A slow runner failed the Rust tests job on test durations alone, with every
test passing: five tests ran just past their bounds.

- pplx-space-node-mgr receive_keeps_destination_identity_through_scrub_and_publication
  and pplx-space-spaced-guest-worker::embedding took 4.7 s against the 4 s
  failure bound and had no exception. They get one at the file's formula,
  1.5 times the slowest time, rounded up: 8 s.
- Three pplx-space-db-migrate bootstrap tests, already listed, ran 7.0 s and
  5.7 s against ceilings of 7 s and 5 s. Each bootstraps its own Postgres
  database and applies every migration, which the file names as setup a
  test can't shorten without proving less. Their ceilings go to the same
  formula: 11 s and 9 s.

Raising those three goes against the file's "never raise a ceiling" rule.
The alternative, making them faster, means sharing one migrated database
across tests that each prove a fresh bootstrap, so this keeps the tests and
widens their ceilings instead.
@coderabbitai

coderabbitai Bot commented Nov 6, 2026 •

Copy link
Copy Markdown

Explain Change →

Caution

Review failed

The pull request is closed.

No actionable comments were generated in the recent review.

Walkthrough

The test duration budget increases the ceilings for the fresh-database bootstrap and two publication-grant metadata tests. It adds ceilings for the node manager artifact receive identity test and the spaced guest worker embedding test.

Possibly related PRs

Merge Risk: Moderate · up to 564aa

The duration gate will catch fewer slowdowns in five tests. This weakening should be explicitly accepted before merge.

Recent review info

Run configuration

Commits

Reviewing files that changed from the base of the PR and between 4e64603 and 564aa27.

Files selected for processing: 1

  • ci/test-duration-budget.toml

Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 1 remain after this review.

@zibi-pplx

Copy link
Copy Markdown
Collaborator Author

Folded into #1552 (bottom of the stack) instead.

@zibi-pplx zibi-pplx closed this Nov 6, 2026
@zibi-pplx
zibi-pplx deleted the zibi/ci-duration-budget-headroom branch November 6, 2026 18:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant