Repository navigation
Conversation
…dget A slow runner failed the Rust tests job on test durations alone, with every test passing: five tests ran just past their bounds. - pplx-space-node-mgr receive_keeps_destination_identity_through_scrub_and_publication and pplx-space-spaced-guest-worker::embedding took 4.7 s against the 4 s failure bound and had no exception. They get one at the file's formula, 1.5 times the slowest time, rounded up: 8 s. - Three pplx-space-db-migrate bootstrap tests, already listed, ran 7.0 s and 5.7 s against ceilings of 7 s and 5 s. Each bootstraps its own Postgres database and applies every migration, which the file names as setup a test can't shorten without proving less. Their ceilings go to the same formula: 11 s and 9 s. Raising those three goes against the file's "never raise a ceiling" rule. The alternative, making them faster, means sharing one migrated database across tests that each prove a fresh bootstrap, so this keeps the tests and widens their ceilings instead.
|
Caution Review failedThe pull request is closed. No actionable comments were generated in the recent review. Walkthrough
Merge Risk:
|
Collaborator
Author
|
Folded into #1552 (bottom of the stack) instead. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Merging this stops a slow runner from failing the Rust tests job on test durations when every test passes. On #1553's run, all 12,433 tests passed, and five then ran just past their bounds (
ci/test-duration-budget.toml):pplx-space-node-mgr service::artifact_fs::receive::tests::receive_keeps_destination_identity_through_scrub_and_publicationandpplx-space-spaced-guest-worker::embedding embedding. Each gets one at the file's own formula, 1.5 times the slowest time, rounded up: 8 s.pplx-space-db-migratebootstrap tests at 7.0 s (ceiling 7) and 5.7 s (ceilings 5). Each bootstraps its own Postgres database and applies every migration, setup the file names as unshortenable. Their ceilings go to the same formula: 11 s and 9 s.Validation
tomllib. Every exception stays abovefail_seconds, which the check requires.Severity and risk
Severity: low. A pull request with passing tests fails on a slow runner.
Risk: a real slowdown in these five tests would go unnoticed up to their new ceilings. Roll back by reverting this PR.
Not covered
Raising the three db-migrate ceilings goes against the file's "never raise a ceiling" rule. Making them faster instead would mean sharing one migrated database across tests that each prove a fresh bootstrap. If that's preferred, this PR can shrink to the two new exceptions.
AI assistance: an AI coding agent drafted this change and description; the author reviewed them.