Repository navigation
Calibration CI: the conformance sweeps in three groups - #989
Merged
Merged
Conversation
Without the ExpoWeibull's mrl_cb sweep the conformance sweeps took 9.5 minutes on four workers locally, but on the release run they were 59% done when the 45-minute timeout stopped them. They run in three groups of about equal time by their local per-case totals (core-seconds): the offset LogNormal (703), the ExpoWeibull (691) and the rest (788); the three -k filters select 23, 23 and 196 of the 242 tests. The timeout is 60 minutes: the longest group on the day's runs, #617's bootstrap, took 24 to 36, and the runners' speed varied by about two (extra-parameters took 52 minutes on one run and 96 on another). Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_019Km2eWBiPJ5JNkme3vRg4B
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follow-up to #987. With ExpoWeibull's
mrl_cb[lr]dropped, the conformance sweeps take 9.5 min on four workers locally. On the release run, though, they were only 59% done when the 45-minute timeout stopped them; the runners are roughly 8× slower per test than an M-series Mac.They now run in three groups of about equal time, by the local per-case totals in core-seconds:
-k 'LogNormal and offset'-k ExpoWeibullThe three groups together cover all 242 tests.
The job timeout goes from 45 to 60 minutes:
🤖 Generated with Claude Code
https://claude.ai/code/session_019Km2eWBiPJ5JNkme3vRg4B