Skip to content

fix: fail closed on quant monitor delivery - #103

Merged
Pigbibi merged 4 commits into
mainfrom
codex/runtime-hardening-aab-20260730
Jul 30, 2026
Merged

fix: fail closed on quant monitor delivery#103
Pigbibi merged 4 commits into
mainfrom
codex/runtime-hardening-aab-20260730

Conversation

@Pigbibi

@Pigbibi Pigbibi commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Summary

  • treat monitor and daily-briefing delivery failures as explicit failed outcomes instead of successful quiet completion
  • propagate model/consumer failures into the persisted monitoring result without logging credentials or message payloads
  • add regression coverage for missing configuration, rejected Telegram responses, and briefing failure paths

Validation

  • python Ruff: passed
  • Python tests: 616 passed, 1 skipped, 58 subtests passed
  • Cloudflare Worker tests: 28 passed
  • git diff --check

Co-Authored-By: Codex <noreply@openai.com>

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: da1fbb1ff7

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread ops/quant-monitor/scripts/health_cycle.py
Comment thread ops/quant-monitor/scripts/health_cycle.py
Comment thread ops/quant-monitor/scripts/daily_briefing_builder.py
Pigbibi and others added 2 commits July 30, 2026 13:49
Co-Authored-By: Codex <noreply@openai.com>
Co-Authored-By: Codex <noreply@openai.com>

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: acf38f5aeb

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread ops/quant-monitor/scripts/health_cycle.py Outdated
Co-Authored-By: Codex <noreply@openai.com>
@Pigbibi
Pigbibi merged commit ad8144d into main Jul 30, 2026
5 checks passed
@Pigbibi
Pigbibi deleted the codex/runtime-hardening-aab-20260730 branch July 30, 2026 06:07

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c25a2d9107

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

return False
if not isinstance(payload, dict):
return False
return str(payload.get("fingerprint") or "") == fingerprint

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Track deduplication per active incident

When two incidents A and B are active, the persisted value is a single hash of {A, B}; if A recovers while B remains unhealthy, the hash becomes {B} and B is sent again even though it never recovered. Fresh evidence in the current code is that one fingerprint represents the entire alert set rather than persisting individual alert_identities; compare and update identity sets so only newly appearing incidents trigger the 30-minute notifier.

AGENTS.md reference: ops/quant-monitor/AGENTS.md:L20-L26

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant