Skip to content

Explain the mismatch between local Email health and Kubernetes probes #5421

Closed

Description

@devantler

🤖 Generated by the Agentic Engineer

Problem

The reviewed production observer reports local health while Kubernetes remains unready and continues restarting Email. The exact-version synthetic control answers both health paths within the existing deadline. These observations do not identify the production cause.

Acceptance

  • Extend the opt-in, main-only bounded observer to compare the existing health request paths and target without changing probes, network rules, application configuration or retained data.
  • Read only the application's allowed/blocked address classifications using its existing administrative identity inside the protected workflow. Keep credentials, addresses, raw responses and native errors out of logs and artifacts; use finite reads, strict response validation and stable identity/input bindings.
  • Demonstrate success, actual blocked-state detection and incomplete/malformed/failure controls against the exact supported application behavior. Missing evidence remains inconclusive.
  • Merge through protected validation and review, observe a bound production result, and retain Restore Email availability after repeated startup failures #5412 until a root-cause repair produces sustained availability and authenticated administration.

Part of #5412

Activity

  1. added theissue type on Oct 27, 2026
  2. self-assigned this
    on Oct 27, 2026
  3. moved this to 🏃🏻‍♂️ In Progress in 🌊 Project Boardon Oct 27, 2026
  4. devantler commented on Oct 27, 2026

    @devantler
    ContributorAuthor

    🤖 Generated by the Agentic Engineer

    Delivered the bounded observation through #5426, merged at 18f24412ee545be1fa235102085cada9aef8fb56. Protected candidate CI and post-merge Validate Main passed; merged observer sources match the reviewed head. The exact-head Codex review is clean and both earlier findings have documented fixes.

    The first two dispatched reads were inconclusive during restart backoff. First-attempt production run 40463260157 completed its stable, bounded sample and returned ALL_LOCAL_TARGETS_HTTP_200, OTHER_ACTIVE_STORED_BLOCKS and Kubernetes readiness false. The administrative read succeeded inside the bound serving container. No application state or rule was changed.

    This satisfies the observation acceptance criteria. The investigation of the actual probe source and the root-cause repair continues on #5412; sustained availability and external administration remain outstanding.

  5. moved this from 🏃🏻‍♂️ In Progress to ✅ Done in 🌊 Project Boardon Oct 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Fields

Priority

None yet

Effort

None yet

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions