Skip to content

Add Data Maker dataset-driven runs - #635

Draft
HappyDevs1 wants to merge 2 commits into
feat/cli-doctor-jsonfrom
feat/datamaker-test-data
Draft

HappyDevs1 wants to merge 2 commits into
feat/cli-doctor-jsonfrom
feat/datamaker-test-data

Conversation

@HappyDevs1

@HappyDevs1 HappyDevs1 commented Sep 18, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • add strict suite and sidecar data-binding schemas
  • stream and pin Data Maker datasets behind a provider-neutral source
  • run deterministic limited selections in isolated row processes
  • emit aggregate JSON/JUnit evidence, checkpoints, shards, and linked retries
  • document selection, precedence, security, and deletion behavior

Verification

  • cargo check -p flowproof-cli
  • cargo test -p flowproof-cli --lib data::tests (6 passed)
  • CLI definition validation passed

Stack

This draft is based on feat/cli-doctor-json so the existing doctor work is not duplicated in this PR.

Desktop companion: https://github.com/automators-com/flowproof-desktop/pull/40

@HappyDevs1
HappyDevs1 added this pull request to stack #648 September 22, 2026 05:07
CI denies clippy::unwrap_used workspace-wide (-D warnings). The dataset-run
summary re-parsed its own just-built report JSON with two `.unwrap()` calls
where the typed `results: Vec<DataRowResult>` was already in scope; use it
directly instead. Test-only `.unwrap()`/`.unwrap_err()` calls in data.rs
become `.expect()`/`.expect_err()` with a message, matching the rest of the
suite.

Also document `run --data PATH`, which every_visible_cli_flag_is_mentioned_in_the_docs
flagged as shipped but unwritten.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant