Skip to content

Standardize verification and test targets - #878

Merged
kuhe merged 1 commit into
developfrom
kuhe/chore/verification
Oct 30, 2026
Merged

kuhe merged 1 commit into
developfrom
kuhe/chore/verification

Conversation

@kuhe

@kuhe kuhe commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

paired with aws/aws-sdk-python#119

This PR adds the following phony but canonical make targets, standardizing development, CI, and release build verifications.

make static-analysis

This includes what isn't technically static in the traditional sense like
loading a module and using reflection to analyze it, but generally covers analysis
of the code without running the code's function bodies.

This covers things like API surface symbol analysis, aio partitioning and naming, and future not-yet-developed correctness analyses.

Included are 3rd party verifications like pyright and ruff.

make test-unit

Tests which exercise a small number of code units, mocking dependencies. Fast tests.

make test-functional

Tests of mainly the public API but without making real HTTP requests.
Typically these would be HTTP mocks, HTTP snapshot tests,
or multi-unit tests. Some crossover with the concept of an integration test, but consider these the medium-speed tests.

make test-integration

Tests against live services, or complex end to end tests like the codegen-output snapshot path. Slowest set of tests.

@kuhe
kuhe force-pushed the kuhe/chore/verification branch 3 times, most recently from 046087a to e4f806b Compare October 30, 2026 17:22
@kuhe kuhe changed the title Restructure verification into static-analysis / test-unit / test-functional / test-integration Normalize verification and test targets Oct 30, 2026
@kuhe kuhe changed the title Normalize verification and test targets Standardize verification and test targets Oct 30, 2026
@kuhe
kuhe marked this pull request as ready for review October 30, 2026 17:33
@kuhe
kuhe requested a review from a team as a code owner October 30, 2026 17:33
@kuhe
kuhe force-pushed the kuhe/chore/verification branch from e4f806b to 085752d Compare October 30, 2026 17:33
@kuhe
kuhe merged commit e6cdac0 into develop Oct 30, 2026
11 checks passed
Comment thread Makefile


test-unit: ## Runs the python unit tests.
uv run pytest packages/*/tests/unit

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With a command like this, we saw issues in the past where test files with the same names in different packages would cause some tests not to get run. Related PR: #521

Can you investigate to see if this is still an issue or now?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

supposedly fixed in #524

@kuhe
kuhe deleted the kuhe/chore/verification branch October 30, 2026 19:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants