CloudBees Smart Tests uses AI to run the tests most relevant to each code change, so teams get faster feedback, less flaky-test noise, and lower CI waste across the tools and pipelines they already use.

Learn more and sign up: https://www.cloudbees.com/capabilities/cloudbees-smart-tests

What this app does

This GitHub App is how you connect your repositories to Smart Tests and start collecting test data – no CI instrumentation, scripts or manual uploads required.

Setup is self-service and only takes a few minutes:

1. In your CloudBees organization, open Smart Tests and navigate to Settings → "Quick setup with GitHub" and click Install
2. Authorize the app on your GitHub organization and choose which repositories to share
3. Add the Smart Tests GitHub Action to your workflows so test runs are always recorded as artifacts

Once connected, the app automatically streams test results, commit history, and CI run artifacts from your selected repos into your own Smart Tests workspace.

What’s the outcome: Smart Tests simply learns from your test execution performance and generates a confidence curve – a clear, data-backed view of the time savings and risk/reward it could deliver for your suite.

Think of it as a no-risk evaluation: collect data first, see the potential impact, then decide what threshold you wish to operate at.

Product overview - Ship faster. Test smarter. Spend less on CI.

Predictive Test Selection

Run the tests most relevant to each code change. Smart Tests uses your historical test
execution data to build relationships between code and test failures to significantly cut CI time and cost – without sacrificing much coverage.

AI-powered test failure analysis

Group failures by root cause and separate real problems from flaky noise, so your team
spends less time triaging and more time fixing.

Test Insights & Trends

See how your test suite behaves over time – flaky and noisy tests, long-running tests, reliability
trends, and how tests are behaving in your CI.