Skip to content
This repository was archived by the owner on May 16, 2022. It is now read-only.
This repository was archived by the owner on May 16, 2022. It is now read-only.

CI:Add Automated Result Set Validation #17

Description

@mrzzy

Motivation

Currently, the CI only runs the exercise SQL against the Sakila Database:

  • This only ensures that the SQL successfully executes, but not if the SQL produces the correct result set.
  • Need for correctness validation so that users can ensure the queries they executed are correct.

Requirements

  • Able to collect the result set for each SQL exercise query.
  • Perform data validation on the result query against expected result.
  • Data validation should be handle variations in row order, column names etc.

Proposal

  • Add test/%.sql Project Makefile target to test an Exercise SQL:
    • captures the result set of running the SQL query as CSV.
    • uses Great Expectations to validate the result.
  • Add test-exercises job to CI to automate SQL query testing.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: cicdArea of concern: Github Actions CI/CDarea: testingArea of concern: Data Validation / Testing

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions