In this project, I chose to use DBT due to its orchestration layer that makes it easy to write code, and then push it down onto a database, as well as its great CI/CD and documentation features
Goals and Deliverables:
- README file: Describe the data mart columns, the grain of the data mart, and tests to catch any incidental duplication.
- schema.yml file: Include key data for the mart (columns and their descriptions).
- DBT tests that test quality of the data using both SQL and jinja.
- Include a tap, ideally in the main project files.
- Ensure the DBT project structure is sound following DBT's best practices.