Skip to content

Latest commit

 

History

History
54 lines (45 loc) · 1.26 KB

README.md

File metadata and controls

54 lines (45 loc) · 1.26 KB
Raw

Introduction

This is a demo project for PipeRider. It shows how you can use dbt+duckdb+PipeRider to transform and query data efficiently. With these tools, you can generate a report that gives you insights into your git projects.

Usage

  1. Clone this repo

    git clone [email protected]:InfuseAI/git-repo-analytics.git

  2. Prepare git repositories repo for analysis by editing the repos.csv

    The format of the repos.csv file is as follows:

    name,repo
dbt-core,dbt-labs/dbt-core
duckdb,duckdb/duckdb
PipeRider,InfuseAI/piperider

  3. Install python package

    python -m venv ./venv
source ./venv/bin/activate
pip install -r requirements.txt

  4. Generate the db file from the repo.

    make fetch
make load

    The file git_repo.duckdb is generated under ./data

  5. Run dbt

    make transform

  6. Generate report

    make report

  7. Run piperider

    make piperider

You can either run step-by-step from step4 to step7 or simply do one command

make

Screenshots