This repository is responsible for ingest data from an external API, here I'm using Faker API, anonymize the data, store it in a database and generate a report. The database used is SQLite
Before you start getting your hands dirty it's important that you learn the concepts behind the code structure.
Our architecture is based on Clean Architecture, if you want to get into the details about this architecture
you can take a look at Robert C. Martin's blog post.
As mentioned, our architecture is based on Clean Architecture so there are some minor differences, this is how the files should be organized:
src/
commom/
extractor/
handlers/
loader/
transformer/
tests/
unit/
These instructions will get you a copy of the service up and running on your local machine for development and testing purposes.
Make sure you have all the following prerequisites:
This service uses Python version 3.8. To download and install the version got to the python page here.
After cloning this repository, on the root folder just type make
The Makefile will install the dependencies and execute the pipeline and the report
This repository execute three queries to retrieve and print the result to answer the questions below
1- Which percentage of users live in Germany and use Gmail as an email provider?
2- Which are the top three countries in our database that use Gmail as an email
provider?
3- How many people over 60 years use Gmail as an email provider?