This repository has been archived by the owner on Apr 22, 2022. It is now read-only.

Ingest images from Flicker using Airflow with backfill #33

Open

abij opened this issue Sep 20, 2019 · 0 comments

Contributor

abij commented Sep 20, 2019

Now there is a download-category.py which downloads the files locally.
And an put-catagories.py to upload in ElasticSearch.

These can be combined in a nice Airflow DAG that is responsible for a certain time-period.
For example: images from 20-sept for a given category.

This could run for multiple days in the past.

The text was updated successfully, but these errors were encountered:

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.