The purpose of this project is to create a data pipeline for intel analyst, looking
to expedite the use of open source twitter data. The specific use case that is being
presented here, is to collect open source images of maritime vessels in an effort
to verify the position of vessels based on an image being capture while they are
close to shore.
Explore the docs »
Table of Contents
- Get a free Twitter API Key at Twitter
- Establish an AWS account at AWS
- Clone the repo
git clone https://github.com/zacharybenson/repo_name.git
- Install requirements.txt
pip install -r requirements.txt
- Go to utilities files, and fill in api keys.
- aws_custom
- postgrees
To use this repo, execute the pipeline notebook or use pipeline.py to run the script on a schedule.
Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.
If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!
- Fork the Project
- Create your Feature Branch (
git checkout -b feature/AmazingFeature) - Commit your Changes (
git commit -m 'Add some AmazingFeature') - Push to the Branch (
git push origin feature/AmazingFeature) - Open a Pull Request
Distributed under the MIT License. See LICENSE.txt for more information.
Zachary Benson - @Linkedin
Project Link: https://github.com/zacharybenson/TWITTER_PIPELINE