Directory Download

The program is writtent to download directory content recursively.

Setting Virtual Envirnment

virtualenv myenv

Activate virtual Environment

source myenv/bin/activate

Install Dependencies

pip install -r requirements.txt

How to run

Insert your url on mycall = Crawler("http://example.com/package")

and then simply hit this, this will download all files on temp directory on the location its been run python download_directory.py

Returning to host

deactivate