Holvoo.net Crawler

A scrapy web crawler for holvoo.net.

Make sure scrapy is installed, if not available, please use the following command to install scrapy.

pip install scrapy

This project is built using scrapy 1.4.0

Run the crawler:

scrapy crawl articles

Due to the large amount of data, the process can take several hours to complete.