Skip to content

maxcohen31/Italian-real-estate-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Italian-real-estate-scraper

Real estate spider made by using Scrapy framework

Run Locally

Clone the project

  git clone https://github.com/maxcohen31/Amazon-book-scraper.git

Setup a virtual enviroment

To set up a virtual enviroment you can either use

virtualenv realestatescraper ; source bin/activate
pip install scrapy

or

python3 venv -m realestatescraper ; source bin/activate
pip install scrapy

Go to the project directory

  cd Italian\ Real\ Estate/realestate/spiders

Run the crawler - links

  python3 real_estate_link_extractor.py

Run the crawler - properties

  python3 real_estate_scraper.py

Disclaimer

This code is for teaching purpose only. I will not be liable for any damages you may suffer from modifying, using or distributing this script.

About

Web crawler made using Scrapy framework

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages