We have created a webscraper that pulls out data from ecommerce websites like Amazon, Flipkart and Snapdeal. Based on the search keyword, the web crawler searches through multiple pages on each website and the web scraper will scrape out the desired data.
Putting the desired data in a csv file. Later, cleaning the data to display it on a webpage in the form of results.
- BeautifulSoup
- requests
- selenium
- Download the code and unzip the files
- Install Python 3.7 or 3.8
- Download the required packages
- Create a configuration file with script and python interpreter
- Execute code
- Enter search keyword on homepage