Web Scraper for Woolworths Website
This project is a web scraper built using Python, Requests, and BeautifulSoup. It retrieves information from the Woolworths website related to drinks. The scraper navigates through the website, extracts relevant data, and saves it to a text file.
To run this project locally, please follow the steps below:
1- Clone the repository:
git clone https://github.com/khouloud504/data_scraper.git
2- Navigate to the project directory:
cd data_scraping
3- Install the required dependencies:
pip install -r requirements.txt
4- Run the scraper:
python scraper.py
The extracted information will be saved to the 'output.txt' file.
The scope of this project is to demonstrate web scraping techniques using Python. It focuses on extracting data from the Woolworths website related to drinks, specifically cordials, juices, and iced teas. The scraper uses the Requests library to make HTTP requests, Selenium for web automation, and BeautifulSoup for parsing the HTML content.