Scrapes the BBC Igbo and Igbo Radio daily.
A depth-driven search script is used to find all most recent articles starting from the homepage of BBC Igbo.
The scraper goes to all category links in the navigation bar, and navigates to each article found on each page of the categories page.
Install the project dependencies:
yarn install
Build the project:
yarn build
To scrape and save BBC Igbo articles, run:
yarn start
To scrape Igbo Radio articles, run:
yarn start:igbo_radio
You can also run the dev watch server for hot reloading:
yarn dev