Skip to content

Latest commit

 

History

History
32 lines (28 loc) · 1.27 KB

README.md

File metadata and controls

32 lines (28 loc) · 1.27 KB
Raw

Blackboard Scraper

Script for locally downloading all files from your personal Blackboard page

Requirements

  • Python 3.9 or up
  • Beautiful Soup 4
pip install beautifulsoup4
  • Requests
pip install requests

Steps

  1. Login to Blackboard
  2. On the home page (where the course list is) right click anywhere on the screen and click "inspect" to open the developer tools
  3. Look for the "Network" tab and open it
  4. Refresh the page
  5. You'll see a lot of requests appear. Find the first one and right click on it.
  6. Click copy then copy as cURL

Screenshot 2022-07-26 at 20 33 22

  1. Go to https://curlconverter.com/ and paste the cURL request into it to get the request headers and cookies in Python
  2. Copy the headers and cookies variables and paste them into headers.py
  3. Go back to the Blackboard homepage and open the Console tab in the developer tools
  4. Copy the contents of getCourseLinks.js and paste it into the console and press Enter.
  5. Right click on the output and click "Copy Object"
  6. Paste the object in place of #PASTE HERE in course_links.py
  7. Save changes
  8. Run python3 scrape.py to start downloading