Madeline Powers, [email protected], April 28, 2024
This repository contains an analysis of the topics of subreddits using topic modeling with scikit learn on a large dataset of reddit comments.
The data used for this project was collected specifically for it, using PRAW. It is included in the repository in partial form, and can be reconstructed using the unredact_data.py script.
- final_report.md: Final report for the project.
- data/: directory containing partial data files, used for data reconstructin
- data_samples/: directory containing samples of the full data
- images/: directory containing plot images
- notebooks/: directory for jupyter notebooks
- data_exploration.ipynb: initial exploration and cleanup of data (nbviewer)
- clustering.ipynb: document clustering and analysis (nbviewer)
- scripts/: directory for python scripts
- scrape_top_subreddits.py: script for gathering a list of the top n subreddits
- scrape_comments.py: script for scraping comments from reddit
- redact_data.py: script to produce the partial data files
- unredact_data.py: script to reconstruct dataset
- presentation.pdf: presentation given in class
- progress_report.md: progress reports written during the project
- project_plan.md: initial plan for project