New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Other data sources; new scrapers #31

Open

3 of 8 tasks

alanhdu opened this issue Feb 21, 2015 · 0 comments

Labels

alanhdu commented Feb 21, 2015

Right now, our events come only from Facebook. It'd be nice to get other events from other sources:

Data sources

Facebook
~~Columbia UEM~~ (Not doing)
Web scraping
- http://events.columbia.edu Web scraping: http://events.columbia.edu #47
- http://events.engineering.columbia.edu/ Scrape events from columbia engineering #59

If we add other data sources, we'd have to set up some considerable infrastructure:

Structured way of defining new data sources (maybe a data source bass class?)
Detect duplicate events
Match up FB names and UEM names

alanhdu added the wishlist label

alanhdu added in progress metaissue and removed in progress wishlist labels

sunyang713 removed the in progress label

sunyang713 changed the title ~~Other data sources~~ Other data sources; new scrapers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment