Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

0673 spider chi ohare noise #972

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
Open

0673 spider chi ohare noise #972

wants to merge 13 commits into from

Commits on Jul 9, 2020

  1. First commit for chicago ohare noise

    @stmfunk
    stmfunk committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    3352066 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2020

  1. Added code to parse meeting tile

    @stmfunk
    stmfunk committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    15b6cf6 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2020

  1. Added request code to retrieve subpages. Added code to retrieve start… 

    … and end times from root page. Need to modify routines to retrieve data from subpages and format as meeting items
    @stmfunk
    stmfunk committed Jul 23, 2020
    Configuration menu
    Copy the full SHA
    fcca613 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2020

  1. Updated _parse_title to retrieve from subpage

    @stmfunk
    stmfunk committed Jul 29, 2020
    Configuration menu
    Copy the full SHA
    16973d3 View commit details
    Browse the repository at this point in the history

  2. Added location parsing

    @stmfunk
    stmfunk committed Jul 29, 2020
    Configuration menu
    Copy the full SHA
    f7147ad View commit details
    Browse the repository at this point in the history

  3. Completed data collection from basic page. Next item on the agenda is… 

    … to unify data from other urls to obtain minutes and agenda urls
    @stmfunk
    stmfunk committed Jul 29, 2020
    Configuration menu
    Copy the full SHA
    c6d69e0 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2020

  1. Finished the scraper ohare1. Next item is to unify the data from both… 

    … scrapers
    @stmfunk
    stmfunk committed Aug 8, 2020
    Configuration menu
    Copy the full SHA
    ec1a12e View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2020

  1. Finished merging scrapers. Was unable to mesh data on crawl, should i… 

    …deally be tried in database. Fixed formatting with flake8, isort and black. Begin making tests
    @stmfunk
    stmfunk committed Aug 19, 2020
    Configuration menu
    Copy the full SHA
    58fb97b View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2020

  1. Deleted swap files

    @stmfunk
    stmfunk committed Aug 22, 2020
    Configuration menu
    Copy the full SHA
    964e2ab View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2020

  1. Implemented status and classification methods.

    @stmfunk
    stmfunk committed Aug 28, 2020
    Configuration menu
    Copy the full SHA
    e6d8234 View commit details
    Browse the repository at this point in the history

  2. Added vim swap file to gitignore

    @stmfunk
    stmfunk committed Aug 28, 2020
    Configuration menu
    Copy the full SHA
    dc8f7fb View commit details
    Browse the repository at this point in the history

  3. Added all primary tests for first subspider. Matching tests for secon… 

    …d subspider should round out the code.
    @stmfunk
    stmfunk committed Aug 28, 2020
    Configuration menu
    Copy the full SHA
    f3e3066 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2020

  1. Finished making tests. Ran and finalized linting and style-checking

    @stmfunk
    stmfunk committed Sep 9, 2020
    Configuration menu
    Copy the full SHA
    4eb0409 View commit details
    Browse the repository at this point in the history