Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(scrapers.update_from_text): new command #4520

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

feat(scrapers.update_from_text): new command #4520

wants to merge 12 commits into from

Commits on Oct 1, 2024

  1. feat(scrapers.update_from_text): new command 

    Helps solve: freelawproject/juriscraper#858

- New command to re-run Site.extract_from_text over downloaded opinions
- Able to filter by Docket.court_id ,  OpinionCluster.date_filed, OpinionCluster.precedential_status
- Updates tasks.update_from_document_text to return information for logging purposes
- Updates test_opinion_scraper to get a Site.extract_from_text method
    @grossir
    grossir committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    d871b4a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into scrapers_update_from_text_command

    @grossir
    grossir authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    f516f13 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Merge branch 'main' into scrapers_update_from_text_command

    @flooie
    flooie authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    79c8c0a View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Merge branch 'main' into scrapers_update_from_text_command

    @grossir
    grossir committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    143e6de View commit details
    Browse the repository at this point in the history

  2. refactor(scrapers.update_from_text): change function name and docstring

    @grossir
    grossir committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    5adce99 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into scrapers_update_from_text_command

    @flooie
    flooie authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    3bc0f8e View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Merge branch 'main' into scrapers_update_from_text_command

    @grossir
    grossir authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    5baa691 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. feat(scrapers.update_from_text): refactor from code review 

    - validate citation objects from `Site.extract_from_text`. Add tests for this
- abstract --courts required argument for scrapers into ScraperCommand class
also, made it more flexible
- refactor cl_scrape_opinions; cl_scrape_oral_arguments to account for this
- delete cl.scrapers.utils.extract_recap_documents which was generating a
circular import. This function was not used anywhere
    @grossir
    grossir committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    ce22a58 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into scrapers_update_from_text_command

    @grossir
    grossir committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    401342b View commit details
    Browse the repository at this point in the history

  3. fix(scrapers.tests): UpdateFromTextTest fix dates input type

    @grossir
    grossir committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    abc27aa View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into scrapers_update_from_text_command

    @grossir
    grossir authored Nov 8, 2024
    Configuration menu
    Copy the full SHA
    e89cf16 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. Merge branch 'main' into scrapers_update_from_text_command

    @grossir
    grossir authored Nov 11, 2024
    Configuration menu
    Copy the full SHA
    1e716f0 View commit details
    Browse the repository at this point in the history