Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(ingest/bigquery): Improve memory usage of lineage extraction #7326

Merged
merged 7 commits into from
Feb 13, 2023
Merged

fix(ingest/bigquery): Improve memory usage of lineage extraction #7326

merged 7 commits into from
Feb 13, 2023

Commits on Feb 12, 2023

  1. - Fix for not clearing bigquery table cache which caused to carry ove… 

    …r tables from one project to the other

- Fixing range partition profiling
- Fixing peak memory report
    @treff7es
    treff7es committed Feb 12, 2023
    Configuration menu
    Copy the full SHA
    1e57de7 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2023

  1. PR review fixes 

    Adding tests
    @treff7es
    treff7es committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    a4da49b View commit details
    Browse the repository at this point in the history

  2. Fixing test

    @treff7es
    treff7es committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    82f4e32 View commit details
    Browse the repository at this point in the history

  3. Fixing error printing

    @treff7es
    treff7es committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    1aa953a View commit details
    Browse the repository at this point in the history

  4. Adding a 3.7 compatible arg check

    @treff7es
    treff7es committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    55cba69 View commit details
    Browse the repository at this point in the history

  5. Lower memory usage of bigquery lineage extraction

    @treff7es
    treff7es committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    9f0a32b View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into lineage_mem_improve

    @treff7es
    treff7es committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    f4ddaea View commit details
    Browse the repository at this point in the history