Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SNOW-13, SNOW-15] Add scheduled tasks to daily ingest parquet data #1

Merged
merged 26 commits into from
Oct 18, 2023
Merged

[SNOW-13, SNOW-15] Add scheduled tasks to daily ingest parquet data #1

merged 26 commits into from
Oct 18, 2023

Commits on Oct 13, 2023

  1. Add userprofile scheduled task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    ef20b8e View commit details
    Browse the repository at this point in the history

  2. Create node snapshot scheduled task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    f3773b4 View commit details
    Browse the repository at this point in the history

  3. Add certified task scheduled task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    e6ab99a View commit details
    Browse the repository at this point in the history

  4. Create certified quiz question task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    1a7aca6 View commit details
    Browse the repository at this point in the history

  5. Add in scheduled task for file downloads

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    3c44497 View commit details
    Browse the repository at this point in the history

  6. Create acl snapshots scheduled task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    6ec742f View commit details
    Browse the repository at this point in the history

  7. Shift sql query to another script

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    f15cd53 View commit details
    Browse the repository at this point in the history

  8. Scheduled team snapshots tasks

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    315814d View commit details
    Browse the repository at this point in the history

  9. Create user profile scheduled tasks

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    3bb5b33 View commit details
    Browse the repository at this point in the history

  10. Create vertificiation sub snapshot task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    6208a7a View commit details
    Browse the repository at this point in the history

  11. Create team member snapshot task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    57cb63f View commit details
    Browse the repository at this point in the history

  12. Add in file upload task

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    3d469e7 View commit details
    Browse the repository at this point in the history

  13. Create file snapshot tasks

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    657af7d View commit details
    Browse the repository at this point in the history

  14. Add in processed access record task and remove dead code

    @thomasyu888
    thomasyu888 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    87b3344 View commit details
    Browse the repository at this point in the history

  15. Merge branch 'main' into SNOW-13-add-scheduled-tasks

    @thomasyu888
    thomasyu888 authored Oct 13, 2023
    Configuration menu
    Copy the full SHA
    211bcc3 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Alter task

    @thomasyu888
    thomasyu888 committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    233b768 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Merge branch 'SNOW-13-add-scheduled-tasks' of github.com:Sage-Bionetw… 

    …orks/snowflake into SNOW-13-add-scheduled-tasks
    @thomasyu888
    thomasyu888 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    ac924df View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into SNOW-13-add-scheduled-tasks

    @thomasyu888
    thomasyu888 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    4a46043 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into SNOW-13-add-scheduled-tasks

    @thomasyu888
    thomasyu888 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    59eb7cc View commit details
    Browse the repository at this point in the history

  4. Update tasks

    @thomasyu888
    thomasyu888 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    ff8ff33 View commit details
    Browse the repository at this point in the history

  5. Execute sqlfluff to lint

    @thomasyu888
    thomasyu888 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    8178e72 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Add md5 function

    @thomasyu888
    thomasyu888 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    527e6e3 View commit details
    Browse the repository at this point in the history

  2. Add md5 hashing and remove filename from key

    @thomasyu888
    thomasyu888 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    d8919c8 View commit details
    Browse the repository at this point in the history

  3. hash md5 and replace filename from key

    @thomasyu888
    thomasyu888 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    f453ed9 View commit details
    Browse the repository at this point in the history

  4. Fix end statement

    @thomasyu888
    thomasyu888 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    ecd78ce View commit details
    Browse the repository at this point in the history

  5. Add MD5 key

    @thomasyu888
    thomasyu888 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    73c1d1a View commit details
    Browse the repository at this point in the history