Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Copy all run and out dirs at once, not in for-loop #3025

Merged
merged 55 commits into from
Jan 21, 2023
Merged

Copy all run and out dirs at once, not in for-loop #3025

merged 55 commits into from
Jan 21, 2023

Commits on Aug 31, 2022

  1. move remote copy outside for-loop

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    1d719d5 View commit details
    Browse the repository at this point in the history

  2. put back some mkdir and copy steps

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    f3b79bf View commit details
    Browse the repository at this point in the history

  3. go up a directory to copy to outdir/out not outdir/out/out

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    ed1d334 View commit details
    Browse the repository at this point in the history

  4. update changelog

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    3795f0c View commit details
    Browse the repository at this point in the history

  5. only print unique jobids

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    693e981 View commit details
    Browse the repository at this point in the history

  6. move copying files back to outside of for loop.

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    41df050 View commit details
    Browse the repository at this point in the history

  7. Merged upstream/develop into remote-copy

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    5a8f90c View commit details
    Browse the repository at this point in the history

  8. comments

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    132997f View commit details
    Browse the repository at this point in the history

  9. more todos

    @Aariq
    Aariq committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    e57dd5d View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2022

  1. Merge branch 'develop' into remote-copy

    @dlebauer
    dlebauer committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    5678889 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2022

  1. added Sys.sleep() b/c settings$host$outdir still not getting copied o… 

    …ver always.
    @Aariq
    Aariq committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    4286732 View commit details
    Browse the repository at this point in the history

  2. print informative errors

    @Aariq
    Aariq committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    c8b9240 View commit details
    Browse the repository at this point in the history

  3. remove sys.sleep--shouldn't be necessary

    @Aariq
    Aariq committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    7427d16 View commit details
    Browse the repository at this point in the history

  4. remove non-ascii chars

    @Aariq
    Aariq committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    abbc021 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    67905b8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    61b50c0 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    f45f38e View commit details
    Browse the repository at this point in the history

  2. add specific comments

    @Aariq
    Aariq committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    b8331a4 View commit details
    Browse the repository at this point in the history

  3. copy over just log files

    @Aariq
    Aariq committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    b73c2f5 View commit details
    Browse the repository at this point in the history

  4. comment out custom errors---not quite working. Save for another PR

    @Aariq
    Aariq committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    f6ba486 View commit details
    Browse the repository at this point in the history

  5. fix rsync syntax error

    @Aariq
    Aariq committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    d02858e View commit details
    Browse the repository at this point in the history

  6. correct filepath to logs

    @Aariq
    Aariq committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    17346d9 View commit details
    Browse the repository at this point in the history

  7. Merged upstream/develop into remote-copy

    @Aariq
    Aariq committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    a0baba2 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    01ac887 View commit details
    Browse the repository at this point in the history

  2. fix rsync --exclude flag

    @Aariq
    Aariq committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    78db328 View commit details
    Browse the repository at this point in the history

  3. Merged upstream/remote-copy into remote-copy

    @Aariq
    Aariq committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    714a698 View commit details
    Browse the repository at this point in the history

  4. system2 already uses shQuote() internally.

    @Aariq
    Aariq committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    4bfb1c3 View commit details
    Browse the repository at this point in the history

  5. enable informative errors

    @Aariq
    Aariq committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    3b8a52c View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    725b991 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    dc4a577 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2022

  1. copy over only ensemble directories

    @Aariq
    Aariq committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    e59188d View commit details
    Browse the repository at this point in the history

  2. no need to mkdir, rsync does this

    @Aariq
    Aariq committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    44a1b0b View commit details
    Browse the repository at this point in the history

  3. try adding a pause??

    @Aariq
    Aariq committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    a02c00b View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2022

  1. Merged upstream/develop into remote-copy

    @Aariq
    Aariq committed Oct 13, 2022
    Configuration menu
    Copy the full SHA
    f397c40 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    b64eb80 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    3380b97 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Nov 1, 2022
    Configuration menu
    Copy the full SHA
    3d4ab9f View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2022

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    6fa5063 View commit details
    Browse the repository at this point in the history

  2. copy run dirs first, then out

    @Aariq
    Aariq committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    0d20cc1 View commit details
    Browse the repository at this point in the history

  3. make rsync errors logger level severe

    @Aariq
    Aariq committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    d4b3df2 View commit details
    Browse the repository at this point in the history

  4. whoops, fixed prev commit

    @Aariq
    Aariq committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    ff1e4af View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2022

  1. wrap initial rsync steps in retry.func()

    @Aariq
    Aariq committed Nov 30, 2022
    Configuration menu
    Copy the full SHA
    1afd382 View commit details
    Browse the repository at this point in the history

  2. add sleep to retry

    @Aariq
    Aariq committed Nov 30, 2022
    Configuration menu
    Copy the full SHA
    f6f1e34 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2022

  1. add more retry

    @Aariq
    Aariq committed Dec 1, 2022
    Configuration menu
    Copy the full SHA
    93f7155 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. document() totally unrelated package

    @Aariq
    Aariq committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    780b9f1 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2022

  1. Merge branch 'develop' into remote-copy

    @dlebauer
    dlebauer committed Dec 19, 2022
    Configuration menu
    Copy the full SHA
    76d825b View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2023

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Jan 3, 2023
    Configuration menu
    Copy the full SHA
    f7d1d0f View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2023

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    e4289c3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    9141d3b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    c8cda6e View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2023

  1. Merge branch 'develop' into remote-copy

    @Aariq
    Aariq committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    61dd672 View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2023

  1. Merge branch 'develop' into remote-copy

    @robkooper
    robkooper committed Jan 19, 2023
    Configuration menu
    Copy the full SHA
    2b1a3ed View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2023

  1. add shQuote(args) back

    @Aariq
    Aariq committed Jan 20, 2023
    Configuration menu
    Copy the full SHA
    35eb512 View commit details
    Browse the repository at this point in the history

  2. remove rsync status messages

    @Aariq
    Aariq committed Jan 20, 2023
    Configuration menu
    Copy the full SHA
    bdf2095 View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2023

  1. Merge branch 'develop' into remote-copy

    @infotroph
    infotroph committed Jan 21, 2023
    Configuration menu
    Copy the full SHA
    aeb0bc0 View commit details
    Browse the repository at this point in the history