Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

docs: add example for Pytorch flexible primitives [DET-3202] #778

Merged
merged 1 commit into from
Jul 3, 2020
Merged

docs: add example for Pytorch flexible primitives [DET-3202] #778

merged 1 commit into from
Jul 3, 2020

Conversation

shiyuann
Copy link
Contributor

@shiyuann shiyuann commented Jun 25, 2020 •
edited
Loading

Description

Add an example with multiple models and multiple optimizers with the new Pytorch primitives.

Test Plan

  1. Manually train this model and check if it's successfully trained. Use TensorBoard to check on the generated images.
  2. Have tested it with parallel training.

Commentary (optional)

Please only review the second commit.

@cla-bot cla-bot bot added the cla-signed label Jun 25, 2020
rb-determined-ai
rb-determined-ai reviewed Jun 25, 2020
View reviewed changes
examples/experimental/native/flexible_primitives_mnist_pytorch/data.py Outdated Show resolved Hide resolved
examples/experimental/native/flexible_primitives_mnist_pytorch/model_def.py Outdated Show resolved Hide resolved
examples/experimental/native/flexible_primitives_mnist_pytorch/model_def.py Outdated Show resolved Hide resolved
examples/experimental/native/flexible_primitives_mnist_pytorch/model_def.py Outdated Show resolved Hide resolved
examples/experimental/native/flexible_primitives_mnist_pytorch/model_def.py Outdated Show resolved Hide resolved
examples/experimental/native/flexible_primitives_mnist_pytorch/model_def.py Outdated Show resolved Hide resolved
examples/experimental/native/flexible_primitives_mnist_pytorch/model_def.py Outdated Show resolved Hide resolved
@shiyuann shiyuann force-pushed the pytorch/example branch 10 times, most recently from d272c4c to 2b44277 Compare June 29, 2020 07:57
@shiyuann shiyuann force-pushed the pytorch/example branch 2 times, most recently from 34f7aeb to 42f5632 Compare June 30, 2020 21:45
@shiyuann shiyuann assigned rb-determined-ai and unassigned shiyuann and katport Jul 1, 2020
@shiyuann shiyuann assigned shiyuann and unassigned rb-determined-ai Jul 3, 2020
@shiyuann shiyuann merged commit 3d42608 into determined-ai:master Jul 3, 2020
@shiyuann shiyuann deleted the pytorch/example branch July 3, 2020 03:46
hamidzr added a commit to hamidzr/determined that referenced this pull request Jul 7, 2020
@hamidzr
Merge in upstream/master.
ab7fc57 
Squashed commit of the following:

commit 8f45512
Author: Shiyuan <[email protected]>
Date:   Tue Jul 7 12:31:56 2020 -0700

    test: add nightly test for pytorch flexible primitive example [DET-3534] (determined-ai#827)

    * fix: fix GAN example.

    * test: add nightly test for flexible primitive example

commit e501ea0
Author: Caleb Hoyoul Kang <[email protected]>
Date:   Tue Jul 7 12:07:40 2020 -0600

    feat: experiment list filter [DET-2999, DET-3000] (determined-ai#796)

commit a1b494e
Author: Sidney Wijngaarde <[email protected]>
Date:   Tue Jul 7 12:39:11 2020 -0400

    feat: model versions endpoints [DET-3478] (determined-ai#822)

    Endpoints for managing model versions.

commit 21fb956
Author: Hamid Zare <[email protected]>
Date:   Mon Jul 6 16:36:14 2020 -0700

    fix: fix an issue with cluster resource computation [DET-3509] (determined-ai#832)

    repeat after me: "in JS Array.push does NOT return the resulting array"

commit 1c5d151
Author: naren-determined <[email protected]>
Date:   Mon Jul 6 14:51:21 2020 -0700

    feat: added cli logging to native (determined-ai#833)

    * feat: Native API Logging Improvement [DET-3316]

    * feat: added logging for native

    * feat: added cli logging to native [DET-3316]

    * fix: order of imports for linting

    * fix: migrated logs function from cli to common [DET-3316]

    * fix: trial log path [DET-3316]

    * fix: linting for cli trial.py [DET-3316]

    * buggy test [DET-3316]

    * buggy test part 2 [DET-3316]

    * buggy test number 3 [DET-3316]

    * authentication fix native logging [DET-3316]

    * fix linting native logging [DET-3316]

    * moving authentication_required to common api [DET-3316]

    * fix: added authentication_required to authentication in common [DET-3316]

    * feat: add cli logging to native

commit 6843c8f
Author: katport <[email protected]>
Date:   Mon Jul 6 12:07:21 2020 -0700

    feat: add unets tf.keras example [DET-3397] (determined-ai#825)

commit a9d7007
Author: Yoni Ben-tzur <[email protected]>
Date:   Fri Jul 3 21:52:07 2020 -0700

    feat: clean up swagger spec (determined-ai#823)

commit afc6e3f
Author: naren-determined <[email protected]>
Date:   Thu Jul 2 22:59:49 2020 -0700

    revert: added cli logging to native. (determined-ai#821)

    * Revert "feat: added cli logging to native [DET-3316] (determined-ai#788)"

    This reverts commit 0c99a0c.

    * fix: revert to previous commit

commit 3d42608
Author: Shiyuan <[email protected]>
Date:   Thu Jul 2 20:45:59 2020 -0700

    docs: add example for Pytorch flexible primitives [DET-3202] (determined-ai#778)

commit 0c99a0c
Author: naren-determined <[email protected]>
Date:   Thu Jul 2 19:07:53 2020 -0700

    feat: added cli logging to native [DET-3316] (determined-ai#788)

    * feat: Native API Logging Improvement [DET-3316]

    * feat: added logging for native

    * feat: added cli logging to native [DET-3316]

    * fix: order of imports for linting

    * fix: migrated logs function from cli to common [DET-3316]

    * fix: trial log path [DET-3316]

    * fix: linting for cli trial.py [DET-3316]

    * buggy test [DET-3316]

    * buggy test part 2 [DET-3316]

    * buggy test number 3 [DET-3316]

    * authentication fix native logging [DET-3316]

    * fix linting native logging [DET-3316]

    * moving authentication_required to common api [DET-3316]

    * fix: added authentication_required to authentication in common [DET-3316]
tayritenour pushed a commit to tayritenour/determined that referenced this pull request Apr 25, 2023
@stoksc @dzhu
refactor(dispatcherrm): split fetch HPC resources out (determined-ai#778
f075fe5 
) [DET-9168]
eecsliu pushed a commit to eecsliu/determined that referenced this pull request Jun 23, 2023
@stoksc @determined-ci
refactor(dispatcherrm): split fetch HPC resources out (determined-ai#778
cdbe4ad 
) [DET-9168]
stoksc added a commit that referenced this pull request Jun 26, 2023
@stoksc @hanyucui
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
0016221
eecsliu pushed a commit that referenced this pull request Jun 28, 2023
@stoksc @NicholasBlaskey
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
787f411
eecsliu pushed a commit that referenced this pull request Jun 28, 2023
@stoksc
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
32a8de0
stoksc added a commit that referenced this pull request Jul 20, 2023
@stoksc @EmilyBonar
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
0b3f4e1
eecsliu pushed a commit that referenced this pull request Jul 24, 2023
@stoksc @eecsliu
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
993f0aa
stoksc added a commit that referenced this pull request Oct 17, 2023
@stoksc @NicholasBlaskey
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
df08414
azhou-determined pushed a commit that referenced this pull request Dec 7, 2023
@stoksc @azhou-determined
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
67be532
wes-turner pushed a commit that referenced this pull request Feb 2, 2024
@stoksc @determined-ci
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
021ae12
@dannysauer dannysauer added this to the 0.12.11 milestone Feb 6, 2024
rb-determined-ai pushed a commit that referenced this pull request Feb 29, 2024
@stoksc @djanicekpach
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
4610776
amandavialva01 pushed a commit that referenced this pull request Mar 18, 2024
@stoksc @determined-ci
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
ed42683
eecsliu pushed a commit that referenced this pull request Apr 18, 2024
@stoksc @determined-ci
refactor(dispatcherrm): split fetch HPC resources out (#778) [DET-9168]
49d1069
eecsliu pushed a commit to determined-ai/determined-release-testing that referenced this pull request Apr 22, 2024
@stoksc @eecsliu
refactor(dispatcherrm): split fetch HPC resources out (determined-ai#778
76c94fc 
) [DET-9168]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@katport katport katport left review comments

@rb-determined-ai rb-determined-ai rb-determined-ai approved these changes

@aaron276h aaron276h Awaiting requested review from aaron276h

Assignees

@shiyuann shiyuann

Labels
cla-signed
Projects
None yet
Milestone
0.12.11
Development

Successfully merging this pull request may close these issues.
4 participants
@shiyuann @rb-determined-ai @katport @dannysauer