Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

Deepspeed integration #4693

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
e2ac4b5
first draft of deepspeed trainer
jacobdanovitch Oct 2, 2020
619657e
delegating grad_clipping, grad_norm, grad_acculumation, etc. to deeps…
jacobdanovitch Oct 2, 2020
a329fd2
cleaning up deepspeed config interface
jacobdanovitch Oct 2, 2020
00666c2
idenifying bottleneck / start simplifying model engine
jacobdanovitch Oct 7, 2020
f0da3bf
1416 LOC -> 562
jacobdanovitch Oct 10, 2020
d0e8a68
debugging memory leak
jacobdanovitch Oct 28, 2020
0a74573
functioning / cleaner prototype
jacobdanovitch Oct 31, 2020
eaf8aa5
Merge branch 'master' into jacobdanovitch/deepspeed
jacobdanovitch Nov 2, 2020
498d3a2
checkpointing works e2e
jacobdanovitch Nov 2, 2020
a211b5e
ready for review
jacobdanovitch Nov 5, 2020
3b30e21
Merge branch 'master' into jacobdanovitch/deepspeed
jacobdanovitch Nov 5, 2020
fdd888b
add new trainer/lazy changes
jacobdanovitch Nov 5, 2020
ef544c9
Merge branch 'master' into jacobdanovitch/deepspeed
jacobdanovitch Nov 9, 2020
083a6d0
dangling changes
jacobdanovitch Nov 23, 2020
0f8d5b7
Merge branch 'master' of https://github.com/allenai/allennlp into jac…
jacobdanovitch Nov 23, 2020
4e4f7d7
updating from master
jacobdanovitch Nov 30, 2020
f48ea19
typechecks passing!
jacobdanovitch Nov 30, 2020
b3328fc
init file
jacobdanovitch Jan 3, 2021
966e296
Merge remote-tracking branch 'upstream/main' into jacobdanovitch/deep…
jacobdanovitch Jan 3, 2021
2fdb7c0
save old tests in case
jacobdanovitch Jan 8, 2021
95a9e5f
tracking down dist barrier bug(s)
jacobdanovitch Jan 8, 2021
b152fe1
catch up
jacobdanovitch Jan 19, 2021
5b82534
Merge branch 'main' of https://github.com/allenai/allennlp into jacob…
jacobdanovitch Jan 19, 2021
4fb6604
moved master checks to checkpointer to accomodate deepspeed
jacobdanovitch Jan 20, 2021
e21fb1f
Merge branch 'main' of https://github.com/allenai/allennlp into jacob…
jacobdanovitch Feb 10, 2021
703843c
updating to 2.0
jacobdanovitch Feb 10, 2021
e7b8825
checking in sparse attention
jacobdanovitch Feb 18, 2021
3fc1835
merge resolution
jacobdanovitch Feb 18, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions allennlp/training/__init__.py
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
from allennlp.training.checkpointer import Checkpointer
from allennlp.training.tensorboard_writer import TensorboardWriter
from allennlp.training.no_op_trainer import NoOpTrainer
from allennlp.training.deepspeed_trainer import DeepspeedTrainer
from allennlp.training.trainer import (
Trainer,
GradientDescentTrainer,
Expand Down
Loading