Skip to content

No labels!

There aren’t any labels for this repository quite yet.

precision: half
precision: half
Half-precision
precision: te
precision: te
Transformer Engine
priority: 0
priority: 0
High priority task
priority: 1
priority: 1
Medium priority task
priority: 2
priority: 2
Low priority task
progress bar: rich
progress bar: rich
progress bar: tqdm
progress bar: tqdm
progress tracking (internal)
progress tracking (internal)
Related to the progress tracking dataclasses
question
question
Further information is requested
ready
ready
PRs ready to be merged
repro needed
repro needed
The issue is missing a reproducible example
reproducibility
reproducibility
run TPU
run TPU
strategy: bagua (removed)
strategy: bagua (removed)
Bagua
strategy: colossalai (removed)
strategy: colossalai (removed)
Colossal-AI
strategy: ddp
strategy: ddp
DistributedDataParallel
strategy: deepspeed
strategy: deepspeed
strategy: dp (removed in pl)
strategy: dp (removed in pl)
DataParallel
strategy: fairscale fsdp (removed)
strategy: fairscale fsdp (removed)
Fully Sharded Data Parallel
strategy: fairscale sharded (removed)
strategy: fairscale sharded (removed)
Sharded Data Parallel
strategy: fsdp
strategy: fsdp
Fully Sharded Data Parallel
strategy: hivemind (external)
strategy: hivemind (external)
strategy: horovod (removed)
strategy: horovod (removed)
strategy: hpu (external)
strategy: hpu (external)
HPUParallel
strategy: ipu (removed)
strategy: ipu (removed)
strategy: xla
strategy: xla