Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add multi-GPU dataparallel #74

Merged
merged 64 commits into from
Mar 28, 2024
Merged

Add multi-GPU dataparallel #74

merged 64 commits into from
Mar 28, 2024

Conversation

ilyes319
Copy link
Contributor

@ilyes319 ilyes319 commented Feb 9, 2023

This PR should add different kind of multi-GPU support.

Here is just the most naive being the Dataparallel class of torch.

@ilyes319 ilyes319 added the enhancement New feature or request label Feb 14, 2023
davkovacs and others added 21 commits February 14, 2023 15:30
@davkovacs
still a little slow data loading
f3f14f2
@davkovacs
performance good, but no shuffling of training set during training!
da23dba
@davkovacs
data loading works with shuffling
a290466
@davkovacs
document on-line data loading
b7a097a
@davkovacs
Update README.md
652a96e
@ilyes319
Merge pull request #73 from davkovacs/on_the_fly_dataloading
d619d9d 
on the fly data loading
@davkovacs
lower CPU memroy during preprocessing
262a1fb
@davkovacs
Merge branch 'on_the_fly_dataloading' of github.com:davkovacs/mace in…
f769417 
…to on_the_fly_dataloading
@davkovacs
update README
cde62d3
@davkovacs
save jsons stats as strings
d662854
@davkovacs
fix test set h5 save name
3b4162b
@ilyes319
Merge pull request #81 from davkovacs/on_the_fly_dataloading
2dee6d1 
On the fly dataloading
@ilyes319
improve half periodic matscipy
bc8f04a
@ilyes319
Merge pull request #64 from ACEsuit/52-matscipy-neighbour-list-as-def…
5ab28a6 
…ault

Make matscipy default neighbour list
@ilyes319
implement on the fly graph creation
e552cc5
@ilyes319
add hf5 test
5d90030
@ilyes319
fix stuff
511f591
@ilyes319
Merge pull request #99 from davkovacs/multi-GPU
fca0bb3 
Multi gpu
@ilyes319
fix import
56b3814
@ilyes319
add flags
8c0eb6f
@ilyes319
fix cpu
8bd47ec
samwaltonnorwood and others added 28 commits June 16, 2023 17:05
@samwaltonnorwood
Distributed evaluation.
d07469a
@ilyes319
Merge pull request #117 from sivonxay/multi-GPU
583b1c3 
Slight modification to HDF5Dataset
@mavaylon1
Update .gitignore
643a18b
@mavaylon1
Update .gitignore
b900ee4
@mavaylon1
Update preprocess_data.py
37762e9
@mavaylon1
Update utils.py
99baf11
@mavaylon1
cpu/4
7876875
@ilyes319
compute statistics only once
3c13f10
@mavaylon1
Merge branch 'multi-GPU' into multi-GPU
a28c4fb
@mavaylon1
some reverts
2f54450
@mavaylon1
clean
1d67e69
@ilyes319
Merge pull request #105 from samwaltonnorwood/distributed
7befa8f 
Multi-node, multi-GPU data parallel training.
@mavaylon1
test
354c23d
@mavaylon1
test cleanm
3df66cc
@mavaylon1
Merge branch 'ACEsuit:multi-GPU' into multi-GPU
741f9aa
@mavaylon1
removal
41aeede
@mavaylon1
clean up
42ffd94
@mavaylon1
clean up
3ce9b08
@mavaylon1
clean up
916d759
@mavaylon1
clean up
8e7d174
@mavaylon1
args
2a74e38
@mavaylon1
fix
5da3b6a
@mavaylon1
parse/test
729b1ad
@mavaylon1
clean
a07a0ff
@mavaylon1
type hints
9f553f6
@mavaylon1
remove
5d27636
@ilyes319
Merge pull request #133 from mavaylon1/multi-GPU
d8e236a 
Multi-processing
@ilyes319
fix bug avg neighbors
113b839
@ilyes319 ilyes319 merged commit 564eaf5 into develop Mar 28, 2024
@ilyes319 ilyes319 deleted the multi-GPU branch September 19, 2024 07:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@ilyes319 @davkovacs @samwaltonnorwood @sivonxay @mavaylon1