Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change MPI buffer creation + 1D non-contiguous tensors #785

Merged
merged 6 commits into from
Jun 7, 2021

Conversation

coquelin77
Copy link
Member

@coquelin77 coquelin77 commented Jun 2, 2021

Description

Removed storage_offset when finding the mpi buffer (communication. MPICommunication.as_mpi_memory()).
Added allowance for 1 dimensional non-contiguous local tensors in communication. MPICommunication.mpi_type_and_elements_of()

Issue/s resolved: #769 #784

Changes proposed:

  • removed storage_offset addition to data pointer in communication. MPICommunication.as_mpi_memory()
  • added if block to determine strides for non-contiguous 1D local tensors in communication. MPICommunication.mpi_type_and_elements_of()

Type of change

  • Bug fix (non-breaking change which fixes an issue)

Due Diligence

  • All split configurations tested
  • Multiple dtypes tested in relevant functions
  • Documentation updated (if needed)
  • Updated changelog.md under the title "Pending Additions"

Does this change modify the behaviour of other functions? If so, which?

no

…ock for 1D non-contiguous tensors in comm.mpi_type_and_elements_of()
@codecov
Copy link

codecov bot commented Jun 2, 2021

Codecov Report

Merging #785 (1a75eb2) into master (3dc9aca) will increase coverage by 0.01%.
The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #785      +/-   ##
==========================================
+ Coverage   90.84%   90.85%   +0.01%     
==========================================
  Files          64       64              
  Lines        8921     8932      +11     
==========================================
+ Hits         8104     8115      +11     
  Misses        817      817              
Flag Coverage Δ
unit 90.85% <100.00%> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
heat/core/communication.py 89.82% <100.00%> (+0.09%) ⬆️
heat/core/manipulations.py 99.25% <100.00%> (+<0.01%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3dc9aca...1a75eb2. Read the comment docs.

@coquelin77
Copy link
Member Author

verbal approval received from @Markus-Goetz for merge. waiting for tests, then this will be merged

@coquelin77 coquelin77 merged commit 184f112 into master Jun 7, 2021
@coquelin77 coquelin77 deleted the bug/769-resplit-after-index branch June 7, 2021 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

resplit after indexing
1 participant