Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-4715][Core] Make sure tryToAcquire won't return a negative value #3575

Closed
wants to merge 1 commit into from
Closed

Conversation

zsxwing
Copy link
Member

@zsxwing zsxwing commented Dec 3, 2014

ShuffleMemoryManager.tryToAcquire may return a negative value. The unit test demonstrates this bug. It will output 0 did not equal -200 granted is negative.

@zsxwing zsxwing changed the title Make sure tryToAcquire won't return a negative value [SPARK-4715][Core] Make sure tryToAcquire won't return a negative value Dec 3, 2014
@SparkQA
Copy link

SparkQA commented Dec 3, 2014

Test build #24080 has started for PR 3575 at commit a193ae6.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Dec 3, 2014

Test build #24080 has finished for PR 3575 at commit a193ae6.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • public class NullType extends DataType

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24080/
Test PASSed.

@andrewor14
Copy link
Contributor

I see. This can become negative when new threads join and awaken our current thread, since 1/N is now smaller but our curMem doesn't change. This LGTM, I'm merging it into master, 1.2 and 1.1 thanks.

asfgit pushed a commit that referenced this pull request Dec 3, 2014
ShuffleMemoryManager.tryToAcquire may return a negative value. The unit test demonstrates this bug. It will output `0 did not equal -200 granted is negative`.

Author: zsxwing <[email protected]>

Closes #3575 from zsxwing/SPARK-4715 and squashes the following commits:

a193ae6 [zsxwing] Make sure tryToAcquire won't return a negative value

(cherry picked from commit edd3cd4)
Signed-off-by: Andrew Or <[email protected]>
@asfgit asfgit closed this in edd3cd4 Dec 3, 2014
asfgit pushed a commit that referenced this pull request Dec 3, 2014
ShuffleMemoryManager.tryToAcquire may return a negative value. The unit test demonstrates this bug. It will output `0 did not equal -200 granted is negative`.

Author: zsxwing <[email protected]>

Closes #3575 from zsxwing/SPARK-4715 and squashes the following commits:

a193ae6 [zsxwing] Make sure tryToAcquire won't return a negative value
@zsxwing zsxwing deleted the SPARK-4715 branch December 4, 2014 02:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants