Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

System.exit in Main.java lead to a failure in yarn cluster mode #3166

Closed
popboy126 opened this issue Jun 26, 2017 · 1 comment
Closed

System.exit in Main.java lead to a failure in yarn cluster mode #3166

popboy126 opened this issue Jun 26, 2017 · 1 comment
Labels
bug Spark
Milestone
Engine-4.0

Comments

@popboy126
Copy link

Line 154(System.exit(0)) in Main.java will lead a unormal exitcode(143) for a container in yarn cluster mode. Remove this will get the correct output.
final Object result = runCommandLineProgram(program, args); handleResult(result); //System.exit(0);
@droazen droazen added this to the Engine-4.0 milestone Jun 26, 2017
@lbergelson
Copy link
Member

This is a duplicate of #2666.

lbergelson added a commit that referenced this issue Aug 1, 2017
@lbergelson
removing the explicit System.exit(0) from Main
e2bf899 
this fixes the yarn early termination bug reported in #2666 and #3166
@lbergelson lbergelson mentioned this issue Aug 1, 2017
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Spark
Projects
None yet
Milestone
Engine-4.0
Development

No branches or pull requests
4 participants
@tomwhite @droazen @lbergelson @popboy126