-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[bug-fix] scheduler won't override running status incorrectly #2187
[bug-fix] scheduler won't override running status incorrectly #2187
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sounds good, but change important as this would require a test case too I think. See the scheduler api tests.
@Tarrasch I've added a test case for the particular fix. I'm not sure how to parse the build failure, it seems a git/build issue? Should I create a new PR? |
@stguido, can you rebase your code on master? This problem is fixed now but you need to rebase your code for your patch to "include" it. :) |
deb4b1e
to
307aa53
Compare
307aa53
to
98875bb
Compare
@Tarrasch, I've finally got this to be green again - lmk if it's good for a merge |
Thanks for the fix @stguido! :) |
Description
The scheduler can currently override the RUNNING status of a task with something incorrect coming from a different worker other than the one currently running the task.
Motivation and Context
The issue has been discussed in the mailing list here: https://groups.google.com/forum/#!searchin/luigi-user/stefano|sort:relevance/luigi-user/WCiQfNEfWY4/5zGdX5X6BgAJ
Have you tested this? If so, how?
It passes tests. We are about to push this into our production env as well.