-
-
Notifications
You must be signed in to change notification settings - Fork 8.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Breaking] Remove max_delta_step
from Poisson.
#7267
base: master
Are you sure you want to change the base?
Conversation
User can use the parameter with same name in `max_delta_step` to control leaf weights, no need to manipulate hessian values.
Codecov Report
@@ Coverage Diff @@
## master #7267 +/- ##
=======================================
Coverage 82.64% 82.64%
=======================================
Files 13 13
Lines 4067 4067
=======================================
Hits 3361 3361
Misses 706 706 Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It seems to me that this parameter is different from the other max_delta_step
. It looks like it was put here to stop numerical instability problems. In particular the default value means the hessian cannot drop below 2 (assuming weights are 1.0). Can we be sure this change will not cause problems?
@RAMitchell It might cause problems in hessian as you mentioned due to small values. But having it might also cause trouble if the hessian is supposed to be small. It's a hyper-parameter that needed tuning. To me, both
If you have a small hessian, G/H will be large, then We should use only one of them. |
User can use the parameter with same name
max_delta_step
in tree method to control leaf weights, noneed to manipulate hessian values.