New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sanity checks for second order backpropagation #60

Merged

fKunstner merged 3 commits into development from second-order-losses

Apr 27, 2020

Collaborator

fKunstner commented Apr 26, 2020

Cleanup of #56 and #55;

Raise warning if the loss has been modified beyond the last torch.nn loss module
Raise warning if backwardis called on non-scalar quantity
Raise exception if CrossEntropy or MSE are used with not-yet-implemented parameters (MSE between vectors, CrossEntropy with ignore_index or weight
Add test for expected behavior

fKunstner added 3 commits

April 22, 2020 22:34


          Add sanity checks to ensure second-order backpropagation makes sense

1d13114


          Throw exception if unsupported parameters of CrossEntropyLoss are used

004f73e


          Disable MSELoss second order backprop on vectors

fca8463

fKunstner merged commit 81e418c into development

fKunstner deleted the second-order-losses branch

April 27, 2020 05:37

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet