update dnn notebook example to give more interesting results #1194
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
vinuthakaranth
approved these changes
Feb 1, 2022
romanlutz
approved these changes
Feb 1, 2022
Codecov Report
@@ Coverage Diff @@
## main #1194 +/- ##
=======================================
Coverage 67.76% 67.76%
=======================================
Files 90 90
Lines 4291 4291
=======================================
Hits 2908 2908
Misses 1383 1383
Flags with carried forward coverage won't be shown. Click here to find out more. Continue to review full report at Codecov.
|
gaugup
pushed a commit
that referenced
this pull request
Feb 2, 2022
gaugup
added a commit
that referenced
this pull request
Feb 7, 2022
* Add cohort and filter definitions in raiwidgets SDK Signed-off-by: Gaurav Gupta <[email protected]> * Remove commented out code Signed-off-by: Gaurav Gupta <[email protected]> * Add metrics to StatisticsUtils - F1 score, selection rate, mean absolute error (#1174) * add new metrics * undo unwanted changes * fix casing * add superscript 2 for r-squared * update tests to reflect new metrics * lintfix * fix mae calculation * update dnn notebook example to give more interesting results (#1194) * Add upload step to e2e test workflow (#1183) * update config * update cypress config * Add upload step to e2e test to CI notebooks pipeline (#1188) * changes * lintfix * Fix code review comments Signed-off-by: Gaurav Gupta <[email protected]> Co-authored-by: Roman Lutz <[email protected]> Co-authored-by: Ilya Matiach <[email protected]> Co-authored-by: Vinutha Karanth <[email protected]>
gaugup
added a commit
that referenced
this pull request
Feb 27, 2022
* Add cohort and filter definitions in raiwidgets SDK Signed-off-by: Gaurav Gupta <[email protected]> * Remove commented out code Signed-off-by: Gaurav Gupta <[email protected]> * Add metrics to StatisticsUtils - F1 score, selection rate, mean absolute error (#1174) * add new metrics * undo unwanted changes * fix casing * add superscript 2 for r-squared * update tests to reflect new metrics * lintfix * fix mae calculation * update dnn notebook example to give more interesting results (#1194) * Add upload step to e2e test workflow (#1183) * update config * update cypress config * Add upload step to e2e test to CI notebooks pipeline (#1188) * changes * lintfix * Fix code review comments Signed-off-by: Gaurav Gupta <[email protected]> Co-authored-by: Roman Lutz <[email protected]> Co-authored-by: Ilya Matiach <[email protected]> Co-authored-by: Vinutha Karanth <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
The notebook "notebooks/responsibleaidashboard/responsibleaidashboard-multiclass-dnn-model-debugging.ipynb" had a DNN pytorch model that was only trained for 12 epochs, which ended up giving the same result during inference.
This PR updates the dnn notebook example to train the model for 10000 epochs, to give more interesting results.
Although it takes 13 seconds to train the model, instead of making training instantaneous, the model outputs several possible classes instead of just one class.
Areas changed
npm packages changed:
Python packages changed:
Tests
Screenshots (if appropriate):
Model overview after increasing the number of iterations in the sample notebook:
Previously it would just be:
Documentation: