Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SYSTEMDS-????] rewrite nary elementwise mult #2105

Closed
wants to merge 1 commit into from

Conversation

e-strauss
Copy link
Contributor

@e-strauss e-strauss commented Sep 11, 2024

This patch adds the nary the rewrite and operator for elementwise multiply

Copy link

codecov bot commented Sep 12, 2024

Codecov Report

Attention: Patch coverage is 92.68293% with 12 lines in your changes missing coverage. Please review.

Project coverage is 70.65%. Comparing base (95cfb76) to head (ea8a890).
Report is 7 commits behind head on main.

Files with missing lines Patch % Lines
...rc/main/java/org/apache/sysds/hops/AggUnaryOp.java 86.66% 0 Missing and 8 partials ⚠️
...nstructions/cp/MatrixBuiltinNaryCPInstruction.java 0.00% 0 Missing and 1 partial ⚠️
...e/instructions/spark/BuiltinNarySPInstruction.java 83.33% 0 Missing and 1 partial ⚠️
...e/sysds/runtime/lineage/LineageRecomputeUtils.java 50.00% 0 Missing and 1 partial ⚠️
.../apache/sysds/runtime/matrix/data/MatrixBlock.java 98.71% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2105      +/-   ##
============================================
- Coverage     70.66%   70.65%   -0.02%     
- Complexity    42231    42258      +27     
============================================
  Files          1441     1441              
  Lines        162417   162501      +84     
  Branches      31654    31682      +28     
============================================
+ Hits         114777   114813      +36     
- Misses        38660    38711      +51     
+ Partials       8980     8977       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

squashed:
- fixed bug in nary hop, where output value type was computed wrongfully in case of scalars with mixed value types
- fixed bug in nary hop, where output is wrongfully set as scalar
- clean up & fixed the aggregate ternary rewrite to also work nary mult & fixed the n* lineage issue
- increased code coverage for rewrite ternary aggregate: colsum(A^3)
@@ -180,6 +182,36 @@ public void testTernaryAggregateCDenseMatrixCPNoRewrite() {
public void testTernaryAggregateCSparseMatrixCPNoRewrite() {
runTernaryAggregateTest(TEST_NAME2, true, false, false, ExecType.CP);
}

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added a new test cases for rewrite colsum(A^3) to improve code coverage

@mboehm7
Copy link
Contributor

mboehm7 commented Sep 22, 2024

LGTM - thanks for the patch @e-strauss and the holistic cleanup. During the merge I only replaced the unrolled loop in processMultRowSparse with a new vectMultiplyInPlace in LibMatrixMult.

@mboehm7 mboehm7 closed this in d0287b1 Sep 22, 2024
@e-strauss
Copy link
Contributor Author

thanks, yes makes sense

@e-strauss e-strauss deleted the NARY_ELEM_MULT branch September 25, 2024 08:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants