-
Notifications
You must be signed in to change notification settings - Fork 28.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-33882][ML] Add a vectorized BLAS implementation #30810
Closed
Closed
Commits on Dec 16, 2020
-
[ML] Add a vectorized BLAS implementation
Whenever a native BLAS implementation isn't available on the system, Spark automatically falls back onto a Java implementation. With the recent release of the Vector API in the OpenJDK [1], we can use hardware acceleration for such operations. This patch introduces a VectorizedBLAS class which implements such hardware-accelerated BLAS operations. This feature is hidden behind the "vectorized" profile that you can enable by passing "-Pvectorized" to sbt or maven. The Vector API has been introduced in JDK 16. Following discussion on the mailing list, this API is introduced transparently and needs to be enabled explicitely. [1] https://openjdk.java.net/jeps/338
Configuration menu - View commit details
-
Copy full SHA for 48e4af1 - Browse repository at this point
Copy the full SHA 48e4af1View commit details
Commits on Dec 18, 2020
-
All implmentations beat f2j on microbenchmarks on x86 (w/ AVX-2). See https://github.com/luhenry/vectorizedblas/releases/tag/v0.1.5 for more details
Configuration menu - View commit details
-
Copy full SHA for c949d44 - Browse repository at this point
Copy the full SHA c949d44View commit details
Commits on Dec 20, 2020
-
Use dev.ludovic.vectorizedblas package directly
It simplifies the build process, and will allow for faster iterations on my end
Configuration menu - View commit details
-
Copy full SHA for bc9cfb0 - Browse repository at this point
Copy the full SHA bc9cfb0View commit details -
Make sure we don't depend on spark-core in mllib-local
We still use it for the benchmarks but it should go away at some point
Configuration menu - View commit details
-
Copy full SHA for 494254b - Browse repository at this point
Copy the full SHA 494254bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2b875e6 - Browse repository at this point
Copy the full SHA 2b875e6View commit details
Commits on Dec 21, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 628af4f - Browse repository at this point
Copy the full SHA 628af4fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7d6ac61 - Browse repository at this point
Copy the full SHA 7d6ac61View commit details
Commits on Dec 22, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 53bf41b - Browse repository at this point
Copy the full SHA 53bf41bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0018109 - Browse repository at this point
Copy the full SHA 0018109View commit details -
Configuration menu - View commit details
-
Copy full SHA for d4b737c - Browse repository at this point
Copy the full SHA d4b737cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3ac7e0e - Browse repository at this point
Copy the full SHA 3ac7e0eView commit details -
Bump dev.ludovic:vectorizedblas-blas to 0.1.9
Brings acceleration for sscal, dgemm[N,N], dgemm[N,T], dgemv[N], sgemv[N] and sgemv[T]
Configuration menu - View commit details
-
Copy full SHA for 0c52da5 - Browse repository at this point
Copy the full SHA 0c52da5View commit details -
Configuration menu - View commit details
-
Copy full SHA for e23a0fd - Browse repository at this point
Copy the full SHA e23a0fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 18e62f9 - Browse repository at this point
Copy the full SHA 18e62f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1aea88a - Browse repository at this point
Copy the full SHA 1aea88aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 43a82b1 - Browse repository at this point
Copy the full SHA 43a82b1View commit details
Commits on Jan 4, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 14a0e60 - Browse repository at this point
Copy the full SHA 14a0e60View commit details
Commits on Apr 7, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 521cba2 - Browse repository at this point
Copy the full SHA 521cba2View commit details
Commits on Apr 8, 2021
-
Configuration menu - View commit details
-
Copy full SHA for d93b274 - Browse repository at this point
Copy the full SHA d93b274View commit details
Commits on Apr 13, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 10595df - Browse repository at this point
Copy the full SHA 10595dfView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.