versaurabh / spark-custom-spark-datasource Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Extending Our Spark SQL Query Engine with a custom data source

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.idea		.idea
src/main		src/main
.gitignore		.gitignore
README.md		README.md
build.gradle		build.gradle
settings.gradle		settings.gradle

Repository files navigation

spark-custom-spark-datasource

Extending Our Spark SQL Query Engine with a custom data source as per https://developer.hpe.com/blog/spark-data-source-api-extending-our-spark-sql-query-engine/

How to build

./gradlew build
If you want to use locally built spark libs
- Uncomment flatDir in build.gradle
- Replace <spark base path> with locally built spark path

About

Extending Our Spark SQL Query Engine with a custom data source

Report repository

Releases

No releases published

Packages

No packages published

Languages

Scala 100.0%