Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[spark] Use batch predict in spark #2545

Merged
merged 2 commits into from
May 2, 2023
Merged

Conversation

xyang16
Copy link
Contributor

@xyang16 xyang16 commented Apr 16, 2023

Description

Brief description of what this PR is about

Use batch predict in spark. User can set batch size. Default batch size is 100 for text, 10 for image, audio and binary.

@codecov-commenter
Copy link

codecov-commenter commented Apr 16, 2023

Codecov Report

Patch coverage: 72.58% and project coverage change: +1.51 🎉

Comparison is base (bb5073f) 72.08% compared to head (7694e78) 73.60%.

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@             Coverage Diff              @@
##             master    #2545      +/-   ##
============================================
+ Coverage     72.08%   73.60%   +1.51%     
- Complexity     5126     6958    +1832     
============================================
  Files           473      684     +211     
  Lines         21970    30395    +8425     
  Branches       2351     3152     +801     
============================================
+ Hits          15838    22371    +6533     
- Misses         4925     6490    +1565     
- Partials       1207     1534     +327     
Impacted Files Coverage Δ
api/src/main/java/ai/djl/modality/cv/Image.java 69.23% <ø> (-4.11%) ⬇️
...rc/main/java/ai/djl/modality/cv/MultiBoxPrior.java 76.00% <ø> (ø)
.../main/java/ai/djl/modality/cv/output/Landmark.java 100.00% <ø> (ø)
...i/djl/modality/cv/translator/BigGANTranslator.java 21.42% <0.00%> (-5.24%) ⬇️
.../modality/cv/translator/ImageFeatureExtractor.java 0.00% <0.00%> (ø)
.../ai/djl/modality/cv/translator/YoloTranslator.java 27.77% <0.00%> (+18.95%) ⬆️
...ain/java/ai/djl/modality/cv/util/NDImageUtils.java 67.10% <0.00%> (+7.89%) ⬆️
api/src/main/java/ai/djl/modality/nlp/Decoder.java 63.63% <ø> (ø)
api/src/main/java/ai/djl/modality/nlp/Encoder.java 66.66% <ø> (ø)
.../main/java/ai/djl/modality/nlp/EncoderDecoder.java 64.00% <ø> (ø)
... and 228 more

... and 352 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@xyang16 xyang16 force-pushed the batch branch 2 times, most recently from 191614b to 8f85b90 Compare April 16, 2023 18:33
@xyang16 xyang16 force-pushed the batch branch 5 times, most recently from 77558a0 to b53db96 Compare May 1, 2023 17:07
@xyang16 xyang16 merged commit b8cc581 into deepjavalibrary:master May 2, 2023
@xyang16 xyang16 deleted the batch branch May 2, 2023 19:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants