-
Notifications
You must be signed in to change notification settings - Fork 66
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove batch_size of bulk API from tests & refactor BWC version check #852
Conversation
Signed-off-by: Liyun Xiu <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the refactor on the versionsBelow check logic.
...ng-upgrade/src/test/resources/processor/PipelineForSparseEncodingProcessorConfiguration.json
Outdated
Show resolved
Hide resolved
src/test/resources/processor/SparseEncodingPipelineConfiguration.json
Outdated
Show resolved
Hide resolved
...pgrade/src/test/java/org/opensearch/neuralsearch/bwc/AbstractRestartUpgradeRestTestCase.java
Outdated
Show resolved
Hide resolved
@@ -124,13 +124,25 @@ protected String uploadSparseEncodingModel() throws Exception { | |||
return registerModelGroupAndGetModelId(requestBody); | |||
} | |||
|
|||
protected void createPipelineForSparseEncodingProcessor(String modelId, String pipelineName) throws Exception { | |||
protected void createPipelineForSparseEncodingProcessor(String modelId, String pipelineName, Integer batchSize) throws Exception { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks like repeating code, is there any opportunity to optimize this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Too many functions are duplicate between these two bwc files, I think we need dedicated work to refactor
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
…#852) * Remove batch_size of bulk API from tests & refactor BWC version check Signed-off-by: Liyun Xiu <[email protected]> * Update changelog Signed-off-by: Liyun Xiu <[email protected]> * Address some comments Signed-off-by: Liyun Xiu <[email protected]> * Update Changelog Signed-off-by: Liyun Xiu <[email protected]> --------- Signed-off-by: Liyun Xiu <[email protected]> (cherry picked from commit e1c3878)
…#852) * Remove batch_size of bulk API from tests & refactor BWC version check Signed-off-by: Liyun Xiu <[email protected]> * Update changelog Signed-off-by: Liyun Xiu <[email protected]> * Address some comments Signed-off-by: Liyun Xiu <[email protected]> * Update Changelog Signed-off-by: Liyun Xiu <[email protected]> --------- Signed-off-by: Liyun Xiu <[email protected]> (cherry picked from commit e1c3878) Signed-off-by: Martin Gaievski <[email protected]>
Description
batch_size
of bulk API from testsbatch_size
in processorRelated Issues
Resolves opensearch-project/OpenSearch#14283
Check List
--signoff
.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.