Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Set batching size by config #110

Open
gallejesus opened this issue Jan 30, 2024 · 2 comments
Open

Set batching size by config #110

gallejesus opened this issue Jan 30, 2024 · 2 comments

Comments

@gallejesus
Copy link

gallejesus commented Jan 30, 2024 •
edited
Loading

As of now, the max size for batch inserts are 10000 rows. Being this a trade of between memory consuption and performance, larger batches can be the best option for small row tables.

It could be nice to have this setting configurable.

Thank you.
@edgarrmondragon
Copy link

Related: meltano/sdk#2155

@BTheunissen
Copy link
Contributor

Will follow the progress of the ticket on the SDK and will upgrade when that is available.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@BTheunissen @edgarrmondragon @gallejesus