New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for memory control in arrow #10730

Open

lll-phill-lll opened this issue Oct 22, 2024 · 0 comments

Assignees

Labels

Member

lll-phill-lll commented Oct 22, 2024

Currently, the memory in arrow is not particularly controlled. gvit@ is adding memory control to the mkql allocator.

in theory, the bottom layer should partially start working in the next couple of weeks

We need to tie in to this functionality and enable spilling based on the availability of free memory

lll-phill-lll self-assigned this

lll-phill-lll added the area/runtime label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment