Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Quorum queues: chunk consumer log effects #7175

Merged
merged 1 commit into from
Feb 27, 2023

Conversation

kjnilsson
Copy link
Contributor

@kjnilsson kjnilsson commented Feb 3, 2023

Chunk quorum queue deliveries

This puts a limit to the amount of message data that is added
to the process heap at the same time to around 128KB.

Large prefetch values combined with large messages could cause
excessive garbage collection work.

Also simplify the intermediate delivery message format to avoid
allocations that aren't necessary.

@michaelklishin michaelklishin changed the title Qq chunk consumer log effects QQs: chunk consumer log effects Feb 3, 2023
@kjnilsson kjnilsson force-pushed the qq-chunk-consumer-log-effects branch from 6f1b819 to b9bfe0a Compare February 6, 2023 16:39
@kjnilsson kjnilsson changed the title QQs: chunk consumer log effects Quorum queues: chunk consumer log effects Feb 6, 2023
@kjnilsson kjnilsson requested a review from ansd February 6, 2023 16:40
deps/rabbit/src/rabbit_fifo.erl Outdated Show resolved Hide resolved
deps/rabbit/src/rabbit_fifo.erl Outdated Show resolved Hide resolved
@kjnilsson kjnilsson force-pushed the qq-chunk-consumer-log-effects branch from b9bfe0a to 7a949a6 Compare February 7, 2023 13:55
@kjnilsson kjnilsson marked this pull request as ready for review February 7, 2023 13:56
ansd
ansd previously approved these changes Feb 7, 2023
This puts a limit to the amount of message data that is added
to the process heap at the same time to around 128KB.

Large prefetch values combined with large messages could cause
excessive garbage collection work.

Also similify the intermediate delivery message format to avoid
allocations that aren't necessary.
@kjnilsson kjnilsson merged commit cb34075 into main Feb 27, 2023
mergify bot pushed a commit that referenced this pull request Feb 27, 2023
This puts a limit to the amount of message data that is added
to the process heap at the same time to around 128KB.

Large prefetch values combined with large messages could cause
excessive garbage collection work.

Also similify the intermediate delivery message format to avoid
allocations that aren't necessary.

(cherry picked from commit cb34075)
michaelklishin added a commit that referenced this pull request Feb 27, 2023
Quorum queues: chunk consumer log effects (backport #7175)
@michaelklishin michaelklishin deleted the qq-chunk-consumer-log-effects branch February 27, 2023 16:52
@michaelklishin michaelklishin added this to the 3.12.0 milestone Feb 27, 2023
@michaelklishin
Copy link
Member

It was decided to ship this only in 3.12.0 and not to backport.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants