Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Plan to support Incremenal Cooperative Rebalance Protocol? #1858

Open
chickensoup opened this issue Dec 16, 2020 · 9 comments
Open

Plan to support Incremenal Cooperative Rebalance Protocol? #1858

chickensoup opened this issue Dec 16, 2020 · 9 comments
Labels
enhancement stale/exempt Issues and pull requests that should never be closed as stale

Comments

@chickensoup
Copy link

chickensoup commented Dec 16, 2020

Kafka supports consumer incremental cooperative rebalance protocal starting from version 2.4.0, and I'm wondering is there any plan for Sarama client to support this protocol?

KIP-429

@ghost

This comment was marked as outdated.

@ghost ghost added the stale Issues and pull requests without any recent activity label Mar 16, 2021
@ilyakaznacheev
Copy link
Contributor

I just want to bump this issue from closing. Cooperative rebalance support would be very useful to work with different deployment kinds.

@ghost ghost removed the stale Issues and pull requests without any recent activity label Apr 18, 2021
@lizthegrey
Copy link
Contributor

Definitely would also help our issues at Honeycomb where we've had to stop and start all workers at once rather than rolling restart to update

@past-urbanist
Copy link

Now Apache Kafka 3.0 has used CooperativeStickyAssignor as default assignor instead of RangeAssignor. It seems Sarama has fallen far behind it. It is much more efficient in CooperativeStickyAssignor.

@dnwe dnwe added the stale/exempt Issues and pull requests that should never be closed as stale label Jan 11, 2022
@ilyakaznacheev
Copy link
Contributor

Still waiting for it!

@lavoiesl
Copy link
Contributor

I believe this issue is referring to https://cwiki.apache.org/confluence/display/KAFKA/KIP-341%3A+Update+Sticky+Assignor%27s+User+Data+Protocol ?
That feature was added #1416, so I believe this can be closed?

@gofish
Copy link

gofish commented Oct 17, 2022

Incremental rebalance is described by KIP-429.

@dnwe
Copy link
Collaborator

dnwe commented Aug 23, 2023

Thanks to @napallday we have a work-in-progress implementation of the incremental cooperate rebalance protocol. If you'd like to test out the changes they are available under PR #2608

@dberardo-com
Copy link

any ETA for this feature ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement stale/exempt Issues and pull requests that should never be closed as stale
Projects
None yet
Development

No branches or pull requests

8 participants