Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Partitioning with key #267

Open
arezvani opened this issue Aug 12, 2022 · 1 comment
Open

Partitioning with key #267

arezvani opened this issue Aug 12, 2022 · 1 comment

Comments

@arezvani
Copy link

How can I partitioning with key? If I use fieldpartitioner, partition.field.name should be set to which value?
And if I want to partitioning my data with key and hold just latest 10 minutes or 10 data for each key, what should I do?

@OneCricketeer
Copy link

OneCricketeer commented Oct 20, 2022

Field partitioner only inspects the value of each record.

Therefore, you'd need another transform, or stream processor before being able to partition after moving the key to the value. Or otherwise duplicate the key into the value during producer code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants