Skip to content
This repository has been archived by the owner on Jun 4, 2021. It is now read-only.

Improve Kafka retry #596

Closed
matzew opened this issue Sep 16, 2019 · 7 comments
Closed

Improve Kafka retry #596

matzew opened this issue Sep 16, 2019 · 7 comments
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
Milestone

Comments

@matzew
Copy link
Member

matzew commented Sep 16, 2019

Expected Behavior

  • proper retry

Actual Behavior

Currently if there is a message not dispatched to the "consumer", it is not committed:
https://github.com/knative/eventing-contrib/blob/master/kafka/common/pkg/kafka/consumer_handler.go#L80

A failed message is than not correcty reprocessed, if the next one is successful ..

Additional Info

@slinkydeveloper
Copy link
Contributor

I was wondering, if we move the actual event dispatch in another goroutine pool, then when a message for any reason is not sent, we could just re-enqueue it in the channel between the consumers pool and the dispatcher pool

@matzew
Copy link
Member Author

matzew commented Sep 17, 2019 via email

@lionelvillard
Copy link
Member

/milestone 0.10.0

@knative-prow-robot
Copy link
Contributor

@lionelvillard: You must be a member of the knative/knative-milestone-maintainers GitHub team to set the milestone. If you believe you should be able to issue the /milestone command, please contact your and have them propose you as an additional delegate for this responsibility.

In response to this:

/milestone 0.10.0

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@akashrv akashrv added this to the v0.11.0 milestone Oct 3, 2019
@pierDipi
Copy link
Member

pierDipi commented Apr 7, 2020

Does #1114 solve/relate to this issue?

@github-actions
Copy link

This issue is stale because it has been open for 90 days with no
activity. It will automatically close after 30 more days of
inactivity. Reopen the issue with /reopen. Mark the issue as
fresh by adding the comment /remove-lifecycle stale.

@github-actions github-actions bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Sep 11, 2020
@slinkydeveloper
Copy link
Contributor

This is solved

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

6 participants