Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for transactional consume-transform-produce loop #382

Open
nick-zh opened this issue Aug 26, 2020 · 2 comments
Open

Support for transactional consume-transform-produce loop #382

nick-zh opened this issue Aug 26, 2020 · 2 comments
Labels
Milestone

Comments

@nick-zh
Copy link
Collaborator

nick-zh commented Aug 26, 2020

For the use case where you have the following:

  • consumer reading messages
  • processing those messages
  • producing a result of those processed messages
  • all the above being part of a transaction

We need to be able for the consumer offsets to be part of the transaction, this can be achieved by using rd_kafka_send_offsets_to_transaction for which we should add support for.

Is related to #359

@nick-zh nick-zh added this to the v5.0.0 milestone Aug 26, 2020
@donatascn
Copy link

It is odd that this feature is not being upvoted :)

@nizacegodk
Copy link

We would also benefit from having this feature in our projects.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants