Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for long running tasks #8

Open
Timmoth opened this issue Jun 7, 2024 · 0 comments
Open

Add support for long running tasks #8

Timmoth opened this issue Jun 7, 2024 · 0 comments
Labels
help wanted Extra attention is needed

Comments

@Timmoth
Copy link
Owner

Timmoth commented Jun 7, 2024

Each messages in a batch must finish processing before moving on to the next batch, in the case that a user has processes which take a considerable amount of time two problems occur:

  • No more messages will be processed until the long running message is completed (for that specific processor instance)
  • The transaction locking rows will remain open

To mitigate this issue we should add a flag on messages which allows users to specify if their consumers are are fast or slow, then handle each type of messages with a different processor, ensuring slow processes do not block fast processes.

@Timmoth Timmoth added the help wanted Extra attention is needed label Jun 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant