Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support celerycam for reconnecting db connenction if db connection is lost accidentally #550

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 14 additions & 3 deletions djcelery/snapshot.py
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,8 @@
from datetime import timedelta

from django.conf import settings
from django.db import connection
from django.db.utils import InterfaceError

from celery import states
from celery.events.state import Task
Expand Down Expand Up @@ -127,9 +129,18 @@ def _handle_tasks():
for i, task in enumerate(state.tasks.items()):
self.handle_task(task)

for worker in state.workers.items():
self.handle_worker(worker)
_handle_tasks()
try:
for worker in state.workers.items():
self.handle_worker(worker)
_handle_tasks()
except InterfaceError as e:
# When connection already closed exception is raised,
# force to close connection and Django will automatically reconnect
if str(e) == 'connection already closed':
connection.close()
logger.info(
'Django db connection is closed and will reconnect'
)

def on_cleanup(self):
expired = (self.TaskState.objects.expire_by_states(states, expires)
Expand Down