Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Celery beat not working after upgrading to django 3.0.5 #597

Open
shivamzxzx opened this issue May 1, 2020 · 1 comment
Open

Celery beat not working after upgrading to django 3.0.5 #597

shivamzxzx opened this issue May 1, 2020 · 1 comment

Comments

@shivamzxzx
Copy link

error traceback -

[2020-05-01 07:37:48,332: WARNING/MainProcess] Traceback (most recent call last):
[2020-05-01 07:37:48,333: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/kombu/utils/objects.py", line 42, in get
[2020-05-01 07:37:48,333: WARNING/MainProcess] return obj.dict[self.name]
[2020-05-01 07:37:48,333: WARNING/MainProcess] KeyError
[2020-05-01 07:37:48,333: WARNING/MainProcess] :
[2020-05-01 07:37:48,333: WARNING/MainProcess] 'scheduler'
[2020-05-01 07:37:48,333: WARNING/MainProcess] During handling of the above exception, another exception occurred:
[2020-05-01 07:37:48,333: WARNING/MainProcess] Traceback (most recent call last):
[2020-05-01 07:37:48,334: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/bin/celery", line 10, in
[2020-05-01 07:37:48,334: WARNING/MainProcess] sys.exit(main())
[2020-05-01 07:37:48,334: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/main.py", line 16, in main
[2020-05-01 07:37:48,334: WARNING/MainProcess] _main()
[2020-05-01 07:37:48,334: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/celery.py", line 322, in main
[2020-05-01 07:37:48,334: WARNING/MainProcess] cmd.execute_from_commandline(argv)
[2020-05-01 07:37:48,334: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/celery.py", line 495, in execute_from_commandline
[2020-05-01 07:37:48,335: WARNING/MainProcess] super(CeleryCommand, self).execute_from_commandline(argv)))
[2020-05-01 07:37:48,335: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/base.py", line 305, in execute_from_commandline
[2020-05-01 07:37:48,335: WARNING/MainProcess] return self.handle_argv(self.prog_name, argv[1:])
[2020-05-01 07:37:48,335: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/celery.py", line 487, in handle_argv
[2020-05-01 07:37:48,336: WARNING/MainProcess] return self.execute(command, argv)
[2020-05-01 07:37:48,336: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/celery.py", line 419, in execute
[2020-05-01 07:37:48,336: WARNING/MainProcess] ).run_from_argv(self.prog_name, argv[1:], command=argv[0])
[2020-05-01 07:37:48,336: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/base.py", line 309, in run_from_argv
[2020-05-01 07:37:48,336: WARNING/MainProcess] sys.argv if argv is None else argv, command)
[2020-05-01 07:37:48,336: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/base.py", line 393, in handle_argv
[2020-05-01 07:37:48,337: WARNING/MainProcess] return self(*args, **options)
[2020-05-01 07:37:48,337: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/base.py", line 253, in call
[2020-05-01 07:37:48,337: WARNING/MainProcess] ret = self.run(*args, **kwargs)
[2020-05-01 07:37:48,337: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/bin/beat.py", line 109, in run
[2020-05-01 07:37:48,337: WARNING/MainProcess] return beat().run()
[2020-05-01 07:37:48,337: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/apps/beat.py", line 81, in run
[2020-05-01 07:37:48,337: WARNING/MainProcess] self.start_scheduler()
[2020-05-01 07:37:48,338: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/apps/beat.py", line 109, in start_scheduler
[2020-05-01 07:37:48,338: WARNING/MainProcess] service.start()
[2020-05-01 07:37:48,338: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/beat.py", line 622, in start
[2020-05-01 07:37:48,338: WARNING/MainProcess] humanize_seconds(self.scheduler.max_interval))
[2020-05-01 07:37:48,338: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/kombu/utils/objects.py", line 44, in get
[2020-05-01 07:37:48,338: WARNING/MainProcess] value = obj.dict[self.name] = self.__get(obj)
[2020-05-01 07:37:48,339: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/beat.py", line 666, in scheduler
[2020-05-01 07:37:48,339: WARNING/MainProcess] return self.get_scheduler()
[2020-05-01 07:37:48,339: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/beat.py", line 661, in get_scheduler
[2020-05-01 07:37:48,339: WARNING/MainProcess] lazy=lazy,
[2020-05-01 07:37:48,340: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/schedulers.py", line 161, in init
[2020-05-01 07:37:48,340: WARNING/MainProcess] Scheduler.init(self, *args, **kwargs)
[2020-05-01 07:37:48,340: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/celery/beat.py", line 257, in init
[2020-05-01 07:37:48,340: WARNING/MainProcess] self.setup_schedule()
[2020-05-01 07:37:48,340: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/schedulers.py", line 169, in setup_schedule
[2020-05-01 07:37:48,341: WARNING/MainProcess] self.install_default_entries(self.schedule)
[2020-05-01 07:37:48,341: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/schedulers.py", line 263, in schedule
[2020-05-01 07:37:48,341: WARNING/MainProcess] self.sync()
[2020-05-01 07:37:48,341: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/schedulers.py", line 217, in sync
[2020-05-01 07:37:48,341: WARNING/MainProcess] with commit_on_success():
[2020-05-01 07:37:48,341: WARNING/MainProcess] File "/usr/lib/python3.6/contextlib.py", line 81, in enter
[2020-05-01 07:37:48,341: WARNING/MainProcess] return next(self.gen)
[2020-05-01 07:37:48,341: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/db.py", line 52, in commit_on_success
[2020-05-01 07:37:48,341: WARNING/MainProcess] if connection.features.autocommits_when_autocommit_is_off:
[2020-05-01 07:37:48,341: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/django/contrib/gis/db/backends/base/features.py", line 99, in getattr
[2020-05-01 07:37:48,342: WARNING/MainProcess] raise AttributeError
[2020-05-01 07:37:48,342: WARNING/MainProcess] AttributeError
[2020-05-01 07:37:48,342: INFO/MainProcess] Writing entries (0)...
[2020-05-01 07:37:48,343: WARNING/MainProcess] Traceback (most recent call last):
[2020-05-01 07:37:48,343: WARNING/MainProcess] File "/usr/lib/python3.6/multiprocessing/util.py", line 262, in _run_finalizers
finalizer()
[2020-05-01 07:37:48,343: WARNING/MainProcess] File "/usr/lib/python3.6/multiprocessing/util.py", line 186, in call
res = self._callback(*self._args, **self._kwargs)
[2020-05-01 07:37:48,343: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/schedulers.py", line 217, in sync
with commit_on_success():
[2020-05-01 07:37:48,343: WARNING/MainProcess] File "/usr/lib/python3.6/contextlib.py", line 81, in enter
return next(self.gen)
[2020-05-01 07:37:48,343: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/db.py", line 52, in commit_on_success
if connection.features.autocommits_when_autocommit_is_off:
[2020-05-01 07:37:48,343: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/django/contrib/gis/db/backends/base/features.py", line 99, in getattr
raise AttributeError
[2020-05-01 07:37:48,343: WARNING/MainProcess] AttributeError
[2020-05-01 07:37:48,343: INFO/MainProcess] Writing entries (0)...
[2020-05-01 07:37:48,343: WARNING/MainProcess] Traceback (most recent call last):
[2020-05-01 07:37:48,343: WARNING/MainProcess] File "/usr/lib/python3.6/multiprocessing/util.py", line 262, in _run_finalizers
finalizer()
[2020-05-01 07:37:48,344: WARNING/MainProcess] File "/usr/lib/python3.6/multiprocessing/util.py", line 186, in call
res = self._callback(*self._args, **self._kwargs)
[2020-05-01 07:37:48,344: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/schedulers.py", line 217, in sync
with commit_on_success():
[2020-05-01 07:37:48,344: WARNING/MainProcess] File "/usr/lib/python3.6/contextlib.py", line 81, in enter
return next(self.gen)
[2020-05-01 07:37:48,344: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/djcelery/db.py", line 52, in commit_on_success
if connection.features.autocommits_when_autocommit_is_off:
[2020-05-01 07:37:48,344: WARNING/MainProcess] File "/home/shivam/tmq1/venv2/lib/python3.6/site-packages/django/contrib/gis/db/backends/base/features.py", line 99, in getattr
raise AttributeError
[2020-05-01 07:37:48,344: WARNING/MainProcess] AttributeError
@auvipy
Copy link
Member

auvipy commented Jan 19, 2021

The problem is this package only supports the celery 3.x version and older Django versions. the Django versions after 1.11 lts do not support python 2 either. we might end up adding django 2.2+ support to ease the migration from celery 3.x to 4.x/5.x but new django versions won't support python 2.

martey added a commit to mobolic/django-session-cleanup that referenced this issue Jan 20, 2021
@martey
Change package requirements.
d43da91 
Use "celery" instead of "django_celery" since:

  - This package does not explicitly require the Django integration
    features in "django_celery".
  - "django_celery" is not supported in recent versions of celery:
    celery/django-celery#597 (comment)

Also upgrade minimum Celery version from 3.2.0 to 4.4.0, since former
version does not support any currently support version of Django.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@auvipy @shivamzxzx