Skip to content

Add celery-redbeat instead of two separate celery containers#1650

Merged
davinotdavid merged 1 commit intomainfrom
use-celery-redbeat
Apr 27, 2026
Merged

Add celery-redbeat instead of two separate celery containers#1650
davinotdavid merged 1 commit intomainfrom
use-celery-redbeat

Conversation

@davinotdavid
Copy link
Copy Markdown
Contributor

@davinotdavid davinotdavid commented Apr 23, 2026

What changed?

  • Added celery-redbeat to requirements.txt
  • Removed the celery-beat container from docker-compose.yml
  • Adjusted the entry.sh file to run with a --beat argument and updated the celery_app to have beat_scheduler as redbeat.RedBeatScheduler

Why?

Infrastructure-wise, it wouldn't be great to have two separate containers for celery and celery without celery-redbeat have concurrency issues when scaling.

How to test

Run the following:

  • docker compose down -v
  • docker compose up -d --build

Check the celery-worker docker container logs and see the pre-existing tasks registered and the heartbeat running successfully.

Applicable Issues

Fixes #1648

Copy link
Copy Markdown
Contributor

@ryanjjung ryanjjung left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It all checks out! Thanks!

@davinotdavid davinotdavid merged commit b324ba3 into main Apr 27, 2026
8 checks passed
@davinotdavid davinotdavid deleted the use-celery-redbeat branch April 27, 2026 14:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Move from Celery beat to Redbeat

3 participants