Awesome Queues

A curated list of awesome queueing systems for background jobs and distributed tasks.

Queues allow you to create reliable distributed background tasks - logic that runs in the background, separate from your main request.

---

Serverless queues

• Inngest - An event-driven serverless queue, in which serverless functions are triggered by HTTP events.
• SQS - A cloud message queue from AWS, supporting Lambda functions

Language-agnostic queues

• SQS - A cloud message queue from AWS. Supports elastic scale, and delaying jobs up to 15m ahead of time.
• Inngest - An event-driven queue, running serverless functions in any language
• Faktory - A self-hosted distributed task queue written in Go, with SDKs available for many languages
• Temporal - A durable execution system: reliable, automatic queueing that handles high scale.

Language-specific queues

Python queues

• Celery, a commonly used distributed task queue written in Python
• RQ, a simple task queue for Python backed by Redis

Go queues

• Tasqueue - A task queue service backed by Redis or NATS. It supports cron, but not delayed jobs.
• Asynq - A task queue service backed by Redis.

Ruby queues

• Sidekiq - A very common background task runner for Ruby, backed by Redis.

JavaScript, TypeScript, and NodeJS queues

• BullMQ - A message queue for NodeJS backed by redis