Set up Celery worker infrastructure #18

Closed
opened 2025-12-29 23:45:59 +00:00 by cardosofelipe · 0 comments

Description

Configure Celery for background task processing with Redis as broker.

Requirements

Queue Configuration

Per ADR-003:

Queue Workers Purpose
agent 4 High-priority agent tasks
git 2 Git operations
sync 2 Issue synchronization
default 2 General tasks

Backend Integration

  • Create app/core/celery_app.py with Celery configuration
  • Create app/tasks/ directory structure
  • Create sample task for testing

Docker Compose

  • Add Celery worker service per queue
  • Add Celery beat for scheduled tasks (optional for Phase 0)
  • Health checks for workers

Acceptance Criteria

  • Celery app configured with Redis broker
  • All 4 queues defined and routable
  • Worker services in Docker Compose
  • Sample task executes successfully
  • Workers restart on failure
  • Health checks pass

Technical Notes

  • Reference: ADR-003 (Celery task queue architecture)
  • Reference: SPIKE-002 (Agent orchestration patterns)
  • Use celery[redis] package

Assignable To

backend-engineer agent (Celery config), devops-engineer agent (Docker)

## Description Configure Celery for background task processing with Redis as broker. ## Requirements ### Queue Configuration Per ADR-003: | Queue | Workers | Purpose | |-------|---------|---------| | agent | 4 | High-priority agent tasks | | git | 2 | Git operations | | sync | 2 | Issue synchronization | | default | 2 | General tasks | ### Backend Integration - Create `app/core/celery_app.py` with Celery configuration - Create `app/tasks/` directory structure - Create sample task for testing ### Docker Compose - Add Celery worker service per queue - Add Celery beat for scheduled tasks (optional for Phase 0) - Health checks for workers ## Acceptance Criteria - [ ] Celery app configured with Redis broker - [ ] All 4 queues defined and routable - [ ] Worker services in Docker Compose - [ ] Sample task executes successfully - [ ] Workers restart on failure - [ ] Health checks pass ## Technical Notes - Reference: ADR-003 (Celery task queue architecture) - Reference: SPIKE-002 (Agent orchestration patterns) - Use `celery[redis]` package ## Assignable To backend-engineer agent (Celery config), devops-engineer agent (Docker)
cardosofelipe added the backenddevopsphase-0 labels 2025-12-29 23:49:39 +00:00
Sign in to join this conversation.