Docs / Batch Queue

Batch Queue

Mass content production at economy-tier cost. Queue hundreds of generation tasks, manage priorities, and route outputs to the right destination automatically.

How It Works

The Batch Queue routes high-volume tasks to the Economy tier (DeepSeek V4) for cost-efficient processing:

  1. Submit batch items via the dashboard or API with type, prompt, and count
  2. Items enter a priority queue managed by the Batch Runner agent
  3. The runner processes items sequentially, respecting rate limits
  4. Completed outputs are saved to the vault and reported via WebSocket
  5. Failed items are automatically retried up to 3 times

Supported Batch Types

TypeDescriptionTypical Count
blogBlog posts on specified topics10-50
socialSocial media posts with platform variants20-100
productProduct descriptions and listings10-200
emailEmail sequences and templates5-30
seoSEO-optimized page content10-100

API Usage

POST /api/batch

Submit a new batch job for processing.

{
  "type": "blog",
  "prompt": "Write about sustainable tech trends",
  "count": 10,
  "priority": "normal"
}

Priority Levels

  • high — Processed immediately, jumps to front of queue
  • normal — Standard FIFO processing (default)
  • low — Processed only when no higher-priority items remain

Rate Limiting

Batch operations are subject to rate limiting to manage API costs:

  • Maximum 10 batch submissions per minute (heavy rate limiter)
  • Maximum 100 items per single batch submission
  • Economy-tier processing has provider-specific throughput limits
  • Failed items use exponential backoff before retry

Dashboard View

The Batch view provides real-time monitoring:

  • Queue depth and estimated completion time
  • Per-item status tracking (queued, processing, complete, failed)
  • Output preview with download options
  • Cost estimation and actual spend tracking
  • Bulk actions (pause, resume, cancel, re-queue failed)