Cloud Tasks Queue Setup

Overview

Create and configure Google Cloud Tasks queues for reliable asynchronous task execution. Covers queue creation with rate limiting and retry policies, HTTP and App Engine task targets, task dispatching with scheduling delays, and queue management operations (pause, resume, purge).

Prerequisites

• Google Cloud project with Cloud Tasks API enabled (gcloud services enable cloudtasks.googleapis.com)
• gcloud CLI authenticated with roles/cloudtasks.admin or roles/cloudtasks.enqueuer IAM role
• Target HTTP endpoint or App Engine service to receive dispatched tasks
• Service account with appropriate permissions for task execution

Instructions

1. Create a Cloud Tasks queue with rate limiting: gcloud tasks queues create <queue-name> --location=<region> --max-dispatches-per-second=10 --max-concurrent-dispatches=5
2. Configure retry policy for failed tasks: gcloud tasks queues update <queue-name> --max-attempts=5 --min-backoff=1s --max-backoff=300s --max-doublings=4
3. Create an HTTP task targeting your endpoint: gcloud tasks create-http-task --queue=<queue-name> --url=https://your-service.run.app/process --method=POST --body-content='<json-payload>'
4. Schedule a delayed task by adding --schedule-time with an ISO 8601 timestamp up to 30 days in the future
5. Verify queue status and task counts: gcloud tasks queues describe <queue-name> to check dispatch rate, retry config, and queue state
6. Manage queue operations: pause (gcloud tasks queues pause), resume (gcloud tasks queues resume), or purge all tasks (gcloud tasks queues purge)

Examples

Setting up an email processing queue: Create a queue with 5 dispatches per second rate limit and 3 max concurrent tasks to avoid overwhelming the email service. Configure retry with exponential backoff (1s min, 60s max, 3 doublings) and 10 max attempts for transient failures.