Skip to main content
Google Cloud Documentation
Technology areas
  • AI and ML
  • Application development
  • Application hosting
  • Compute
  • Data analytics and pipelines
  • Databases
  • Distributed, hybrid, and multicloud
  • Industry solutions
  • Migration
  • Networking
  • Observability and monitoring
  • Security
  • Storage
Cross-product tools
  • Access and resources management
  • Costs and usage management
  • Infrastructure as code
  • SDK, languages, frameworks, and tools
/
Console
  • English
  • Deutsch
  • Español
  • Español – América Latina
  • Français
  • Indonesia
  • Italiano
  • Português
  • Português – Brasil
  • עברית
  • 中文 – 简体
  • 中文 – 繁體
  • 日本語
  • 한국어
Sign in
  • Pub/Sub
Start free
Overview Guides Reference Samples Resources
Google Cloud Documentation
  • Technology areas
    • More
    • Overview
    • Guides
    • Reference
    • Samples
    • Resources
  • Cross-product tools
    • More
  • Console
  • Discover
  • Product overview
  • Choose Pub/Sub or Cloud Managed Service for Apache Kafka
  • Choose Pub/Sub or Cloud Tasks
  • Pub/Sub architectural overview
  • Pub/Sub reliability
  • Pub/Sub Lite documentation
  • Get started
  • Pub/Sub service overview
  • Publish and subscribe with client libraries
  • Publish and subscribe with the gcloud CLI
  • Publish and subscribe with the console
  • Secure and control access
  • Authenticate to Pub/Sub
  • Access control for Pub/Sub
  • Configure message encryption
  • Configure message storage policies
  • Create and manage tags
  • Publish messages
  • Publish message overview
  • Create a topic
    • Standard topic
    • Amazon Kinesis Data Streams import topic
    • Cloud Storage import topic
    • Azure Event Hubs import topic
    • Amazon Managed Streaming for Apache Kafka (MSK) import topic
    • Confluent Cloud import topic
  • Manage topics
    • Change topic type
    • Delete topics
    • List topics
  • Publish messages
  • Configure publishing options
    • Compress messages
    • Retry requests
    • Flow control
    • Concurrency control
    • Batch messaging
  • Use schemas
    • Associate a schema with a topic
    • Publish messages to a topic with a schema
  • Use SMTs
    • Create a topic SMT
    • Update a topic SMT
    • Delete a topic SMT
  • Best practices for publishing
  • Receive messages
  • Subscription overview
  • Choose a subscription type
  • How subscriptions work
    • Pull subscriptions
    • Push subscriptions
    • BigQuery subscriptions
    • Bigtable subscriptions
    • Cloud Storage subscriptions
  • Create a subscription
    • Subscription properties
    • Pull subscription
    • Push subscription
    • BigQuery subscription
    • Bigtable subscription
    • Cloud Storage subscription
  • Manage subscriptions
    • Change subscription type
    • List subscriptions
    • Detach a subscription from a topic
    • Delete subscriptions
    • Receive messages from pull subscriptions
  • Use SMTs
    • Create a subscription SMT
    • Update a subscription SMT
    • Delete a subscription SMT
  • Configure delivery options
    • Flow control
    • Handle message failures
      • Dead letter topics
      • Subscription retry policy
    • Message retention
    • Replay and purge messages
    • Lease management
    • Order messages
    • Filter messages
    • Validate schemas
    • Exactly-once delivery
    • Concurrency control
    • Authentication for push subscriptions
    • Payload unwrapping
  • Best practices for subscribing
  • Validate and transform messages
  • Schemas
    • Schema overview
    • Create a schema
    • Commit a schema revision
    • Delete a schema
    • Delete a schema revision
    • List schemas
    • List revisions of a schema
    • Roll back a schema revision
    • View schema details
    • Validate a schema definition
    • Validate a message for a schema
  • Single message transforms (SMTs)
    • SMT overview
    • Choose topic or subscription SMTs
    • AI Inference SMT
    • User-defined function (UDF) SMT
  • Monitor and audit
  • Monitor Pub/Sub in Cloud Monitoring
  • Monitor topics within Pub/Sub
  • Monitor subscriptions within Pub/Sub
  • View Pub/Sub audit logs
  • View Pub/Sub reports with labels
  • Use OpenTelemetry tracing
  • Best practices for metrics in scaling
  • Build Pub/Sub systems
  • Build a one-to-many Pub/Sub system
  • Replay messages with seek
  • Migrate from Kafka to Pub/Sub
  • Use the Pub/Sub remote MCP server
  • Test and integrate
  • Test locally with Pub/Sub emulator
  • Connect Pub/Sub to Apache Kafka
  • Pub/Sub in Spring applications
  • Pub/Sub with Cloud Run
  • Integrate Pub/Sub with Cloud Functions
    • Pub/Sub triggers in Cloud Functions
    • Optical Character Recognition (OCR)
  • Integrate Pub/Sub with Dataflow
    • Stream from Pub/Sub to Cloud Storage with Dataflow
    • Stream from Pub/Sub to BigQuery
    • Stream with Pub/Sub and Dataflow
    • Stream logs to Splunk using Pub/Sub and Dataflow
  • Work with messages in App Engine
  • Stream Pub/Sub messages over WebSockets
  • Troubleshoot
  • General troubleshooting
  • Troubleshooting with audit logs
  • Troubleshoot topics
    • Troubleshoot standard topics
    • Troubleshoot import topics
      • Use platform logs to troubleshoot import topics
      • Troubleshoot Amazon Kinesis Data Streams import topics
      • Troubleshoot Cloud Storage import topics
      • Troubleshoot Azure Events Hub import topics
      • Troubleshoot Amazon MSK import topics
      • Troubleshoot Confluent Cloud import topics
  • Troubleshoot subscriptions
    • Troubleshoot pull subscriptions
    • Troubleshoot push subscriptions
    • Troubleshoot push payload unwrapping
    • Troubleshoot BigQuery subscriptions
    • Troubleshoot Bigtable subscriptions
    • Troubleshoot Cloud Storage subscriptions
    • Troubleshoot subscriptions with SMTs
  • Troubleshoot with GCPDiag
    • Troubleshoot pull subscriptions with GCPDiag
  • Code samples
  • Pub/Sub code samples
  • AI and ML
  • Application development
  • Application hosting
  • Compute
  • Data analytics and pipelines
  • Databases
  • Distributed, hybrid, and multicloud
  • Industry solutions
  • Migration
  • Networking
  • Observability and monitoring
  • Security
  • Storage
  • Access and resources management
  • Costs and usage management
  • Infrastructure as code
  • SDK, languages, frameworks, and tools
  • Home
  • Documentation
  • Data analytics
  • Pub/Sub
  • Guides

Connect Pub/Sub to Apache Kafka Stay organized with collections Save and categorize content based on your preferences.

This document describes how to integrate Apache Kafka and Pub/Sub by using the Pub/Sub Group Kafka Connector.

Note: You can also use this connector with Pub/Sub Lite. See Connect Pub/Sub Lite to Apache Kafka.

About the Pub/Sub Group Kafka Connector