Skip to main content
Technology areas
close
AI and ML
Application development
Application hosting
Compute
Data analytics and pipelines
Databases
Distributed, hybrid, and multicloud
Industry solutions
Migration
Networking
Observability and monitoring
Security
Storage
Cross-product tools
close
Access and resources management
Costs and usage management
Infrastructure as code
SDK, languages, frameworks, and tools
/
Console
English
Deutsch
Español – América Latina
Français
Indonesia
Italiano
Português – Brasil
עברית
中文 – 简体
中文 – 繁體
日本語
한국어
Sign in
Managed Service for Apache Kafka
Start free
Overview
Guides
Reference
Samples
Resources
Technology areas
More
Overview
Guides
Reference
Samples
Resources
Cross-product tools
More
Console
Discover
Product overview
Choose Managed Service for Apache Kafka or Pub/Sub
Move Kafka data to Google Cloud
Get started
Create and view a cluster
Produce and consume messages with the Kafka command-line tools
Develop a Java producer
Develop a Python producer
Produce Avro messages with the schema registry
Generate synthetic data
Create and manage Kafka clusters
Plan your Kafka cluster size
Configure networking
Create a Kafka cluster
List your Kafka clusters
View a Kafka cluster
Update a Kafka cluster
Delete a Kafka cluster
Topics
Create a Kafka topic
List your Kafka topics
View a Kafka topic
Update a Kafka topic
Delete a Kafka topic
Consumer groups
Overview of Kafka consumer groups
List your Kafka consumer groups
View a Kafka consumer group
Update a Kafka consumer group
Delete a Kafka consumer group
Brokers
Overview
View brokers
Change partition assignment
Use quotas for load isolation
Use the Managed Service for Apache Kafka remote MCP server
Control access
Authenticate to Managed Service for Apache Kafka API
Authenticate to Kafka brokers
Authentication types for Kafka brokers
Authenticate with SASL
Authenticate with mTLS
Access control for Managed Service for Apache Kafka
Access control with Kafka ACLs
Overview
Create a Managed Kafka ACL
Add an ACL entry
Remove an ACL entry
Replace all ACL entries
List Managed Kafka ACLs
View a Managed Kafka ACL
Delete a Managed Kafka ACL
Configure message encryption
Use custom constraints to manage resources
Create and manage schemas
Overview of schema registry
Schema lifecycle management
Create and manage a schema registry
Create a schema registry
List all schema registries
View a schema registry
Update a schema registry
Delete a schema registry
Create and manage subjects
Create a subject
List subjects
Delete a subject
Register a new schema version
List subject versions
Delete a subject version
Update schema mode
Update compatibility type
Move Kafka data using Kafka Connect
Kafka Connect overview
Get started with Kafka Connect
Replicate Pub/Sub messages to Kafka
Write Kafka messages to BigQuery
Back up Kafka messages to Cloud Storage
Replicate Kafka topics with MirrorMaker 2.0
Use Kafka Connect with Schema Registry
Create and manage Connect clusters
Create a Connect cluster
List your Connect clusters
View a Connect cluster
Edit a Connect cluster
Delete a Connect cluster
Create and manage connectors
Connectors overview
Connector types
Create a MirrorMaker 2.0 connector
Create a Pub/Sub Source connector
Create a Pub/Sub Sink connector
Create a Cloud Storage Sink connector
Create a BigQuery Sink connector
Create a Cloud SQL for PostgreSQL Source connector
Create a Generic PostgreSQL Source connector
List your connectors
View a connector
Update a connector
Delete a connector
Pause, resume, stop and restart a connector
Monitor
Monitor Kafka clusters
Monitor Kafka clusters for reliability
Monitor client applications
Audit logs
Audit logging
Use audit logs
Troubleshoot
Troublshoot Kafka clusters
Troubleshoot mTLS authentication
Troubleshoot Kafka Connect
Troubleshoot Connect clusters and connectors
Troubleshoot a BigQuery Sink connector
Troubleshoot a PostgreSQL Source connector
Troubleshoot a Cloud Storage sink connector
Troubleshoot a MirrorMaker 2.0 connector