跳至主要内容
技术领域
close
AI 和机器学习
应用开发
应用托管
计算
数据分析和流水线
数据库
分布式云、混合云和多云
生成式 AI
行业解决方案
网络
可观测性和监控
安全
Storage
跨产品工具
close
访问权限和资源管理
费用和用量管理
基础设施即代码
迁移
SDK、语言、框架和工具
/
控制台
English
Deutsch
Español
Español – América Latina
Français
Indonesia
Italiano
Português
Português – Brasil
עברית
中文 – 简体
中文 – 繁體
日本語
한국어
登录
Cloud Dataflow
免费开始使用吧
概览
指南
Dataflow 机器学习
参考文档
示例
资源
技术领域
更多
概览
指南
Dataflow 机器学习
参考文档
示例
资源
跨产品工具
更多
控制台
Dataflow
所有 API
Apache Beam SDK
Java 版 SDK 2.x
Python 版 SDK 2.x
Go 版 SDK 2.x
SDK 版本支持状态
Apache Beam 运行时支持
SDK 和工作器依赖项
使用不支持的 SDK
客户端库
.NET 客户端库
Java 客户端库
Node.js 客户端库
PHP 客户端库
Python 客户端库
服务 API
REST API
概览
REST 资源
projects.jobs
概览
aggregated
create
get
getMetrics
list
快照
update
projects.jobs.messages
概览
list
projects.locations.flexTemplates
概览
启动
projects.locations.jobs
概览
create
get
getExecutionDetails
getMetrics
list
快照
update
projects.locations.jobs.messages
概览
list
projects.locations.jobs.stages
概览
getExecutionDetails
projects.locations.templates
概览
create
get
启动
projects.templates
概览
create
get
启动
类型
DynamicTemplateLaunchParams
ExecutionState
过滤
GetTemplateResponse
JobMessageImportance
JobMetrics
JobView
LaunchTemplateParameters
LaunchTemplateResponse
ListJobMessagesResponse
ListJobsResponse
MetricUpdate
ProgressTimeseries
RuntimeEnvironment
快照
StragglerInfo
TemplateView
RPC 参考文档
概览
google.dataflow.v1beta3
google.rpc
Data Pipelines 参考
概览
REST API
REST 资源
projects.locations.pipelines
概览
create
delete
get
list
patch
run
stop
projects.locations.pipelines.jobs
概览
list
类型
作业
RPC 参考文档
概览
google.cloud.datapipelines.v1
google.rpc
Google 提供的 Dataflow 模板
批处理模板
任意源数据库到 Spanner
Apache Cassandra to Bigtable
AstraDB to BigQuery
BigQuery to Bigtable
BigQuery to Clickhouse
BigQuery to Elasticsearch
BigQuery to MongoDB
BigQuery to Parquet Files on Cloud Storage
BigQuery to TFRecord Files on Cloud Storage
Bigtable to Avro files on Cloud Storage
Bigtable to JSON files on Cloud Storage
Bigtable to Parquet Files on Cloud Storage
Bigtable to SequenceFile Files on Cloud Storage
Bigtable 变更数据流到 Vertex AI Vector Search
Bigtable to Vertex AI Vector Search files on Cloud Storage
Spanner to Avro files on Cloud Storage
Spanner to BigQuery
Spanner to Text Files on Cloud Storage
Spanner to Vertex AI Vector Search Files on Cloud Storage
Cloud Storage Avro Files to Bigtable
Cloud Storage Avro Files to Spanner
Cloud Storage CSV files to BigQuery
Cloud Storage Parquet Files to Bigtable
Cloud Storage SequenceFile Files to Bigtable
Cloud Storage Text Files to BigQuery
具有 Python UDF 的 Cloud Storage Text Files to BigQuery
Cloud Storage Text Files to Spanner
Cloud Storage Text Files to Datastore
Cloud Storage to Elasticsearch
Cloud Storage Text Files to Firestore
Cloud Storage Text Files to Pub/Sub
Datastore to Cloud Storage
Firestore to Cloud Storage
Google Ads to BigQuery
Google Cloud to Neo4j
JDBC to BigQuery
JDBC to Pub/Sub
MongoDB to BigQuery
MySQL to BigQuery
从 Oracle 迁移到 BigQuery
PostgreSQL to BigQuery
SQL Server to BigQuery
流处理模板
Apache Kafka 到 Apache Kafka
Apache Kafka to BigQuery
Apache Kafka 到 Cloud Storage
Bigtable change streams to BigQuery
Bigtable change streams to Pub/Sub
Spanner change streams to BigQuery
Spanner change streams to Cloud Storage
Spanner change streams to Pub/Sub
Cloud Storage Text Files to BigQuery
具有 Python UDF 的 Cloud Storage Text Files to BigQuery
Cloud Storage Text Files to Pub/Sub
Data Masking/Tokenization using Cloud DLP to BigQuery
Datastream to BigQuery
Datastream to Spanner
Datastream to SQL
JMS to Pub/Sub
MongoDB to BigQuery
MySQL Change Data to BigQuery
MQTT to Pub/Sub
Pub/Sub 到 BigQuery
具有 Python UDF 的 Pub/Sub to BigQuery
Pub/Sub Avro to BigQuery
Pub/Sub Proto to BigQuery
具有 Python UDF 的 Pub/Sub Proto to BigQuery
Pub/Sub Subscription to BigQuery
Pub/Sub to Avro Files on Cloud Storage