GoogleCloudPlatform/DataflowTemplates
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks observed · 2026-08-28
Health v2 · maintenance only
95/100
- Activity 99
- Release rhythm 87
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: 6
- age_days: 3127
- days_rel: 7
- days_push: 7
- n_releases_24m: 100
Adoption not part of the score
1310 stars · 1111 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A collection of Google-provided Apache Beam pipeline templates for Google Cloud Dataflow that solve common in-cloud data tasks like import/export, backup/restore, and bulk API operations without writing pipeline code. The templates are open source Java pipelines that can be run as-is or customized and extended by developers.
Use cases
- stream data from Kafka or Pub/Sub into BigQuery
- run change data capture from MySQL to BigQuery
- migrate data from Datastream into Spanner or BigQuery
- export BigQuery tables to Cloud Storage
- bulk copy or backup data between Google Cloud databases
- mask or tokenize data with Cloud DLP while loading into BigQuery
- process MongoDB or JMS data streams without writing pipeline code
When to choose
- you need prebuilt, production-ready pipelines for common GCP data movement tasks
- you want to run batch or streaming ETL on Dataflow without a development environment
- you need a customizable starting point for Apache Beam pipelines on Google Cloud
When to avoid
- your data workloads run outside Google Cloud
- you need highly custom transformation logic that doesn't fit any template
- you prefer lightweight local ETL tools rather than managed cloud dataflow jobs
Facets
framework · maturity active
etl streaming data-science workflow-automation big-data cloud-computing databases analytics cloud jvm google-cloud-dataflow apache-beam pipeline-templates bigquery bigtable cloud-spanner gcp batch-processing change-data-capture data-engineering docker
2 sources
- readme: https://github.com/GoogleCloudPlatform/DataflowTemplates · fetched 2026-08-28 · ec414145bfb6
- homepage: https://cloud.google.com/dataflow/docs/guides/templates/provided-templates · fetched 2026-08-29 · 0f2472d7a113
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| GoogleCloudPlatform/DataflowTemplates | main | 95 |
For agents
markdown · JSON · MCP: product_card(name="GoogleCloudPlatform/DataflowTemplates")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem