# spotify/scio

A Scala API for Apache Beam and Google Cloud Dataflow.

Repository: https://github.com/spotify/scio
Canonical: https://ross.abutalabs.com/products/scio
Homepage: https://spotify.github.io/scio
Language: Scala
License: Apache-2.0
License Family: permissive
Topics: scala, bigquery, google-cloud, beam, dataflow, batch, streaming, data, ml, scio
Last push: 2026-08-11T19:43:46+00:00

## Health v2 (maintenance only)
Score: 96/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 97, release rhythm 91, longevity 100
- inputs: {"age_days": 4178, "days_push": 22, "days_rel": 63, "gap_med": 20.5, "n_releases_24m": 23}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2628, forks 533 (observed 2026-08-28T04:07:05.469331+00:00)

## What it is
Scio is a Scala API for Apache Beam and Google Cloud Dataflow, inspired by Apache Spark and Scalding. It provides a unified batch and streaming programming model with type-safe integrations for Google Cloud products and various data formats.

## Use cases
- write batch data pipelines in Scala on Apache Beam
- run streaming data processing jobs on Google Cloud Dataflow
- read and write BigQuery tables in a type-safe way
- process Avro, Parquet, and Protobuf data at scale
- integrate pipelines with Pub/Sub, Bigtable, and Cloud Storage
- run machine learning pipelines with TensorFlow IO
- develop and test data pipelines interactively with a Scala REPL

## When to choose
- your team works in Scala and needs a Spark-like API on Beam
- you run data pipelines on Google Cloud Dataflow
- you need unified batch and streaming processing with strong typing
- you want deep integration with Google Cloud data products like BigQuery

## When to avoid
- you prefer Python or Java directly over Scala
- you need a runner or cloud other than Beam-supported ones without extra work
- your pipelines are small enough that a simpler tool suffices

## Facets
- artifact type: framework
- maturity: active
- function: etl, streaming, data-science, machine-learning, serialization
- domain: big-data, data-science, cloud-computing, microservices
- platform: jvm, cloud
- tags: apache-beam, google-cloud-dataflow, bigquery, batch-processing, scala-api, data-pipelines, data-engineering

## Member repositories
- spotify/scio (main) score 96

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:07:05.469331+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T02:19:42.905622+00:00, confidence not recorded.
  - readme: https://github.com/spotify/scio (fetched 2026-08-28T04:07:05.469331+00:00, sha 01fdd9bf4b4d)
  - homepage: https://spotify.github.io/scio (fetched 2026-08-29T10:02:31.338185+00:00, sha 0d385c672f4a)
- Data as of 2026-08-30T08:39:29.467469+00:00.