# redpanda-data/connect

Fancy stream processing made operationally mundane

Repository: https://github.com/redpanda-data/connect
Canonical: https://ross.abutalabs.com/products/redpanda-data-connect
Homepage: https://docs.redpanda.com/connect/home/
Language: Go
License Family: other
Topics: message-queue, stream-processing, streaming-data, message-bus, logs, stream-processor, cqrs, event-sourcing, go, golang, kafka, amqp, rabbitmq, nats, etl, data-engineering, data-ops
Last push: 2026-08-26T23:42:39+00:00

## Health v2 (maintenance only)
Score: 95/100 (v2, computed 2026-09-03T02:39:23.370411+00:00)
- activity 99, release rhythm 86, longevity 100
- inputs: {"age_days": 3817, "days_push": 7, "days_rel": 13, "gap_med": 6, "n_releases_24m": 102}
- flags: no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 8736, forks 959 (observed 2026-08-28T04:10:25.418703+00:00)

## What it is
Redpanda Connect (formerly Benthos) is a declarative stream processor that moves data between hundreds of sources and sinks with transformation, enrichment, and filtering via the Bloblang mapping language. Pipelines are defined in a single YAML file and run as a stateless, horizontally scalable binary or container.

## Use cases
- stream postgres database changes into iceberg tables on s3
- pipe kafka topics to elasticsearch with transformations
- build etl pipelines between message brokers like rabbitmq and nats
- enrich and filter log streams before shipping to a data lake
- set up change data capture from mysql or mongodb
- transform json events between cloud services like s3 and bigquery

## When to choose
- you need to move and transform data between many systems with declarative YAML config
- you want CDC from databases flowing into analytics stores as first-class events
- you need at-least-once delivery with a stateless, horizontally scalable deployment
- you prefer a single static binary or container over maintaining custom pipeline code

## When to avoid
- you need exactly-once processing semantics with durable state
- you want a visual drag-and-drop pipeline builder rather than config files
- your transformations require complex custom logic better expressed in a general-purpose language
- you need a full streaming broker rather than a connector/processor layer

## Facets
- artifact type: application
- maturity: active
- function: streaming, etl, message-queue, data-science, configuration-management
- domain: big-data, databases, analytics
- platform: go, windows, cli, self-hosted, cloud
- tags: stream-processing, change-data-capture, bloblang, kafka, data-pipelines, connectors, yaml-config, event-streaming, data-engineering, real-time, docker, kubernetes, linux, macos

## Member repositories
- redpanda-data/connect (main) score 95

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:10:25.418703+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T17:25:18.424411+00:00, confidence not recorded.
  - readme: https://github.com/redpanda-data/connect (fetched 2026-08-28T04:10:25.418703+00:00, sha 20d49241bca1)
  - homepage: https://docs.redpanda.com/connect/home/ (fetched 2026-08-29T08:25:50.379541+00:00, sha a6e48227e113)
  - site_page: https://docs.redpanda.com/home (fetched 2026-08-29T08:25:50.390009+00:00, sha ef4b8c4fd806)
  - site_page: https://docs.redpanda.com/streaming/current/get-started/quickstarts (fetched 2026-08-29T08:25:50.393112+00:00, sha 0e39761c86b2)
  - site_page: https://docs.redpanda.com/streaming/current/get-started/rpk-quickstart (fetched 2026-08-29T08:25:50.396129+00:00, sha bfa2dbee68a4)
  - site_page: https://docs.redpanda.com/streaming/current/get-started/licensing/overview (fetched 2026-08-29T08:25:50.399252+00:00, sha ffb32fdbeba2)
  - site_page: https://docs.redpanda.com/streaming/current/get-started/licensing/disable-enterprise-features (fetched 2026-08-29T08:25:50.401937+00:00, sha 79178f46c642)
  - site_page: https://docs.redpanda.com/streaming/current/get-started/rpk-install (fetched 2026-08-29T08:25:50.405103+00:00, sha 9d234545d210)
  - site_page: https://docs.redpanda.com/streaming/current/get-started/partner-integration (fetched 2026-08-29T08:25:50.407989+00:00, sha 75309d86d081)
  - site_page: https://docs.redpanda.com/streaming/current/manage/cluster-maintenance/about-throughput-quotas (fetched 2026-08-29T08:25:50.409912+00:00, sha 119aed1fb1f4)
- Data as of 2026-08-30T08:39:29.467469+00:00.