# bytedance/bitsail

BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.

Repository: https://github.com/bytedance/bitsail
Canonical: https://ross.abutalabs.com/products/bitsail
Homepage: https://bytedance.github.io/bitsail/
Language: Java
License: Apache-2.0
License Family: permissive
Topics: flink, big-data, data-integration, data-lake, data-pipeline, data-synchronization, high-performance, real-time
Archived: true
Last push: 2024-01-01T15:59:00+00:00

## Health v2 (maintenance only)
Score: 10/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 0, release rhythm 8, longevity 100
- inputs: {"age_days": 1434, "days_push": 975, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: archived
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1675, forks 332 (observed 2026-08-28T04:05:20.530213+00:00)

## What it is
BitSail is ByteDance's open-source distributed data integration engine built on Flink, supporting batch, streaming, and incremental data synchronization between heterogeneous data sources. It provides schema synchronization, dirty data collection, flow control, and lakehouse integration at massive scale.

## Use cases
- sync data between heterogeneous databases at scale
- build batch and streaming data pipelines
- load data into a data lake or warehouse
- handle incremental data synchronization
- collect and quarantine dirty records during ETL
- run distributed cloud-native data integration jobs

## When to choose
- you need high-throughput, distributed data synchronization across many source types
- you want one engine covering batch, streaming, and incremental scenarios
- you need schema evolution and dirty data handling built in
- you already run Flink or Hadoop-based infrastructure

## When to avoid
- you need a lightweight single-node ETL tool for small datasets
- your team cannot operate JVM/Flink-based distributed systems
- you need a connector for a source BitSail does not support
- you want a tool with a large active community - development activity has slowed

## Facets
- artifact type: framework
- maturity: maintenance
- function: etl, streaming, data-science, monitoring
- domain: big-data, databases, analytics
- platform: jvm, cloud, self-hosted
- tags: data-integration, flink, data-lake, data-synchronization, batch-streaming, apache-license, data-engineering, docker

## Member repositories
- bytedance/bitsail (main) score 10

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:20.530213+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:42:28.774224+00:00, confidence not recorded.
  - readme: https://github.com/bytedance/bitsail (fetched 2026-08-28T04:05:20.530213+00:00, sha 308241b25f6d)
  - homepage: https://bytedance.github.io/bitsail/ (fetched 2026-08-29T11:15:11.381762+00:00, sha fa16bde6f8ab)
- Data as of 2026-08-30T08:39:29.467469+00:00.