# datazip-inc/olake

OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics.  Supported sources :  Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.

Repository: https://github.com/datazip-inc/olake
Canonical: https://ross.abutalabs.com/products/olake
Homepage: https://olake.io
Language: Go
License: Apache-2.0
License Family: permissive
Topics: cdc, change-data-capture, data-pipeline, database, elt, lakehouse, replication, apache-iceberg, parquet, s3, hacktoberfest, kafka
Last push: 2026-08-26T15:57:58+00:00

## Health v2 (maintenance only)
Score: 84/100 (v2, computed 2026-09-03T02:39:23.370411+00:00)
- activity 99, release rhythm 86, longevity 49
- inputs: {"age_days": 687, "days_push": 7, "days_rel": 12, "gap_med": 4.5, "n_releases_24m": 71}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1431, forks 248 (observed 2026-08-28T04:04:42.433129+00:00)

## What it is
OLake Go is a high-performance open-source EL (extract-load) engine written in Go that replicates databases (PostgreSQL, MySQL, MongoDB, Oracle, MSSQL, DB2), Kafka, and S3 into Apache Iceberg tables or Parquet files on object storage. It supports full refresh, incremental sync, and CDC with parallel chunking, schema evolution, and a self-hosted web UI/CLI, plus companion Iceberg table maintenance (OLake Fusion).

## Use cases
- replicate postgres to apache iceberg
- cdc replication from mysql to data lakehouse
- ingest mongodb into parquet on s3
- stream kafka topics to iceberg tables
- build a lakehouse without spark or debezium
- self-hosted elt pipeline for real-time analytics
- automate iceberg table compaction and maintenance

## When to choose
- you need fast, scalable database-to-Iceberg ingestion with CDC and incremental sync
- you want vendor-lock-in-free lakehouse tables queryable by any engine (Glue, Hive, REST, JDBC catalogs)
- you want a lightweight self-hosted pipeline with no Spark, Flink, Kafka Connect, or Debezium dependency
- you need a web UI plus CLI for managing sync jobs on your own infrastructure

## When to avoid
- you need transformations in the pipeline (OLake is EL only, not ELT/ETL with transforms)
- your source is not among the supported databases, Kafka, or S3
- you need CDC from Oracle or DB2, which is not yet supported
- you prefer a fully managed cloud data pipeline service

## Facets
- artifact type: application
- maturity: active
- function: etl, streaming, database, data-science, cli, gui
- domain: big-data, databases, analytics, self-hosted
- platform: self-hosted, go, cross-platform, cloud
- tags: change-data-capture, apache-iceberg, parquet, lakehouse, data-replication, cdc, kafka, s3, elt, data-pipeline, data-engineering, docker, kubernetes

## Member repositories
- datazip-inc/olake (main) score 84

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:04:42.433129+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T04:37:06.789295+00:00, confidence not recorded.
  - readme: https://github.com/datazip-inc/olake (fetched 2026-08-28T04:04:42.433129+00:00, sha b4d99e594eea)
  - homepage: https://olake.io (fetched 2026-08-29T11:48:33.792820+00:00, sha 03d17a2caa6d)
  - site_page: https://olake.io/docs (fetched 2026-08-29T11:48:33.801967+00:00, sha 41a8e56e415a)
  - site_page: https://olake.io/docs/fusion/getting-started/overview (fetched 2026-08-29T11:48:33.803958+00:00, sha c6d56124e7b8)
  - site_page: https://olake.io/docs/getting-started/quickstart (fetched 2026-08-29T11:48:33.808180+00:00, sha 60f834ced153)
  - site_page: https://olake.io/docs/benchmarks/ingestion (fetched 2026-08-29T11:48:33.810679+00:00, sha fa8d32007d42)
  - site_page: https://olake.io/docs/release/ingestion/v0.9.0 (fetched 2026-08-29T11:48:33.812552+00:00, sha 188361ee25cc)
  - site_page: https://olake.io/about-us (fetched 2026-08-29T11:48:33.814862+00:00, sha 17002c1e264f)
  - site_page: https://olake.io/contact (fetched 2026-08-29T11:48:33.806389+00:00, sha 2ac2a5121e96)
- Data as of 2026-08-30T08:39:29.467469+00:00.