embulk/embulk

Health v2 · maintenance only

Adoption not part of the score

1783 stars · 203 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Embulk is an open-source, plugin-based parallel bulk data loader written in Java that transfers data between databases, storages, file formats, and cloud services. It uses YAML configuration files, supports transaction resuming, automatic format guessing, and plugins distributed via Maven and RubyGems.

Use cases

• load csv files into elasticsearch on a schedule
• transfer data between databases and cloud storage
• bulk load data from s3 into a data warehouse
• convert data between file formats like csv and
• resume failed bulk data load transactions
• parallel loading of large datasets
• pluggable etl pipeline with reusable plugins

When to choose

• you need parallel bulk data transfer between heterogeneous storages, databases, and cloud services
• you want a plugin ecosystem for many input/output formats
• you need transactional guarantees and resumable data loads

When to avoid

• you need streaming or real-time data pipelines rather than batch loads
• you want a project in active development - it is in maintenance mode and looking for long-term maintainers
• you need v0.9 plugin compatibility with v0.11, which is not guaranteed

Facets

cli-tool · maturity maintenance

etl data-science cli plugin-system streaming big-data databases developer-tools jvm cross-platform cli bulk-data-loader data-transfer parallel-loading jruby-plugins data-integration data-engineering automation

Member repositories

For agents

markdown · JSON · MCP: product_card(name="embulk/embulk")