# igorbarinov/awesome-data-engineering

A curated list of data engineering tools for software developers

Repository: https://github.com/igorbarinov/awesome-data-engineering
Canonical: https://ross.abutalabs.com/products/awesome-data-engineering
License: CC0-1.0
License Family: permissive
Topics: awesome, awesome-list
Last push: 2026-07-18T15:19:21+00:00

## Health v2 (maintenance only)
Score: 74/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 93, release rhythm 35, longevity 100
- inputs: {"age_days": 4094, "days_push": 46, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 8992, forks 1602 (observed 2026-08-28T04:10:26.674279+00:00)

## What it is
A curated awesome-list of data engineering tools, databases, frameworks, and resources for software developers. It organizes links across categories like databases, ingestion, stream and batch processing, workflow orchestration, monitoring, and datasets.

## Use cases
- find data engineering tools for building pipelines
- discover open source databases for my stack
- compare stream processing and batch processing frameworks
- find workflow orchestration tools like Airflow alternatives
- learn what tools data engineers use
- find datasets and data dumps for testing

## When to choose
- you want a broad, curated starting point for exploring the data engineering ecosystem
- you are evaluating categories of tools (databases, ingestion, ELK, monitoring) before deep-diving
- you want community-maintained links including podcasts, books, and conferences

## When to avoid
- you need in-depth documentation or tutorials rather than a link list
- you need a specific tool recommendation with benchmarks or comparisons
- you need actively maintained software itself - this is a list of links, not a tool

## Facets
- artifact type: learning-resource
- maturity: active
- function: developer-tools, etl, database, streaming, monitoring, data-visualization
- domain: big-data, databases, awesome-lists, developer-tools
- platform: cross-platform
- tags: awesome-list, curated-list, data-pipelines, batch-processing, data-lake, elk-stack, workflow-orchestration, data-engineering

## Member repositories
- igorbarinov/awesome-data-engineering (main) score 74

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:10:26.674279+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T17:24:22.727759+00:00, confidence not recorded.
  - readme: https://github.com/igorbarinov/awesome-data-engineering (fetched 2026-08-28T04:10:26.674279+00:00, sha aa1c0871b4a6)
- Data as of 2026-08-30T08:39:29.467469+00:00.