fugue-project/fugue

Health v2 · maintenance only

Adoption not part of the score

2169 stars · 103 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Fugue is a Python library providing a unified interface for distributed computing, letting users run Python, Pandas, Polars, and SQL code on Spark, Dask, and Ray backends with minimal rewrites. It includes FugueSQL, an enhanced SQL interface that can invoke Python code for end-to-end data workflows.

Use cases

• scale pandas code to spark dask or ray
• parallelize python functions across a cluster
• run sql workflows on top of pandas and spark dataframes
• port local data pipelines to distributed backends without rewrites
• bridge local testing and large-scale distributed execution
• invoke python functions from sql queries

When to choose

• you have pandas or python code that needs to scale to Spark, Dask, or Ray
• you want a SQL interface that works across multiple dataframe engines
• you want to avoid learning framework-specific APIs for each distributed backend
• you need to test logic locally and run the same code at scale

When to avoid

• your data fits comfortably in memory on a single machine
• you want a drop-in pandas replacement like Modin or PySpark Pandas
• you are fully committed to one engine and its native APIs
• you need dbt-style SQL transformation management for warehouses

Facets

library · maturity active

etl data-science workflow-automation big-data microservices data-science python cross-platform distributed-computing spark dask ray pandas polars fuguesql dataframes sql data-engineering

Member repositories

For agents

markdown · JSON · MCP: product_card(name="fugue-project/fugue")