zerodha/dungbeetle

Health v2 · maintenance only

Adoption not part of the score

1264 stars · 174 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

DungBeetle is a lightweight, single-binary distributed job server for queuing and asynchronously executing heavy SQL read jobs (such as reports) against MySQL, PostgreSQL, or ClickHouse databases. Results are written to separate ephemeral results databases and exposed via HTTP APIs, offloading reporting work from primary application databases.

Use cases

• queue heavy SQL report queries asynchronously instead of running them in the app
• generate user-facing reports without overloading the primary database
• offload reporting layer from application servers
• run thousands of concurrent report requests via a distributed job queue
• cache SQL query results in a fast ephemeral results database
• manage and cancel queued SQL jobs over HTTP APIs

When to choose

• your app serves many concurrent users requesting SQL-based reports
• you want to decouple heavy read queries from your main application and database
• you need a simple single-binary job queue for SQL workloads with MySQL, Postgres, or ClickHouse sources
• you want job results written to a separate fast results database for follow-up queries

When to avoid

• you need general-purpose background job processing beyond SQL queries
• you need write jobs or transactional task execution, not read-only reporting
• you prefer embedding job queues directly in your application framework
• you need complex workflow orchestration or DAG-based scheduling

Facets

service · maturity active

database message-queue http-server api-framework scheduling databases backend analytics developer-tools windows self-hosted go job-queue sql-reports report-generation distributed-workers async-jobs clickhouse mysql postgresql redis-broker single-binary data-engineering linux macos docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="zerodha/dungbeetle")