twitter/algebird

Health v2 · maintenance only

Adoption not part of the score

2295 stars · 345 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Algebird is a Scala library providing abstract algebra typeclasses (Monoids, Groups, Rings) for building composable aggregation systems. It includes monoid implementations for probabilistic data structures like HyperLogLog, CountMinSketch, and Bloom filters, originally built for Twitter's Scalding and Summingbird frameworks.

Use cases

• combine approximate statistics like HLL sketches in a MapReduce job
• implement composable aggregations over maps and tuples in Scala
• estimate cardinality of large datasets with low memory
• count approximate item frequencies with CountMinSketch
• define custom monoids for distributed reductions
• merge probabilistic data structures in streaming systems

When to choose

• you are building aggregation systems on JVM big-data frameworks like Scalding, Storm, or Summingbird
• you need composable, mergeable approximate statistics (HLL, CountMinSketch, Bloom filters)
• you want typeclass-based algebraic abstractions for reductions in Scala

When to avoid

• you need a general-purpose math or linear algebra library rather than algebraic typeclasses for aggregation
• your project is not on the JVM/Scala
• you need actively developed probabilistic structures with the latest research features

Facets

library · maturity stable

serialization data-science developer-tools big-data data-science developer-tools jvm abstract-algebra monoids typeclasses probabilistic-data-structures hyperloglog count-min-sketch bloom-filter aggregation scala algorithms

Member repositories

For agents

markdown · JSON · MCP: product_card(name="twitter/algebird")