nubskr/walrus

Health v2 · maintenance only

Adoption not part of the score

1923 stars · 73 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Walrus is a distributed log streaming engine written in Rust, built on a high-performance write-ahead-log storage engine with segment-based partitioning and Raft consensus for metadata coordination. It offers fault-tolerant pub/sub messaging with automatic leadership rotation, lease-based write fencing, and io_uring-backed batch I/O on Linux.

Use cases

• replace kafka for high-throughput log streaming
• build event-driven pipelines with a lightweight message broker
• stream logs across a distributed cluster with fault tolerance
• benchmark a rust streaming engine against kafka and rocksdb wal
• run a self-hosted pub/sub message queue with raft metadata

When to choose

• you need a lightweight kafka-like log broker with sub-millisecond batch writes on linux
• you want raft-based fault tolerance without heavy jvm infrastructure
• you're experimenting with or learning distributed log storage engine design

When to avoid

• you need a mature, battle-tested broker with a rich ecosystem of clients and connectors
• you require kafka protocol compatibility or existing consumer tooling
• you need production support on non-linux platforms

Facets

service · maturity experimental

message-queue streaming database rpc microservices databases infrastructure-as-code rust self-hosted cli log-streaming raft-consensus io-uring kafka-alternative event-broker wal segment-based-partitioning messaging linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="nubskr/walrus")