uber/fiber

Health v2 · maintenance only

Flags: no_releases archived

Adoption not part of the score

1047 stars · 108 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Fiber is a Python distributed computing library for modern computer clusters that exposes the same API as Python's standard multiprocessing library. It uses Nanomsg for fast inter-process communication and Docker/Kubernetes to run code on clusters without manual deployment.

Use cases

• run multiprocessing-style code on a computer cluster
• parallelize large-scale scientific computations like POET
• scale AI model training across cluster CPUs and GPUs
• distribute reinforcement learning experiments
• run parallel workloads on Kubernetes without cluster expertise

When to choose

• you already know Python multiprocessing and want cluster-level scaling
• you want to run parallel jobs on Kubernetes without deploying a separate framework
• you need dynamic CPU/memory/GPU resource allocation for parallel workloads

When to avoid

• you need a stable, actively maintained project (APIs are experimental and releases stopped in 2023)
• you need general-purpose data pipeline processing like Spark or Dask
• you only need parallelism on a single machine (standard multiprocessing suffices)

Facets

library · maturity maintenance

concurrency machine-learning workflow-automation microservices machine-learning developer-tools python multiprocessing cluster-computing parallel-computing nanomsg reinforcement-learning linux docker kubernetes

Member repositories

For agents

markdown · JSON · MCP: product_card(name="uber/fiber")