uqfoundation/pathos

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

1484 stars · 89 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

pathos is a Python framework for parallel graph management and execution across heterogeneous computing resources. It provides drop-in parallel and distributed versions of map and apply, with pluggable launchers including ssh-based, MPI-based, and multiprocessing backends.

Use cases

• parallelize a serial Python loop with minimal refactoring
• run map/apply across multiple machines over ssh
• launch MPI-based parallel jobs on a cluster
• nest parallel maps for hierarchical heterogeneous computing
• serialize Python functions and closures for remote execution
• monitor and control remote RPC services from Python

When to choose

• you want drop-in parallel map without rewriting your codebase
• you need one codebase spanning serial, threaded, multiprocess, ssh, and MPI execution
• you need to pickle nearly any Python object (via dill) for distributed tasks
• you want hierarchical/nested parallelism across heterogeneous resources

When to avoid

• you need fine-grained control over MPI internals or node-level HPC scheduling
• you need GPU/accelerator parallelism (use CUDA or Dask instead)
• you want a full distributed data pipeline framework like Dask or Ray
• you need strict async/await concurrency rather than process-based parallelism

Facets

library · maturity active

concurrency serialization caching rpc microservices developer-tools python cross-platform cli parallel-computing parallel-map heterogeneous-computing ssh-launcher mpi multiprocessing dill automation

Member repositories

For agents

markdown · JSON · MCP: product_card(name="uqfoundation/pathos")