scipipe/scipipe

Health v2 · maintenance only

Adoption not part of the score

1109 stars · 74 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

SciPipe is a Go library for writing scientific workflows (pipelines) based on Flow-Based Programming, wrapping command-line tools and Go code into networks of channels and processes. Workflows compile to fast, self-contained binaries with task parallelism, streaming, restartability, and audit/provenance reports.

Use cases

• build bioinformatics pipelines in Go
• chain command-line tools into reproducible workflows
• run many dependent programs in parallel on multiple cores
• stream data between pipeline steps to save disk space
• resume an interrupted workflow run without overwriting outputs
• generate audit reports for scientific workflow provenance
• build cheminformatics data processing pipelines

When to choose

• you want workflows as compiled, portable Go binaries
• you need to wrap arbitrary command-line tools in a pipeline
• you need task and pipeline parallelism with streaming support
• you want provenance/audit reports and restartable runs
• you prefer writing pipelines in Go code rather than YAML

When to avoid

• you need a large ecosystem of prebuilt workflow steps or community recipes
• you prefer declarative YAML/DSL workflow definitions like Snakemake or Nextflow
• you need container scheduling or cluster orchestration built in
• your team does not work in Go

Facets

library · maturity maintenance

workflow-automation cli concurrency developer-tools bioinformatics developer-tools go cross-platform cli scientific-workflows flow-based-programming bioinformatics-pipeline cheminformatics dataflow provenance reproducibility pipeline-parallelism data-engineering automation command-line linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="scipipe/scipipe")