hail-is/hail

Health v2 · maintenance only

Adoption not part of the score

1070 stars · 266 forks observed · 2026-09-03

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Hail is an open-source Python library for scalable exploration and analysis of genomic data, built on Spark, Scala, and C++ primitives for distributed queries and linear algebra. It provides the MatrixTable data structure for multi-dimensional genomic data and Hail Batch for massively parallel pipeline execution in the cloud.

Use cases

• run a genome-wide association study (GWAS) on biobank-scale data
• parse and query VCF, BGEN, PLINK, and other genomic file formats at scale
• perform PCA and linear regression across millions of variants
• build massively parallel computational pipelines with dependency management
• analyze petabyte-scale datasets in the cloud or small datasets on a laptop
• compute variant QC statistics like call rates and allele frequencies
• visualize GWAS results with Manhattan and QQ plots

When to choose

• you need to analyze large-scale genomic or multi-dimensional structured data beyond what Pandas or NumPy can handle
• you are running GWAS or population genetics analyses on biobank-scale datasets
• you want a unified Python API for distributed genomic queries and batch job orchestration
• you need to process VCF/BGEN/PLINK files with scalable, cloud-native tooling

When to avoid

• you only need simple dataframe operations on small tabular data - use Pandas or Polars instead
• your project requires a stable, long-term-support API - Hail uses continuous deployment with frequent changes
• you cannot install Java 11 or lack access to Spark clusters or cloud resources for large workloads
• your analysis is unrelated to genomics and does not involve matrix-like structured data

Facets

library · maturity active

data-science machine-learning etl workflow-automation streaming bioinformatics data-science big-data python cloud genomics gwas vcf spark distributed-computing matrixtable batch-computing cloud-native genetics linux macos docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="hail-is/hail")