# pykeio/ort

Fast ML inference & training for ONNX models in Rust

Repository: https://github.com/pykeio/ort
Canonical: https://ross.abutalabs.com/products/ort
Homepage: https://ort.pyke.io/
Language: Rust
License: Apache-2.0
License Family: permissive
Topics: ai, inference, machine-learning, onnxruntime, rust, onnx, ai-training, fine-tuning
Last push: 2026-08-23T20:46:26+00:00

## Health v2 (maintenance only)
Score: 89/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 99, release rhythm 71, longevity 98
- inputs: {"age_days": 1376, "days_push": 10, "days_rel": 36, "gap_med": 100.5, "n_releases_24m": 7}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2476, forks 263 (observed 2026-08-28T04:06:54.988884+00:00)

## What it is
ort is a safe, fast Rust binding for Microsoft's ONNX Runtime, providing hardware-accelerated machine learning inference and training for ONNX models. It supports many execution providers (CUDA, TensorRT, OpenVINO, CoreML, etc.) and alternative pure-Rust backends, and is production-ready.

## Use cases
- run ONNX models in Rust with GPU acceleration
- deploy PyTorch or TensorFlow models in production from Rust
- fast on-device ML inference in a Rust application
- fine-tune or train ONNX models in Rust
- run transformer models like BERT or YOLOv8 efficiently
- compile ML inference to WebAssembly

## When to choose
- you need high-performance ML inference in a Rust codebase
- you want hardware-accelerator support across NVIDIA, Intel, Qualcomm, and Apple
- you need to deploy models on-device or on servers with low latency
- you want a maintained, production-ready alternative to onnxruntime-rs

## When to avoid
- your project is in Python and PyTorch directly is sufficient
- you need a pure-Rust ML stack with no C++ dependency (though alternative backends exist)
- you require the stable 1.x API rather than the 2.0 release-candidate

## Facets
- artifact type: library
- maturity: active
- function: machine-learning, llm-inference, gpu-computing, sdk
- domain: machine-learning, deep-learning, large-language-models, developer-tools
- platform: rust, cross-platform, wasm
- tags: onnx, onnxruntime, inference, training, rust-binding, hardware-acceleration, execution-providers, gpu

## Member repositories
- pykeio/ort (main) score 89

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:06:54.988884+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T02:28:22.170733+00:00, confidence not recorded.
  - readme: https://github.com/pykeio/ort (fetched 2026-08-28T04:06:54.988884+00:00, sha 7ca09dbbb221)
  - homepage: https://ort.pyke.io/ (fetched 2026-08-29T10:10:22.653775+00:00, sha 5013e2464317)
  - site_page: https://ort.pyke.io/setup/cargo-features (fetched 2026-08-29T10:10:22.656475+00:00, sha 74df53476d30)
  - registry_crates: https://crates.io/api/v1/crates/ort (fetched 2026-08-29T10:10:22.658320+00:00, sha e78a3d9fe139)
- Data as of 2026-08-30T08:39:29.467469+00:00.