run-house/kubetorch

Health v2 · maintenance only

Adoption not part of the score

1224 stars · 60 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Kubetorch is a Python library that lets you distribute and run ML workloads (training, inference, data processing) on Kubernetes directly from Python code, without local runtimes or code serialization. It provides a serverless-like interface with fast iteration, real-time log/error propagation, and built-in fault handling, deployed via a Helm chart.

Use cases

• run distributed ML training on kubernetes from python
• deploy model inference on a k8s cluster
• iterate on RL training jobs quickly with remote GPUs
• run python functions on remote cluster compute
• scale ML workloads with bin-packing and autoscaling
• replace ray cluster setup with simpler python API
• run ML evaluation jobs on kubernetes

When to choose

• you want a Pythonic API to run ML workloads on Kubernetes without writing YAML
• you need fast iteration loops for distributed training or RL
• you want built-in fault recovery and resource adjustment for ML jobs
• you already have a Kubernetes cluster and want serverless-like ML compute

When to avoid

• you don't use Kubernetes and just need local or single-machine training
• you need a fully managed platform without operating a cluster
• you only need simple batch scheduling without ML-specific features
• you require a very mature, battle-tested orchestrator like Ray or Kubeflow

Facets

library · maturity active

machine-learning llm-training llm-inference deployment container-orchestration serverless workflow-automation sdk machine-learning deep-learning artificial-intelligence data-science cloud-computing infrastructure-as-code microservices python cloud self-hosted distributed-training ml-infrastructure remote-execution gpu-computing helm-chart pytorch ray-alternative devops kubernetes docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="run-house/kubetorch")