cortexlabs/cortex resource

Health v2 · maintenance only

Adoption not part of the score

8011 stars · 594 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Cortex is an open-source platform for deploying, managing, and scaling machine learning models in production on AWS, built on top of EKS. It supports realtime, async, and batch inference workloads with autoscaling, spot instances, and observability integrations.

Use cases

• deploy machine learning models to production on aws
• serve ml models with autoscaling on gpu instances
• run batch inference jobs at scale
• host realtime model inference endpoints
• reduce inference costs with spot instances
• set up mlops infrastructure with terraform

When to choose

• you deploy models on AWS and want managed autoscaling inference
• you need realtime, async, and batch serving from one platform
• you want spot-instance cost savings with on-demand fallback

When to avoid

• you need actively maintained software - the project is no longer maintained by its original authors
• you deploy outside AWS - Cortex is built specifically for AWS/EKS
• you want a fully managed service rather than self-managed clusters

Facets

infra-config · maturity abandoned

deployment container-orchestration infrastructure-as-code monitoring machine-learning llm-inference machine-learning cloud-computing infrastructure-as-code microservices cloud go self-hosted model-serving mlops autoscaling aws-eks serverless-inference gpu-inference terraform-provider devops kubernetes docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="cortexlabs/cortex")