a16z-infra/llm-app-stack resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1319 stars · 152 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A curated reference list from a16z cataloging tools, projects, and vendors at each layer of the LLM application stack, from data pipelines and vector databases to LLM APIs and hosting platforms. It accompanies an article on emerging architectures for LLM applications and includes prompt templates for searching and formatting the tables.

Use cases

• find vector database options for my LLM app
• compare LLM API providers open source vs proprietary
• discover tools for each layer of the LLM app stack
• research the emerging architectures for LLM applications
• find data pipeline tools for preparing documents for LLMs
• look up logging and evaluation tools for LLM apps
• choose an app hosting platform for an AI application

When to choose

• you want a broad survey of the LLM tooling ecosystem before picking components
• you're researching or writing about LLM application architecture
• you need a starting point to discover vendors and open-source projects per stack layer

When to avoid

• you need runnable software rather than a list of links
• you need up-to-date, maintained recommendations since the list may lag the fast-moving ecosystem
• you need unbiased benchmarks rather than a catalog of options

Facets

learning-resource · maturity maintenance

developer-tools rag llm-inference vector-database etl monitoring large-language-models artificial-intelligence awesome-lists developer-tools databases cross-platform awesome-list llm-stack curated-list reference emerging-architectures data-engineering

Member repositories

For agents

markdown · JSON · MCP: product_card(name="a16z-infra/llm-app-stack")