mozilla-ai/any-llm

Health v2 · maintenance only

Adoption not part of the score

2171 stars · 216 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

any-llm is a Python library from Mozilla.ai that provides a single, unified interface for calling many LLM providers (OpenAI, Anthropic, Mistral, Ollama, Azure, and more) via one completion/embedding API. Switching providers requires only changing a provider parameter and API key, with unified exception handling, streaming, and tool calling support.

Use cases

• switch between openai and anthropic without changing code
• unified python api for multiple llm providers
• call local ollama models with the same code as openai
• migrate from litellm to a lighter sdk
• compare llm provider costs with one interface
• add streaming and tool calling across providers
• build a library that lets users pick their llm provider

When to choose

• you want a lightweight, provider-agnostic LLM client in Python
• you need to swap or benchmark multiple LLM providers with minimal code changes
• you want unified exception handling and streaming across providers
• you're migrating from LiteLLM and want compatible env vars and model strings

When to avoid

• you only ever call a single provider's official SDK
• you need features like provider-side routing, caching, or spend tracking that gateway platforms offer
• you're not using Python 3.11+

Facets

library · maturity active

llm-inference sdk http-client large-language-models artificial-intelligence developer-tools apis python cross-platform unified-api llm-providers openai-compatible provider-agnostic litellm-alternative streaming tool-calling embeddings

Member repositories

For agents

markdown · JSON · MCP: product_card(name="mozilla-ai/any-llm")