callstackincubator/ai

Health v2 · maintenance only

Adoption not part of the score

1387 stars · 58 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A collection of on-device AI primitives for React Native offering Vercel AI SDK-compatible APIs for running LLMs, embeddings, transcription, and speech synthesis directly on mobile devices. It supports Apple Foundation Models, Google Gemini Nano via ADK, GGUF models via llama.rn, and MLC LLM runtimes on iOS and Android.

Use cases

• run llm inference offline in a react native app
• add privacy-preserving on-device chat to a mobile app
• use apple foundation models from react native
• run gguf models locally on android and ios
• generate embeddings on-device for semantic search
• add speech-to-text and text-to-speech to a mobile app
• replace cloud llm api calls with local inference to cut costs

When to choose

• you need offline-capable, low-latency AI features in a React Native app
• user data privacy requires that inference never leaves the device
• you want Vercel AI SDK APIs like streamText and generateText backed by local models
• you want to avoid server and API costs for AI features

When to avoid

• you need frontier-scale model quality that only large cloud models provide
• your app is not React Native or targets web/desktop only
• you need broad model choice without managing GGUF or MLC model downloads
• you require features like large-context reasoning beyond on-device model limits

Facets

library · maturity active

llm-inference sdk speech-recognition tts rag agent-framework large-language-models mobile-development artificial-intelligence cross-platform on-device-ai react-native vercel-ai-sdk apple-foundation-models gemini-nano gguf mlc-llm privacy-preserving edge-ai devtools-profiler ios android mobile typescript

Member repositories

For agents

markdown · JSON · MCP: product_card(name="callstackincubator/ai")