towhee-io/towhee

Health v2 · maintenance only

Adoption not part of the score

3454 stars · 259 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Towhee is a Python framework for building ETL pipelines that process unstructured data (images, video, text, audio) into embeddings using state-of-the-art machine learning models. It offers a Pythonic API for prototyping pipelines with 700+ pre-trained models and integrates with vector databases like Milvus for production use.

Use cases

• generate embeddings from images for image retrieval
• encode text documents into vectors for semantic search
• build a RAG pipeline with local LLMs and knowledge retrieval
• extract features from video clips with deep learning models
• process unstructured data and load it into a vector database
• prototype ML pipelines in Python and optimize them for production
• run CLIP or BERT models to embed multimodal data

When to choose

• you need to embed unstructured data (images, video, text, audio) into vectors for search or retrieval
• you want pre-built pipelines with SOTA models instead of wiring up torch/transformers yourself
• you are building a vector search or RAG application with Milvus or similar vector databases
• you want a Pythonic API to prototype ML pipelines and optimize them for production

When to avoid

• you need a single specific model with full control over inference details rather than a pipeline framework
• you only do tabular or classical ML workloads with no unstructured data
• you need a framework with very active recent development and a large community
• your pipeline is simple enough that calling a model library directly is easier

Facets

framework · maturity maintenance

machine-learning etl rag llm-inference image-processing video-processing nlp audio-processing data-science machine-learning deep-learning artificial-intelligence computer-vision large-language-models python cross-platform embeddings unstructured-data vector-embeddings pipeline-orchestration feature-extraction milvus multimodal pretrained-models natural-language-processing data-engineering retrieval-augmented-generation docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="towhee-io/towhee")