promptslab/Promptify

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

4635 stars · 363 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Promptify is a Python library that turns LLMs into task-based NLP engines, providing high-level APIs for NER, classification, QA, and custom tasks with Pydantic-validated structured outputs. It uses LiteLLM as a universal backend so any prompt-based model (GPT-4, etc.) can be swapped in, and includes built-in evaluation metrics.

Use cases

• extract named entities from medical text with an LLM
• classify text sentiment into custom labels using GPT
• get structured JSON answers from a language model
• run question answering over documents with evidence and confidence
• define custom NLP tasks with Pydantic schemas
• evaluate LLM prompt outputs with metrics
• swap between OpenAI and other LLM providers without code changes

When to choose

• you want scikit-learn-style task APIs (NER, classify, QA) on top of LLMs
• you need validated, structured output rather than free-form text
• you want provider-agnostic LLM access via LiteLLM
• you need built-in evaluation for prompt-based NLP tasks

When to avoid

• you need raw low-level control over prompts and completions
• you want fine-tuning or training of models rather than inference
• you need non-Python environments
• you want a fully local NLP pipeline without LLM API calls

Facets

library · maturity active

nlp prompt-engineering llm-inference serialization large-language-models machine-learning artificial-intelligence python structured-output pydantic ner text-classification question-answering litellm openai natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="promptslab/Promptify")