microsoft/PyRIT

Health v2 · maintenance only

Adoption not part of the score

4361 stars · 848 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

PyRIT is Microsoft's open-source Python framework for identifying security and safety risks in generative AI systems. It provides automation for red-teaming LLM endpoints, including attack strategies, scoring of responses, and datasets of harmful prompts.

Use cases

• red team an LLM application for jailbreak vulnerabilities
• automate security testing of generative AI endpoints
• test whether a chatbot can be tricked into producing harmful content
• evaluate AI system safety before deployment
• scan LLM-powered apps for prompt injection risks
• benchmark model robustness against adversarial prompts

When to choose

• you are a security professional or ML engineer red-teaming generative AI systems
• you need a scriptable, extensible Python framework for automated LLM attack campaigns
• you want Microsoft-backed tooling with active development and community support

When to avoid

• you need general application security testing unrelated to generative AI
• you want a no-code GUI scanner rather than a Python framework
• you lack access to an LLM endpoint or model to test against

Facets

framework · maturity active

security penetration-testing vulnerability-scanning llm-inference agent-framework machine-learning security artificial-intelligence large-language-models penetration-testing developer-tools python cross-platform ai-red-team red-teaming generative-ai responsible-ai llm-safety prompt-injection jailbreak-testing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/PyRIT")