garak

by NVIDIA

The LLM vulnerability scanner: it hits your model with probes to find its weaknesses.

9,530 stars GitHub Apache-2.0 FreeOpen sourceLocal

View on GitHub →

What it does

Tests jailbreaks, prompt injection, data leakage, toxicity, hallucinations…
Works with local models and major APIs
Detailed reports to track your model's robustness

Install it

Requirements: Python 3.11 to 3.13

Install

python -m pip install -U garak

List available probes

garak --list_probes

The prompt for your agent

Paste it into your coding agent: it checks the requirements and installs it for you.

Claude CodeCodexCursorGemini CLIopencode

Prompt

Install garak (https://github.com/NVIDIA/garak) on my machine.
1. Check the requirements: Python 3.11 to 3.13. If anything is missing, tell me before installing anything.
2. Follow the official method:
- Install: python -m pip install -U garak
- List available probes: garak --list_probes
3. Check that it works, then explain how to launch it and where to start.

Always review what your agent is about to run, especially install commands.