All prompt tools
Every tool in the directory. Filter by category or search by name.
Anthropic Courses
Anthropic's educational course repository covering API fundamentals, prompt engineering, evaluations and tool use. The repository is archived, with newer material published on Anthropic Academy.
AUTOMATIC1111 Stable Diffusion web UI
The long-standing browser interface for Stable Diffusion, offering prompt and negative prompt fields, attention weighting syntax, prompt matrices and X/Y/Z grids for comparing prompt variations.
Stanford HELM
A holistic evaluation framework from Stanford CRFM that scores models across many scenarios and metrics including accuracy, calibration, robustness and bias, and publishes public leaderboards.
BAML
A domain-specific language for writing prompts as typed functions that compile to Python, TypeScript and other clients. Schemas are enforced with a parser that repairs imperfect model output.
Evidently
An open-source framework for evaluating and monitoring AI systems, with more than a hundred built-in metrics plus LLM-as-judge evaluators and drift detection, rendered as interactive reports.
SmythOS Runtime Environment
An open-source runtime for agentic AI that separates agent definitions, skills and connectors, letting the same agent specification run across different model providers and storage backends.
AutoGen
A Microsoft Research framework for multi-agent applications where agents exchange messages to solve a task. Each agent is configured with its own system prompt, tools and termination rules.
LM Evaluation Harness
EleutherAI's harness for few-shot benchmarking of language models across hundreds of academic tasks. It standardises prompt formatting so results are comparable between models and backends.
Brex Prompt Engineering Guide
An internal Brex guide published openly, explaining how large language models behave and giving practical rules for writing prompts in production systems. It is no longer actively updated.
LMOps
A Microsoft Research collection of projects on making language models usable in production, including automatic prompt optimization, prompt compression and structured prompting techniques.
Optillm
An OpenAI-compatible inference proxy that applies reasoning techniques such as chain-of-thought variants, best-of-n sampling and self-consistency at request time to improve answer quality.
Continuous Eval
A modular evaluation library for LLM pipelines that combines deterministic metrics, semantic metrics and LLM-based judgement at each stage of a chain rather than only at the final answer.
Deepchecks
A validation library that began in tabular machine learning and now covers LLM applications, running suites of automated checks over data and model output and producing shareable reports.
AutoPrompt
A prompt tuning framework built around intent-based prompt calibration. It generates challenging edge-case examples, collects judgements on them and rewrites the prompt to close the gap.
Adaline Gateway
An open-source, locally running SDK that provides one interface for calling many model providers, with batching, retries and caching handled in the library rather than a hosted service.
AlpacaEval
An automatic evaluator for instruction-following models that uses an LLM judge to compare outputs against reference responses, with published leaderboards and length-controlled scoring.
Prompt Engineering Guide (DAIR.AI)
The repository behind promptingguide.ai, collecting explanations, papers, notebooks and worked examples for prompting techniques from zero-shot through to agent and context engineering.
UpTrain
An open-source platform for scoring generative AI responses on dimensions like factual accuracy, retrieval quality and tone, with root-cause analysis to show which pipeline step failed.
NeMo Guardrails
An NVIDIA toolkit for adding programmable rails to conversational applications. Rails are written in a dedicated modelling language and control topics, dialogue flow and unsafe output.
System Prompts and Models of AI Tools
A large archive of system prompts and tool definitions collected from commercial AI coding products and assistants, used as reference material for how production agents are instructed.
OpenAI Evals
OpenAI's framework and open registry for benchmarking models and prompt chains. Evals are declared as YAML plus data files, and the registry collects community-contributed benchmarks.
spacy-llm
An Explosion package that plugs language models into spaCy pipelines, shipping versioned prompt templates for tasks such as named entity recognition, classification and summarisation.
Priompt
A JSX-based prompt design library from the makers of Cursor. Prompt components are given priorities so the renderer can drop lower-priority sections when the context window is tight.
AIPRM
A browser extension and prompt library that adds a searchable catalogue of curated prompt templates directly into ChatGPT and other assistants, aimed at marketing and SEO workflows.
Anthropic Claude Cookbooks
Anthropic's official notebook collection showing working patterns for Claude, including prompt structures for classification, extraction, tool use, retrieval and long-context work.
LiteLLM
A gateway and Python SDK that exposes more than a hundred model APIs in the OpenAI request format, with budgets, fallbacks and logging so one prompt can be tested across providers.
Repo Prompt Community Edition
The community edition of Repo Prompt, a macOS context-engineering app that helps select files from a repository and assemble them into a prompt, with an MCP command-line interface.
UQLM
A Python package from CVS Health for uncertainty quantification in language models, providing hallucination detection scorers based on response consistency and token probabilities.
AICI
A Microsoft research project that runs prompt controllers as WebAssembly modules inside the inference loop, letting custom logic constrain and steer token generation in real time.
Fooocus
A simplified image generation interface that hides most settings and applies automatic prompt expansion, so a short prompt is rewritten into a more detailed one before generation.
Langtail
A prompt management platform aimed at product teams, combining a playground for iterating on prompts with test suites that run those prompts against saved cases before deployment.
Prompt Optimizer
A browser, desktop and extension tool that rewrites a rough prompt into a more structured one, keeping history locally and letting you compare the original and optimized versions.
Trace
A Microsoft Research framework for end-to-end optimization of AI workflows, propagating execution feedback back through a computation graph to update prompts, code and parameters.
Agno
A Python framework and runtime for building agents with instructions, tools, memory and knowledge, then serving them behind an API. It emphasises low overhead per agent instance.
ComfyUI
A node-based interface for diffusion models where prompt encoding, conditioning and sampling are separate graph nodes, making complex prompt pipelines reproducible and shareable.
Opik
Comet's open-source platform for tracing, evaluating and monitoring LLM applications, including a prompt library with versioning and an agent optimizer for improving prompt text.