An open-source AI gateway that fronts many model providers behind one API, adding routing, load balancing, guardrails and governance for prompts sent from applications.
Source: Official GitHub repository. Last checked 2026-09-18. Spot an error? Tell us.
Nearby and similar
A domain-specific language for writing prompts as typed functions that compile to Python, TypeScript and other clients. Schemas are enforced with a parser that repairs imperfect model output.
A workspace where teams build and share custom assistants connected to company tools and documents, with prompt instructions managed per assistant.
A language model programming library that treats prompts as versioned Python functions. A local store records every prompt version and invocation so changes can be diffed and compared in a studio UI.
A templating language for steering language models token by token, interleaving generation with control flow, regex and grammar constraints. Output structure is enforced during decoding rather than checked afterwards.
One of the most widely used frameworks for LLM applications, providing prompt templates, chat message abstractions, tool calling and agent loops. It connects to the LangSmith platform for tracing and prompt management.
A platform for stateful agents, formerly MemGPT, where the agent manages its own context window through editable memory blocks. The prompt is assembled from persistent memory rather than rebuilt each turn.