talon

What it does

Talon is an open-source AI governance gateway designed to help EU-based teams enforce compliance policies across Large Language Models and AI agents. It acts as a proxy layer that intercepts and monitors LLM interactions, enforcing organizational policies related to data protection, cost management, and regulatory compliance.

Key features

• PII (Personally Identifiable Information) detection and masking
• Cost governance and token-level budget controls
• Model access policies and restrictions
• Data residency enforcement for GDPR compliance
• EU AI Act alignment and compliance tracking
• Signed evidence and audit trails for compliance documentation
• Policy-as-Code framework for flexible rule definition
• OpenAI proxy and LLM gateway capabilities
• MCP (Model Context Protocol) integration support
• Integration with OPA (Open Policy Agent)

How to set up

Talon is available as open-source software on GitHub. Installation typically involves cloning the repository, configuring your governance policies using the Policy-as-Code framework, setting up environment variables for your LLM providers, and deploying the gateway as a proxy between your applications and LLM APIs. Documentation and setup guides are available in the GitHub repository.