TrueFoundry offers an enterprise AI gateway for LLMs, MCP servers and agents. The AI Gateway connects many models through one interface, with routing, fallbacks, rate limits, cost controls and observability. The MCP Gateway connects agents to tools and MCP servers with central authentication, access control and audit trails, and the Agent Gateway manages agent identity, access policies and tracing. TrueFoundry also provides an AI deployment platform, prompt management, a registry for agent skills, and tooling for training and fine-tuning. Single sign-on, role-based access control and audit logging are built in.
According to its website, TrueFoundry can run on-premises, in a VPC, in a hybrid setup, in air-gapped environments or on public cloud, and the company states that data and models stay within the customer's own cloud or on-premises infrastructure. The company is based in San Francisco (Ensemble Labs Inc). A European organisation can therefore run the platform in its own EU environment, while still depending on a US vendor for the software and support.