Centralized governance with Model Catalog | Portkey

One place to govern every LLM your org uses

Use Portkey’s Model Catalog to manage access to 1,600+ models across your organization centrally. Define access policies, control usage, and give every team the right models, all from a single, unified control layer.

Book a demo

Get started for free

Powering 3000+ GenAI teams

Centralized governance for your organization

Move past fragmented setups and manage access and budgets for all teams from one unified control layer.

Scale without friction with org-level integrations

Connect to any AI provider once at the org level. These credentials are inherited by chosen teams and workspaces, eliminating repetitive setup and ensuring consistent, secure integration management across your stack.

Learn More

Control team access with precision

Model Catalog allows you to define which teams or workspaces can access integrations. Set granular budgets and enforce rate limits at the workspace level to ensure responsible usage and prevent overruns

Learn More

Provision models with full control

Choose which models from each integration are available to teams. Limit access to approved models and optionally auto-enable new ones as they’re released.

Learn more

Model Garden - A unified view of every model your teams can use

See all approved models across providers — along with supported modalities, max token limits, and ready-to-use code snippets. Empower your teams to choose the right model, faster.

Learn More

Enterprise-ready LLMOps platform

Highest standards for security & compliance

Portkey complies with stringent data privacy and security standards so that you can focus on innovation without worrying about data security.

Visit Trust Portal

Audited every quarter

100% secure on-prem deployment with full control

Deploy Portkey in your private cloud for enhanced security, control, and 100% data ownership.

Github 10400 Stars

The most popular open source AI Gateway

Portkey’s AI Gateway is actively maintained by 50+ contributors worldwide, bringing the cutting edge of AI work into the Gateway.

Portkey provides end-to-end support for Azure

Portkey plugs into your entire Azure ecosystem, so you can build and scale without leaving your existing infrastructure

Learn More

New Integration: Inference.net (wholesaler of LLM...

Kierra Westervelt • Oct 03, 2024

New Integration: DeepSeek AI on Gateway

Alfonso Workman • Oct 01, 2024

Enhance RAG Retrieval Success by 67% using...

Lincoln Geidt • Sep 30, 2024

OpenAI o1-preview and o1-mini on Portkey

Zain Aminoff • Sep 27, 2024

New Integration: Inference.net (wholesaler...

Omar Calzoni • Sep 23, 2024

Changelog

We’re open-source!

Join 50 other contributors in collaboratively developing Portkey’s open-source AI Gateway and push the frontier of production-ready AI.

Read the full changelog

Trusted by Fortune 500s & Startups

Portkey is easy to set up, and the ability for developers to integrate with LLMs is great. Overall, it has significantly sped up our development process.

Patrick L,

Founder and CPO, QA.tech

With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.

Prateek Jogani,

CTO, Qoala

Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching

AI Leader,

Fortune 500 Pharma Company

Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.

Kiran Prasad,

Senior ML Engineer, Ario

Well done on creating such an easy-to-use and navigate product. It’s much better than other tools we’ve tried, and we saw immediate value after signing up. Having all LLMs in one place and detailed logs has made a huge difference. The logs give us clear insights into latency and help us identify issues much faster. Whether it's model downtime or unexpected outputs, we can now pinpoint the problem and address it immediately. This level of visibility and efficiency has been a game-changer for our operations.

Oras Al-Kubaisi,

CTO, Figg

Used by GenAI teams across the world!