# Run GenAI at scale, fully inside Azure Portkey plugs into your Azure AI stack - deploy via Marketplace, connect Entra SSO/SCIM, apply Content Safety guardrails, and run Azure OpenAI or AI Foundry models seamlessly. ## Build a secure and scalable Gen AI platform on Azure Portkey gives Azure AI teams the control, visibility, and infrastructure they need to ship GenAI applications faster. ###### Know what’s driving your AI bill Break down LLM usage by app, team, or user and see exactly which use cases drive value, and which need optimization or retirement. [Learn More](/content/docs/guides/use-cases/track-costs-using-metadata#tracking-llm-costs-per-user-with-portkey/index.html) ###### Track everything, down to each prompt Monitor latency, token usage, and model performance. Trace every agent action and tool call to debug and optimize complex autonomous workflows. [Learn More](/content/docs/product/observability/traces/index.html) ###### Mirror your internal org structure Integrate with Microsoft Entra to sync org-wide user access, set budgets and rate limits, so teams can build freely without overrunning costs. [Learn More](/content/docs/product/enterprise-offering/org-management/scim/azure-ad#azure-entra/index.html) ###### Built-in governance from day one Stay audit-ready with org-wide audit logs, usage history and feedback data for every call. [Learn More](/content/docs/product/enterprise-offering/audit-logs#audit-logs/index.html) ## Enterprise-ready LLMOps platform ###### Highest standards for security & compliance Portkey complies with stringent data privacy and security standards so that you can focus on innovation without worrying about data security. [Visit Trust Portal](https://trust.portkey.ai/) ###### Audited every quarter ###### 100% secure on-prem deployment with full control Deploy Portkey in your private cloud for enhanced security, control, and 100% data ownership. ## Trusted by Fortune 500s & Startups Portkey is easy to set up, and the ability for developers to integrate with LLMs is great. Overall, it has significantly sped up our development process. Patrick L, Founder and CPO, QA.tech With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations. Prateek Jogani, CTO, Qoala Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching. AI Leader, Fortune 500 Pharma Company ### Latest guides and resources ###### How to scale GenAI apps built on Azure AI services Discover how to scale genAI applications built on Microsoft Azure. [Learn More](/content/blog/scale-genai-apps-on-azure-ai-services/index.html) ###### Discover how you can build your Gen AI platform on Azure... Portkey supercharges your Azure AI infrastructure with an enterprise-ready [Learn More](/content/docs/integrations/cloud/azure/index.html) ###### Build resilient Azure AI applications with an AI Gateway Learn how to make your Azure AI applications production-ready by adding [Learn More](/content/blog/resilient-azure-ai-apps-with-ai-gateway/index.html) ### Build AI apps without leaving your infrastructure Portkey is a comprehensive platform designed to streamline and enhance AI integration for developers and organizations. **Portkey, Inc** 2261 Market Street #5205, San Francisco, CA --- ### New Integration Updates **New Integration: Inference.net (wholesaler of LLM...)**\ Kierra Westervelt • Oct 03, 2024 **New Integration: DeepSeek AI on Gateway**\ Alfonso Workman • Oct 01, 2024 --- --- Changelog #### We’re open-source! Join 50 other contributors in collaboratively developing Portkey’s open-source AI Gateway and push the frontier of production-ready AI. [Read the full changelog](/content/docs/changelog/index.html)