Skip to content

Deploy production-ready AI agents in one click! Citadel delivers unified governance, end-to-end observability & rapid development for secure, compliant AI at scale. Built on Azure best practicesโ€”turn security blockers into strengths with managed guardrails, cost control & a shared AI registry. ๐Ÿ›ก๏ธ๐Ÿ“Š

License

Notifications You must be signed in to change notification settings

Azure-Samples/foundry-citadel-platform

๐Ÿฐ Foundry Citadel Platform

A Unified, Layered Approach to AI Security and Compliance

Microsoft IDC Leader License

Foundry Citadel Platform represents Microsoft's comprehensive, layered architecture for AI governance, designed to enable enterprises to scale AI innovation while maintaining trust, security, and compliance. This document provides an in-depth analysis of the technical approach, strategic value proposition, and competitive landscape for Microsoft's layered AI governance solution.

Note

The purpose of Foundry Citadel Platform is to provide opinionated, pre-built patterns for AI governance that leverage Microsoft's unique capabilities and ecosystem. It is not intended to be a one-size-fits-all solution, but rather a proven architectural approach that can be adapted and extended based on specific organizational needs and risk profiles.


๐Ÿ“‘ Table of Contents

๐Ÿ“‹ Executive Summary

โš ๏ธ The AI Governance Crisis

The enterprise AI landscape in 2026 stands at a critical inflection point. With 20% of all data breaches now directly attributed to unmanaged Shadow AI usage, and 95% of unmanaged GenAI pilots failing to reach production due to lack of governance, organizations face an unprecedented challenge: how to scale AI innovation while maintaining trust, security, and compliance.

๐Ÿ† Microsoft's Strategic Position

In January 2026, Microsoft was named a Leader in the IDC MarketScape for Worldwide Unified AI Governance Platforms 2025โ€“2026, recognized for its end-to-end governance spanning traditional machine learning, generative AI, and agentic AI systems. This recognition validates Microsoft's comprehensive approach to AI governance as both a technical and strategic imperative.

The market trajectory underscores the urgency: Gartner projects that spending on AI data governance will reach $492 million in 2026 and surpass $1 billion by 2030, with fragmented AI regulation extending to 75% of the world's economies by 2030. Organizations deploying AI governance platforms are 3.4 times more likely to achieve high effectiveness in AI governance than those that do not.

๐Ÿ›๏ธ Architectural Philosophy: Separation of Concerns with Unified Oversight

The four layers are not isolated silosโ€”they form an integrated architecture grounded in the principle of separation of concerns with unified oversight. Each layer owns a distinct governance responsibility, yet all layers interlock to deliver end-to-end trust:

  • ๐Ÿ”ท Layer 1 โ€“ Governance Hub acts as the physical gateway: a hub-and-spoke deployment where a centrally managed AI gateway (Azure API Management) enforces runtime policiesโ€”identity validation, token rate limiting, content filtering, and cost attributionโ€”while spoke environments give each business unit autonomous development within guardrails.

  • ๐Ÿ”ถ Layer 2 โ€“ AI Control Plane sits above the gateway to provide the observability and compliance brain. Microsoft Foundry Control Plane continuously evaluates agent behavior, captures end-to-end traces, runs automated red-teaming, and powers fleet operations dashboardsโ€”turning raw telemetry from every spoke into actionable governance insights.

  • ๐ŸŸข Layer 3 โ€“ Agent Identity (Agent 365) ensures that every agent, whether built in-house or discovered as shadow AI, is a first-class enterprise citizen. Unique identities issued through Microsoft Entra ID, combined with sponsorship models, lifecycle controls, and access packages, mean that no agent operates anonymously at scale.

  • ๐Ÿ›ก๏ธ Layer 4 โ€“ Security Fabric weaves real-time protection across the other three layers. Microsoft Defender provides AI-specific threat intelligence and jailbreak detection, Microsoft Purview enforces data governance and PII protection, and Microsoft Entra orchestrates identity-driven access controlโ€”together closing the loop from policy definition to runtime defense.

This layered separation means teams can evolve any single capabilityโ€”upgrade the gateway, add new compliance evaluators, onboard new agent types, or adopt emerging security detectionsโ€”without destabilizing the rest of the governance stack. The result is an architecture that scales from 10 to 10,000 agents while keeping governance both comprehensive and composable.

๐ŸŽฏ Strategic Value Proposition

This layered approach enables enterprises to:

  • ๐Ÿ“ˆ Scale from 10 to 10,000 agents with consistent governance and security.
  • โšก Reduce compliance bottlenecks through automated policy enforcement at runtime.
  • ๐Ÿš€ Achieve faster time-to-value with pre-built, proven patterns.
  • ๐Ÿ’ฐ Lower regulatory expenses by 20% through effective governance technologies.
  • ๐Ÿ”„ Maintain continuous compliance as AI systems and regulations evolve.

โš™๏ธ Unified Technical Approach to Microsoft's Layered AI Governance

๐Ÿ”€ The Governance-Velocity Paradox

The fundamental challenge facing enterprises is what Microsoft terms the โ€œGovernance-Velocity Paradox.โ€ Compliance traditionally slows innovation, yet AI's transformative potential means enterprises cannot afford to choose between speed and safety. As AI agents move from chat to act and from few to thousands, the stakes escalate exponentially.

Traditional governance approaches create critical bottlenecks:

  • โŒ Manual Risk Assessments: Time-consuming and lacking standardization
  • โŒ Scattered Evaluation Tools: Fragmented across different teams and systems
  • โŒ Unclear Governance Requirements: Ambiguous policies difficult to operationalize
  • โŒ Implementation Gaps: Policies rarely map cleanly to real-world technical implementation

The result: delays that frustrate both governance teams and developers, slowing AI adoption and increasing organizational risk.

๐Ÿค The Collaboration Challenge

As AI systems grow from few agents to many, the need for collaboration between different agents, tools, and data becomes key to reusing investments in quality agents. This collaboration typically spans cross-business units and domains to achieve better return on investment and accelerate adoption.

Effective AI governance demands multiple stakeholders collaborating effectively:

  • ๐Ÿ‘” Compliance Officers & Chief AI Officers: Must determine what needs to be assessed to comply with company policies and regulations
  • โ˜๏ธ Cloud Ops Teams: Need to understand how to implement controls and monitor compliance at runtime & establish landing zones for AI workloads
  • ๐Ÿ‘จโ€๐Ÿ’ป AI Developers & Engineering Teams: Need to operationalize these requirements by generating the right qualitative and quantitative evidence

๐Ÿ’จ From Bottlenecks to Acceleration

The transformation from traditional to Microsoft's approach:

Traditional Approach Foundry Citadel Platform
โŒ Manual risk assessments โœ… Automated compliance checks
โŒ Scattered tools โœ… Unified observability platform
โŒ Unclear requirements โœ… Codified governance contracts
โŒ Implementation gaps โœ… Pre-built, proven patterns
โŒ Friction between teams โœ… Streamlined collaboration
โŒ Slow deployment cycles โœ… Rapid, repeatable deployments

This transformation enables organizations to move from AI experiments to AI at scale, with compliance automated, observability centralized, and policies as code.


๐Ÿ› ๏ธ Detailed Technical Approach: Layer-by-Layer Analysis

๐Ÿ”ท Layer 1: Governance Hub โ€“ Runtime Enforcement Plane

๐Ÿ“Œ Overview and Purpose

The Governance Hub serves as the runtime enforcement layer that mediates AI traffic between agents and LLMs, tools, and other agents. It addresses the critical reality that in an AI system, three primary assets must be governed:

  • ๐Ÿง  LLMs: Provide the brain for AI agents
  • ๐Ÿงฐ Tools and Knowledge: Allow agents to be grounded with the ability to act
  • ๐Ÿค– External Agents: Enable collaboration as AI systems grow

Without runtime governance, organizations face:

  • ๐Ÿ’ธ Unpredictable costs
  • โš ๏ธ Reliability issues
  • ๐Ÿ”“ Security threats
  • ๐Ÿ˜ค Developer friction
  • ๐Ÿ˜ฑ Governance nightmares

๐Ÿงฑ Core Components

  • ๐ŸŒ Unified AI Gateway (Azure API Management): Single control point for models, tools, and agents
  • ๐Ÿ“– Universal Registry (Azure API Center): Centralized catalog for discovery
  • ๐Ÿ›ก๏ธ Enforcement Capabilities:
    • ๐Ÿ”‘ Identity validation
    • โš™๏ธ Smart operations (token rate limiting, semantic caching, cost attribution)
    • ๐Ÿšจ Safety (content filtering, prompt injection protection, PII detection)

๐Ÿ›๏ธ Architectural Philosophy: Separation of Concerns with Unified Oversight

Microsoft's architectural philosophy addresses the governance-velocity paradox through a hub-and-spoke deployment model that provides:

๐Ÿ”น Central Governance Hub โ€“ Deployed centrally to serve as the runtime command center
  • Unified AI gateway for all model, tool, and agent access
  • Universal AI registry for centralized catalog and discovery
  • Centralized logging, monitoring, and policy enforcement systems
  • Shared infrastructure that every project leverages
๐Ÿ”น Agent Environment Spokes โ€“ Deployed multiple times, one for each business unit or use case
  • Fully self-contained and secure with dedicated compute, storage, data, and dependent services
  • Teams can work autonomously without stepping on each other's toes
  • Each spoke connects back to the hub for centralized governance and observability

This architecture delivers โ€œlocal freedomโ€ in each project area under a common governance framework enforced by the hub.

๐Ÿ“ก Hub-and-Spoke Deployment Model

The deployment model consists of two primary components:

๐Ÿ”ธ AI Governance Hub (Central Deployment)
  • One deployment governing both production and non-production environments
  • Or two deployments (one for production, one for non-production) with ability to add more per requirements
  • Enforces runtime policies-as-code for all AI interactions across the organization
  • Platform-level observability & audit-trail: Centralized performance metrics, usage tracking, with optional request/response logging for audit and debugging
  • ๐Ÿ“Ž Guidance available at: https://aka.ms/ai-hub-gateway
๐Ÿ”ธ Agents Environment (Spoke Deployment)
  • Deployed at spokes with many deployments across the organization
  • One deployment per business unit or use case
  • Accelerates development through templated deployment that is configurable
  • ๐Ÿ“Ž Guidance available at: https://github.com/Azure/AI-Landing-Zones

๐Ÿ”— Integration with Microsoft AI Governance Stack

Layer Integration
๐Ÿ”ถ Layer 2 (AI Control Plane) Foundry Control Plane relies on the runtime AI Gateway for policy enforcement and collects telemetry for observability and compliance
๐ŸŸข Layer 3 (Agent Identity) Agent 365 identities are validated at the gateway for access control and policy enforcement
๐Ÿ›ก๏ธ Layer 4 (Security Fabric) Defender for API security as added layer of security and threat intelligence

๐Ÿ”ถ Layer 2: AI Control Plane โ€“ Observability and Compliance

๐Ÿ“Œ Overview and Strategic Importance

Powered by Microsoft Foundry Control Plane, this layer automates trust and provides visibility, governance, and control for AI agents, models, and tools across the enterprise.

๐Ÿงฑ Core Functionalities

  • ๐Ÿ“‹ Controls: Define and enforce AI evaluations and compliance policies
  • ๐Ÿ”ญ Observability:
    • Agent-level: Execution traces, performance monitoring, debugging tools
    • AI Evaluations: during development and in production
  • ๐Ÿ” Security:
    • Zero trust architecture
    • Integration with Microsoft security fabric and Agent 365 identity platform
    • AI Red Teaming
    • Drift monitoring
  • ๐Ÿš€ Fleet Operations:
    • Track 100% of registered agents
    • Manage activation and lifecycle
    • Visualize fleet health and anomalies

๐Ÿค Integration with Partner Ecosystem

Partner Capabilities
Credo AI Policy-to-code translation, governance-ready artifacts, real-time evaluator feedback
Saidot EU AI Act-focused risk evaluations, dataset simulation, and compliance mapping

๐Ÿ”— Integration with Microsoft AI Governance Stack

Layer Integration
๐Ÿ”ท Layer 1 (Governance Hub) Relies on runtime telemetry from the AI Gateway for observability and compliance monitoring
๐ŸŸข Layer 3 (Agent Identity) Uses identity information from Agent 365 for access control and compliance enforcement
๐Ÿ›ก๏ธ Layer 4 (Security Fabric) Integrates with Defender for threat intelligence and Purview for data governance insights

๐ŸŸข Layer 3: Agent Identity โ€“ Agent 365

๐Ÿ“Œ Overview and Strategic Significance

Transforms agents into enterprise assets with unique identities, lifecycle management, and access controls. Addresses shadow AI and enables scale with trust.

๐Ÿงฑ Core Capabilities

  • ๐Ÿ†” Agent Identity Platform (Microsoft Entra ID):
    • Unique agent identities
    • Shadow agent detection
    • Lifecycle and ownership management
    • Sponsorship model for human accountability
  • ๐Ÿ” Access Management:
    • Access packages
    • Role-based and attribute-based access control
    • Expiration and review workflows

๐Ÿ”— Integration with Microsoft AI Governance Stack

Layer Integration
๐Ÿ”ท Layer 1 (Governance Hub) Relies on runtime identity enforcement from the AI Gateway
๐Ÿ”ถ Layer 2 (AI Control Plane) Ability to register Foundry Agent identities with Agent 365 for unified identity management and compliance enforcement
๐Ÿ›ก๏ธ Layer 4 (Security Fabric) Integrates with Microsoft Entra for identity governance and with Defender for threat detection and Purview signals based on agent behavior

๐Ÿ›ก๏ธ Layer 4: Security Fabric โ€“ Unified Protection Across All Layers

๐Ÿ“Œ Overview

Provides real-time defense against AI-specific threats and integrates across all governance layers.

๐Ÿงฑ Core Components

๐Ÿ›ก๏ธ Microsoft Defender
  • Threat intelligence for AI & API attack vectors
  • AI-specific posture management
  • Real-time jailbreak detection
  • Prompt injection protection
๐Ÿ“š Microsoft Purview
  • Data governance and labeling
  • PII detection and protection
  • Compliance automation for 100+ frameworks
๐Ÿ” Microsoft Entra
  • Agent and application identity platform
  • Access control and lifecycle automation
  • Shadow agent discovery

๐ŸŒ Unified Security Architecture

  • ๐Ÿ”„ Coordinated threat response across Defender, Entra, and Purview
  • ๐Ÿ‘๏ธ End-to-end visibility and audit trails
  • โšก Real-time protection and compliance by design

๐Ÿ”— Integration with Microsoft AI Governance Stack

Layer Integration
๐Ÿ”ท Layer 1 (Governance Hub) Defender provides runtime protection for the AI Gateway, while Purview enforces data governance policies at the gateway level
๐Ÿ”ถ Layer 2 (AI Control Plane) Defender and Purview provide security insights and compliance monitoring for agent behavior, while Entra ensures identity governance
๐ŸŸข Layer 3 (Agent Identity) Entra provides identity governance for agents, while Defender monitors for identity-based threats and Purview enforces data governance policies based on agent access and behavior

Tip

Microsoft Defender can surface security signals in Foundry Control Plane and Agent 365 allowing different teams to collaborate on threat detection and response.


๐ŸŒŸ Conclusion: The Strategic Value of Microsoft's Layered Approach

๐Ÿ”„ Transforming AI Governance from Constraint to Enabler

Microsoft's layered approach to AI security and governance represents a fundamental reimagining of how enterprises can scale AI innovation while maintaining trust, security, and compliance. By architecting governance as a unified, multi-layer system rather than a collection of disparate tools, Microsoft addresses the core challenge facing enterprises in 2026: the governance-velocity paradox.

๐Ÿ… Key Strategic Advantages

  1. ๐Ÿงฉ Comprehensive Coverage Without Complexity
    The four-layer architecture provides complete governance coverage while maintaining clear separation of concerns:

    • Runtime enforcement (Layer 1) ensures every AI interaction is governed
    • Observability and compliance (Layer 2) provide visibility and automated policy enforcement and ensure agents are executing as intended and compliant with regulations
    • Agent identity (Layer 3) transforms agents into managed enterprise assets
    • Security fabric (Layer 4) integrates protection across all layers

    This architecture enables organizations to implement sophisticated governance without overwhelming operational teams.

  2. ๐Ÿš€ Scale with Confidence
    The layered approach is purpose-built for scale, enabling organizations to grow from 10 agents to 10,000 with consistent governance:

    • Hub-and-spoke deployment allows local autonomy with central oversight
    • Automated compliance eliminates manual bottlenecks
    • Fleet operations provide visibility across entire agent ecosystem
    • Reusable patterns accelerate deployment of new agents
  3. ๐Ÿ—๏ธ Built on Microsoftโ€™s AI Experience
    Microsoftโ€™s governance capabilities are informed by internal experience building, securing, and governing AI systems. Customers benefit from:

    • Responsible AI Standards embedded in engineering processes
    • Office of Responsible AI ensuring ethical AI development
    • Transparency notes, fairness analysis, and explainability tools
    • Proven patterns validated through Microsoftโ€™s own AI deployments
  4. ๐Ÿ† Industry Recognition and Market Leadership
    The IDC MarketScape Leader designation validates Microsoftโ€™s approach as best-in-class for unified AI governance. Key differentiators identified by IDC include:

    • End-to-end governance spanning traditional ML, generative AI, and agentic AI
    • Native integration across Foundry, Agent 365, Purview, Entra, and Defender
    • Comprehensive approach removing disparate and disconnected tooling
    • Operational maturity pairing technical controls with mature governance processes

๐Ÿงฑ The Trust Foundation for AI Transformation

Ultimately, Microsoft's layered approach provides the trust foundation necessary for AI transformation at enterprise scale. As the presentation emphasizes:

"๐Ÿ’ก Those that can trust will scale. Those that scale AI effectively will win."

The layered architecture enables this virtuous cycle:

  • โœ… Governance enables trust through comprehensive controls and visibility
  • โœ… Trust enables scale by removing barriers to AI adoption
  • โœ… Scale delivers competitive advantage through AI-driven innovation

๐Ÿ”ฎ Future-Proofing AI Governance

The layered approach is designed for adaptability as AI technology and regulations evolve:

  • ๐Ÿ”Œ Protocol-agnostic: Supports REST, MCP, A2A, and emerging protocols
  • โ˜๏ธ Multi-cloud capable: Consistent governance across hybrid and cloud environments
  • ๐Ÿงฉ Extensible: Partner integrations (Credo AI, Saidot) enhance capabilities
  • ๐Ÿ“œ Regulatory alignment: With many layered controls in place, mapping regulatory requirements to technical controls becomes more straightforward, enabling faster compliance with new regulations as they arise.

๐Ÿ“Š Measurable Business Impact

Organizations implementing Microsoft's layered governance approach can expect:

Metric Impact
๐Ÿ’ฐ Regulatory expenses 20% reduction through effective governance technologies
๐Ÿš€ GenAI pilot success 95% improvement vs. ungoverned approaches
๐Ÿ›ก๏ธ Data breach risk from shadow AI 80% reduction
๐Ÿ† AI governance effectiveness 3.4x higher
โšก Time-to-value Faster with pre-built patterns and automation

๐Ÿš€ Call to Action for Enterprises

To capitalize on Microsoft's layered approach, enterprises should:

Step Action Description
1 ๐Ÿ” Assess current state Evaluate existing AI governance gaps and risks
2 ๐Ÿ—“๏ธ Plan deployment Design hub-and-spoke architecture aligned with organizational structure
3 ๐Ÿ› ๏ธ Implement in phases Deploy governance hub, enable observability, activate agent identity
4 ๐Ÿ›ก๏ธ Integrate security fabric Connect Defender, Purview, and Entra
5 ๐ŸŽ“ Enable stakeholders Train governance teams, developers, and operators
6 ๐Ÿ“Š Measure and optimize Track compliance, costs, and time-to-value metrics

Important

The era of AI at scale demands governance as a strategic capability, not a compliance burden. Microsoft's layered approach provides the architecture, tools, and ecosystem to make this vision a reality.

๐Ÿ“š Key Resources and References


About

Deploy production-ready AI agents in one click! Citadel delivers unified governance, end-to-end observability & rapid development for secure, compliant AI at scale. Built on Azure best practicesโ€”turn security blockers into strengths with managed guardrails, cost control & a shared AI registry. ๐Ÿ›ก๏ธ๐Ÿ“Š

Resources

License

Code of conduct

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors