Running AI pilots is easy. Turning them into value is where 95% of enterprises fail.
We have been digging into enterprise AI orchestration, the layer that turns scattered GenAI pilots into business value. Enterprises have poured $30B-40B into GenAI, with 95% delivering zero measurable P&L impact [1]. Meanwhile, the orchestration market is projected to grow from $11B to $30B by 2030 at 22% annually [2], precisely because everyone is aware of the potential AI has yet to unfold at enterprise scale.
The reason real impact is lagging behind is not model quality. Instead, enterprises run dozens of pilots across fragmented models with no shared memory, governance, or cost visibility, and only 5% of task-specific AI tools ever reach production. MIT calls it a "learning gap": tools that do not learn, adapt, or integrate into workflows stall out, regardless of the model behind them. More pilots are not solving this. Better orchestration is.
The same dynamic shows up in adoption patterns. 90% of knowledge workers already use personal AI tools like ChatGPT for work, while only 40% of their employers officially deploy AI [1]. Bottom-up adoption is running ahead of procurement, security, and governance. That gap, between what employees are already doing and what the enterprise can safely operationalize, is exactly where the orchestration layer has to intervene.
The market has tried to solve this in several ways, with mixed results:
► Hyperscalers (AWS Bedrock, Azure AI, ServiceNow) move fast but stay locked in their ecosystems. Microsoft and former AWS leaders told us end-to-end orchestration is still unsolved.
► Point solutions dominate the startup layer. Routing players (Martian, Portkey, OpenRouter), security tools (Lakera, CalypsoAI), and observability platforms (Arize, Langfuse) each solve one slice. None solve the whole.
► In-house builds are the most common path and the worst performing. For example, MIT found that purchased solutions succeed twice as often.
Based on expert conversations across Microsoft, AWS, Datadog, IBM Watson, Stripe, and Fortune 500 AI leaders, we believe the winner will need three things at once:
✔ Full-stack and vendor-neutral orchestration across routing, governance, workflow integration, memory, and observability
✔ Learning-capable architecture that adapts to enterprise workflows and improves from user feedback over time
✔ Enterprise-ready from day one, combining trust, clear data boundaries, and on-prem deployment, especially for regulated sectors and European buyers
The timing is now. Enterprise AI spend is shifting out of innovation budgets into permanent IT lines over the next 18 months. Orchestration is becoming a standard line item alongside identity and data management. No clear winner exists yet.
Do you think this will be solved by an incumbent pivoting in, or by a new pure-play? And will the winner be a regional player or a global leader?👇 Interested to hear how others are thinking about it. #DDwithDarius