Get started
AI Infrastructure

The orchestration gap: why every AI framework needs a governance layer

Adam Cowles1 March 20264 min read
Disparate AI framework shapes being connected by a forming violet governance mesh

LangChain orchestrates chains. CrewAI orchestrates crews. AutoGen orchestrates conversations. None of them orchestrate accountability. That is a different layer entirely, and it does not exist yet.

Orchestration is not governance

The AI agent ecosystem in 2026 is rich with orchestration frameworks. LangChain, CrewAI, AutoGen, Semantic Kernel, LlamaIndex, Haystack. Each provides a way to chain together LLM calls, tool invocations, and multi-agent conversations. They are good at what they do.

What they do is schedule and execute. What they do not do is govern. When a LangChain agent makes a tool call that modifies production data, LangChain records that the call happened. It does not record whether the agent was authorised to make it. When a CrewAI crew member delegates a task to another agent, CrewAI coordinates the handoff. It does not produce evidence that the delegation was policy-compliant.

This is not a criticism. These frameworks were built to make agents work. Making agents accountable is a different problem, and it requires a different layer.

The landscape

  • LangChain ($1.25B valuation). Does: Chain composition, tool use, memory, retrieval. Missing: No structured audit trail. No policy enforcement. No evidence chain. Observability via LangSmith is logging, not governance.
  • CrewAI ($24.5M raised). Does: Multi-agent crews, role-based task delegation. Missing: No approval gates. No tamper-evident records. Governance is marketing language, not architecture.
  • AutoGen (Microsoft Research). Does: Multi-agent conversations, human-in-the-loop patterns. Missing: Research-grade HITL. No production policy model. No evidence export.
  • Semantic Kernel (Microsoft). Does: Plugin architecture, planner, function calling. Missing: Enterprise-grade within Azure. Proprietary. Does not extend to non-Microsoft ecosystems.

The pattern is consistent. Every framework handles execution. None handles accountability. This is the orchestration gap.

Why the governance layer must be neutral

Most enterprises do not use one framework. They use several. The data team uses LangChain. The customer service team uses a proprietary agent platform. The DevOps team uses Claude Code. The marketing team uses an automation tool with AI features. Each has its own execution model, its own logging format, its own version of "observability."

When the compliance team asks "what are our AI agents doing?", nobody can answer, because the answer is spread across five different systems with five different log formats and no common schema.

The governance layer cannot belong to any one framework. It needs to be neutral. A common set of protocols that any framework can emit, any governance system can consume, and any auditor can verify. The same way that HTTP does not care what programming language generated the request, the governance protocol should not care what framework triggered the agent action.

Open protocols, not proprietary platforms

This is why Quox built open protocol specifications rather than a proprietary governance API.

AEE defines a standard envelope for agent messages. Any framework can wrap its communications in AEE envelopes. AOCL defines a governance pipeline that agent actions pass through before execution. VOLT defines how to chain those records into tamper-evident evidence. These protocols are not proprietary to Quox. They are designed to be implemented by anyone.

The bet is the same one that built the modern internet. HTTP won because it was open. TCP/IP won because it was open. TLS won because it was open. The governance layer for AI agents will win the same way.

Quox is building the reference implementation. But the protocols are the point. If a better implementation appears, the protocols still work. That is the advantage of standards over platforms.

What happens next

The orchestration frameworks will not add governance themselves. It is not what they are for, and it is not what their users are asking for today. LangChain users want better chains. CrewAI users want better crews. Governance is infrastructure, and infrastructure is a different business.

What will happen is that governance will arrive as a layer. The same way that observability arrived as a layer (Datadog did not replace your application; it watched it), and the same way that security arrived as a layer (Cloudflare did not replace your web server; it sat in front of it), governance will sit alongside orchestration without replacing it.

The frameworks that emit structured evidence will be preferred over those that do not. The governance layers that accept evidence from any framework will be preferred over those tied to one vendor. Open protocols will beat proprietary formats for the same reason they always have: because the world runs more than one stack.

Deploy QuoxCORE: free, self-hosted

AI agent orchestration with built-in governance. Docker Compose up and running in under five minutes.