September 2026 · 5 min read
Sovereign AI is an architecture decision, not geopolitics

Key Definitions
Sovereign AI IDC's definition: free choice and control over the design, development, deployment, accessibility, operation, maintenance and governance of AI systems and the technology they depend on. Cohere CAIO Joelle Pineau: it is fundamentally an architecture question.
Embedded Agent An AI agent embedded in an application that can read internal information, call APIs, invoke tools, or take actions inside another application — not just a model that responds to prompts. IDC's survey found 86% of enterprises already use them.
An IDC survey of 508 organizations, commissioned by Cohere, produced a counterintuitive result: 86% already use agents embedded in applications, yet only 12% say sovereign-AI risk is widely understood in their organization. The more structural finding: 420 organizations have assigned someone responsibility for sovereign AI, but only 8% say those roles are well-defined. Ownership is being assigned faster than it is being defined.
The official definition — and its architectural nature
IDC defines sovereign AI as the ability to exercise free choice and control over the design, development, deployment, accessibility, operation, maintenance and governance of AI systems and applications, as well as the underlying technology they depend on. Cohere's chief AI officer, Joelle Pineau, compresses it into a blunter sentence: "Sovereignty is fundamentally an architectural question. If AI is tied to a single provider or governed by terms that can change, you don't have control; you have dependency."
Cohere co-founder Nick Frosst makes the same point from the opposite direction: once AI is embedded deeply enough that losing access would disrupt other systems, "if access changes, your entire stack can be disrupted, and that is not a foundation you can build on." Sovereign AI is routinely filed under geopolitics; for enterprise decision-makers it is first a set of architectural choices about data, updates and deployment control.
Five truths from the data
Truth 1: Adoption has outrun understanding
99% use generative AI and 86% use embedded agents — but only 12% say sovereign-AI risk is widely understood. Agents already reach company systems and data; comprehension has not caught up.
Truth 2: Ownership precedes definition
420 of 508 organizations have assigned a sovereign-AI owner, but only 8% say those roles are well-defined and just 0.4% fully formalized and governed. Accountability sits with individuals rather than structures.
Truth 3: Infrastructure is the biggest barrier
Asked for their single biggest readiness barrier, infrastructure led at 17%, cost and budget at 10%, skills and talent at 9%. Enterprises are not short on intent; they are short on the underlying operating conditions.
Truth 4: Who owns it
Among organizations with dedicated ownership, the chief AI officer or head of AI leads 51.7% of cases, followed by the CIO/CTO at 36.9%. Germany stands apart: CIOs/CTOs lead 70% there, versus 24% in the U.S., 33% in the U.K. and 32% in Canada.
Truth 5: Data still outranks agent actions as a concern
Data leakage or privacy breaches lead at 76%, followed by compliance, regulatory or legal risk at 59%; only 24% selected improper or unintended autonomous actions by agents. Control over agent behavior is systematically underestimated.
Agent adoption is accelerating — and about to accelerate faster
13% of organizations currently use prebuilt or third-party agents; 67% expect to within 12 months, and internally developed agents are expected to jump from 5% to 44% over the same period. Agents are moving from text generation to accessing systems, invoking tools and taking direct action — yet concern about agent behavior lags well behind concern about data. That mismatch is exactly where the sovereign-AI conversation starts: once agents take actions, you must decide not only where the data lives, but what the agent is allowed to do.
Sovereignty does not replace governance
Cohere's position is that keeping AI inside an organization's own environment determines where data goes and who controls the underlying system — it does not determine what the agent should be allowed to do once it is there. As Pineau puts it: "Control has to be engineered into the system itself: how the model is built, how it's sized, and how it's deployed. True sovereignty requires a platform where privacy, security, and deployment choice are defaults, not add-ons."
Cohere's own answer: customers can run the complete platform on their own infrastructure, including fully air-gapped and classified environments. Licensing is offline with no phone-home; updates, patches and new model versions arrive as signed packages the customer transfers in, validates and deploys through its own process; environment changes are initiated only through client action. An external AI provider cannot push a new model or software update into your environment — what enters and when is the customer's decision.
Four judgments for your enterprise
Treat sovereign AI as an architecture decision, not a political statement
Answer three questions: where does the data live, who controls updates, and how would provider terms changing affect your stack? Those three answers define your dependency structure.
Define responsibility; do not just assign it
420 organizations assigned an owner; only 8% defined the role. An undefined responsibility is no responsibility — write down what this owner can decide and what they answer for.
Govern "what agents may do" separately from "where data lives"
Sovereignty answers data location and control; agent permissions, visibility and runtime monitoring are a separate problem. Solving only the first leaves the keys by the lock.
Answer dependency with architecture, not contract language
Vendor contracts can change; your stack cannot be re-architected monthly. Verify that updates arrive as signed packages you deploy on your own schedule — that defines control better than any SLA.
References
- The New Stack: AI agents are spreading fast. Their rules are still catching up. (2026-08) — https://thenewstack.io/enterprise-ai-agent-governance/
FAQ
Who did this survey cover?+
IDC surveyed 508 organizations on behalf of Cohere; 420 of them already have someone responsible for sovereign AI. The focus is the gap between agent adoption and sovereign-AI readiness.
What does 'sovereignty is an architecture question' mean?+
Cohere CAIO Joelle Pineau: if AI is tied to a single provider or governed by terms that can change, you have dependency, not control. Sovereignty decides where data lives and who controls updates and deployment.
What is the biggest readiness barrier?+
Infrastructure at 17%, cost and budget at 10%, skills and talent at 9%. Organizations are blocked by infrastructure conditions, not intent.
How fast will agent adoption accelerate?+
13% currently use prebuilt or third-party agents and 67% expect to within 12 months; internally developed agents are expected to jump from 5% to 44% over the same period.
What are enterprises most worried about?+
Data leakage or privacy breaches lead at 76%, followed by compliance and legal risk at 59%; only 24% selected improper autonomous actions by agents — control over agent behavior is systematically underestimated.
Related Articles
EU sovereign AI infrastructure: rebuilding compute and supply-chain autonomy
The regional half of sovereign AI — rebuilding compute and supply chains, complementary to the enterprise-level architecture view here.
BCG: enterprise AI needs a control plane — governance architecture from pilot to scale
A control plane centralizes permissions, approvals and monitoring into enterprise AI infrastructure — structurally homologous to the sovereignty argument.
The adoption-to-production agent gap
Adoption rises while production lags — the same structural phenomenon as sovereign AI's "adoption faster than understanding" mismatch.
Shadow AI agents: the invisible enterprise crisis
"You cannot govern what you do not know" — as agent adoption accelerates, inventory and ownership are the first prerequisite of governance.