Skip to main content

Cohere encrypted inference so it cannot read your prompts

Cohere shipped encrypted Model Vault, where keys are born inside the enclave and Intel attests the hardware. The same week it signed the Aleph Alpha merger.

Cohere encrypted inference so it cannot read your prompts

Ricardo Argüello

Ricardo Argüello
Ricardo Argüello

CEO & Founder

Business Strategy 4 min read

Cohere was worth 7 billion dollars a year ago and booked 240 million in 2025 revenue. On September 16 it signed a definitive merger with Aleph Alpha at a reported 20 billion.

That gap is not being paid for model quality. Nobody thinks Cohere is about to out-benchmark Anthropic.

It is being paid for a position: the AI vendor for buyers who cannot or will not standardize on a US lab. Berlin and Toronto headquarters, Aleph Alpha’s Heidelberg site as the research hub, 500 million euros from Schwarz Group, the owner of Lidl, and a possible 3 billion from a Canadian government-backed consortium, per SiliconANGLE.

And in the same week, Cohere shipped the product that makes that position defensible.

Encryption while the data is in use

Every AI privacy conversation for three years has bottomed out in a contract clause. The vendor promises not to train on your data and promises its staff will not look.

A paragraph. That was the control.

Encrypted Model Vault runs inference inside a hardware-based confidential VM with an attested NVIDIA GPU in confidential computing mode, on Intel TDX or AMD SEV-SNP on the CPU side.

The mechanism that matters is in the documentation rather than the announcement. The client encrypts its request straight to that environment over Oblivious HTTP. Keys are generated inside the enclave and never travel to Cohere. The load balancer and the network in between handle ciphertext and nothing else.

On top of that there is attestation. Golden values for the hardware and software are registered with Intel Trust Authority, so when the confidential VM boots, Intel confirms it matches the configuration Cohere, Intel and NVIDIA approved. A customer checks that before the first request.

So the vendor question changes shape. It stops being “do you promise not to look?” and becomes “can I verify that you are unable to look?”

The first question only ever had a legal answer.

Read the fine print before you get excited

Two things.

It is in beta, with early access for a limited group. This is not something you procure next week.

More importantly, attestation does not remove trust. It relocates it. You stop trusting Cohere’s internal policy and start trusting Intel, NVIDIA and the signing chain that certifies those images. That is a genuine improvement, because those parties have different incentives and their claims are checkable. It is not zero trust, and anyone selling it to you that way is overselling.

The rule we apply in AI vendor selection holds. What you cannot verify does not count as a control.

That rule earned its place the hard way. When the Claude Mythos leak happened, every affected company had a contract clause and none of them had a way to check anything.

You are not a German bank, and it still matters

Most readers here will never buy Model Vault. The bar it just raised is still useful.

Next time you evaluate an AI vendor for a workflow touching regulated or genuinely sensitive data, there is now a question with a real answer behind it. Is the data exposed in memory during processing, and is there any way for me to verify your answer without taking your word for it?

Most vendors will say no. That is fine, and it is information. You learn what you are buying and you adjust what you send through it.

What stopped being acceptable is treating the contract paragraph as if it were a technical control. We keep circling this distinction between what a vendor promises and what you actually govern, most recently in the kill switch you do not control.

If you are writing next year’s vendor criteria, add the attestation row to the matrix now. You will get blanks in that column across most of the market this year. The vendor that fills it will be charging a premium for it in 2027.

Let’s review your AI vendor matrix

Frequently Asked Questions

Cohere Aleph Alpha confidential computing data privacy data sovereignty vendor selection Intel TDX

Related Articles

AI Vendor Selection for B2B: Trust and Data Privacy
Business Strategy
· 9 min read

AI Vendor Selection for B2B: Trust and Data Privacy

12 critical questions to ask before choosing an AI vendor. Covers trust evaluation, data governance, and privacy protection for B2B decisions.

vendor selection data privacy AI governance
Mercor Breach: 4 TB of Biometric Data You Can't Rotate
AI & Automation
· 10 min read

Mercor Breach: 4 TB of Biometric Data You Can't Rotate

Mercor, the $10B startup training models for OpenAI and Anthropic, fell to the LiteLLM attack. Lapsus$ claims biometrics from 30,000+ contractors.

AI security software supply chain biometric data
Workado sold 98% AI accuracy. Independent tests said 53%
Business Strategy
· 4 min read

Workado sold 98% AI accuracy. Independent tests said 53%

The FTC's standard for AI performance claims is evidence held at the moment the claim is made. That sentence works just as well as a procurement test.

FTC Workado Cox Media Group
Bending Spoons Bought Airtable. Now Check Your Plan.
Business Strategy
· 6 min read

Bending Spoons Bought Airtable. Now Check Your Plan.

Airtable grew past $480M ARR at 20% and still sold for $1.285B cash against an $11B mark. Picking a vendor means picking its next owner too.

Airtable Bending Spoons SaaS valuation
The Cheap Model Trap: How AI Providers Capture Ecosystems
Business Strategy
· 8 min read

The Cheap Model Trap: How AI Providers Capture Ecosystems

Google at $0.25/M tokens, OpenAI at $0.05/M. Not charity, it's platform capture applied to AI. What the pricing war means for your B2B independence.

AI strategy vendor lock-in AI costs