Cohere opens confidential computing on Model Vault in public beta
Cohere has launched Confidential Computing on Model Vault in public beta, using NVIDIA H100 GPUs on Microsoft Azure to protect prompts, documents, responses and model execution while inference is running.
AT A GLANCE
Key points
- Confidential Computing on Model Vault is now in public beta.
- Prompts and responses are decrypted only inside an attested confidential environment.
- Sensitive data is not sent when remote attestation fails.
- The initial beta runs on NVIDIA H100 GPUs in Microsoft Azure.
What is changing?
Cohere announced the public beta of Confidential Computing on Model Vault on October 22. The managed inference service runs inside a hardware-backed confidential environment using NVIDIA H100 GPUs on Microsoft Azure.
The architecture aims to protect data in use. Prompts, documents and responses remain encrypted through intermediary infrastructure and can be decrypted only inside the attested confidential environment. Cohere says GPU memory and traffic between the CPU and GPU are protected.
Customer-side software checks signed evidence about the hardware, firmware and software configuration against an approved policy before releasing data. If the measurements do not match, the request is not sent. Existing Model Vault API formats remain available.
The public beta targets sensitive workloads such as financial records, clinical documents, privileged material and proprietary source code. Cohere notes that the system does not replace application security, prompt-injection defenses, data-residency requirements, compliance measures or availability protections.
Explore the original sources
Source date: 22 October 2026.
Published by AI Radar: 23 Oct 2026, 08:01 (Istanbul, UTC+3).
FOLLOW THE TOPIC
Topics and tags
Share your discovery.
Send this story to a friend.
Reader comments
What do you think about this development? Share your experience or question. Comments are published after editorial approval.
Your name/nickname and comment become public if approved. Read: Privacy notice.
Loading comments…