Share via

How does Azure OpenAI ensure prompt caching privacy in multitenant environments?

roy pasternak 0 Reputation points
2024-11-10T15:55:19.3233333+00:00

I'm using Azure OpenAI in a multitenant setup and am concerned about prompt caching potentially causing data leakage between tenants. How does Azure handle privacy and security for cached tokens and responses across different tenants?

Is there an official documentation for this?

Thanks

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Avinash Devarakonda 325 Reputation points Microsoft Vendor
    2024-11-11T08:45:42.8733333+00:00

    Hi roy pasternak,

    Welcome to Microsoft Q&A Forum, thank you for posting your query here!

    Azure OpenAI Service ensures privacy and security in multitenant environments by isolating each tenant’s data, encrypting cached data both in transit and at rest, implementing strict access controls, and maintaining detailed audit logs. For more details, you can refer to the official documentation on Prompt Caching with Azure OpenAI Service.

    Prompt caching with Azure OpenAI Service - Azure OpenAI | Microsoft Learn

    Hope this helps. Do let us know if you any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer

    Thank You.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.