Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,315 questions
Increase My Context Windows In Azure OpenAI Service
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 69%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENW%3C/text%3E%3C/svg%3E)
Noel Wilson
0
Reputation points
I am in the Microsoft Startup Hub program and I would like to increase the context windows for our models in Azure OpenAI Service
{count} votes
-
romungi-MSFT 47,206 Reputation points Microsoft Employee2024-11-21T09:27:55.2066667+00:00 @Noel Wilson Do you mean increasing the max request for input and output tokens for a particular model? On the models page, the documented max request tokens for each model is the maximum that can be used for the context window and I don' t think this can be increased beyond the maximum.
The configurable limit of tokens per minute(TPM) is available on the quota page of the OpenAI studio. You can use this to configure to the maximum TPM limit. Is this what you are looking for?
Sign in to comment
Sign in to answer