How to solve error messages 'no healthy upstream' and 'The operation was timeout' in chat playground of Microsoft Azure AI studio?

Robin Bouwmeester 21

In the chat playground I get the error messages such as 'no healthy upstream' or 'The operation was timeout' starting a chat with an uploaded png or jpeg image.

I get these error messages in the API as well.

Yesterday this was all working oke, but very slow.

How can I solve this issue?

EDIT: If I don't attach/upload an image, then the chatbot responses normally.

AshokPeddakotla-MSFT 33,746 Reputation points

2024-08-08T10:00:02.2566667+00:00

Robin Bouwmeester Greetings & Welcome to Microsoft Q&A Forum.

Thank you for posting your query here!

In the chat playground I get the error messages such as 'no healthy upstream' or 'The operation was timeout' starting a chat with an uploaded png or jpeg image.

Can you share model details and the region where the model is deployed?

Also, if this was working earlier and now your are seeing this issue, I would suggest you check the Azure Service Health dashboard for any known issues.
Robin Bouwmeester 21 Reputation points

2024-08-08T10:30:00.8433333+00:00

Modelname: gpt-4o

Modelversion: 2025-05-13

Contentfilter: Standard

Implementationtype: Standard

Capacity: 10K TPM

Frequentylimit: 10000

Location: East US
Robin Bouwmeester 21 Reputation points

2024-08-08T10:35:08.2666667+00:00

Just tested again (nothing changed), and now it works fine again.

Henry 0

It's consistently Error 408: The operation was timeout for me in recent hours when called using REST API.

Model Particulars:

Model Name: gpt-4o-mini
Model Version: 2024-07-18
Deployment time: Global-Standard/
Capacity: 500K TPM

Model Name: gpt-4o
Model Version: 2024-05-13
Deployment time: Global-Standard
Capacity: 400K TPM

Request Particulars:

"api-version": "2024-02-01"

1 answer

AshokPeddakotla-MSFT 33,746 Reputation points

2024-08-08T10:41:36.5533333+00:00

Robin Bouwmeester

This seems like a transient issue and I have checked internally and no issues were reported in East US region.

Just tested again (nothing changed), and now it works fine again.

Glad to hear your issue is resolved and thanks for confirming its working now.

If you face any issues, do let me know. I would be happy to assist you.

If the issue is resolved, please do click Accept Answer and Yes for was this answer helpful so that we can close this case.
Please sign in to rate this answer.
Robin Bouwmeester 21 Reputation points

2024-08-14T10:07:55.7833333+00:00

Testing today, again I get the error message "no healthy upstream | Apim-request-id: 72c15fdb-5bb8-4b3b-8c55-80864a002fa4" and "The operation was timeout. | Apim-request-id: b8217a6f-04a8-49cc-bab8-47c16cefd7fc" in the chat window of the Chat playground on https://oai.azure.com/

Robin Bouwmeester 21 Reputation points

2024-08-15T07:12:30.8+00:00

The issue was resolved later the day spontaneously, but It would be helpful that I can see there are issues on the services side so I wouldn't have to check my own code.

AshokPeddakotla-MSFT 33,746 Reputation points

2024-08-19T13:46:01.45+00:00

As mentioned earlier, I have checked internally and not seen any known issues. For known issues, you can check the Azure Service Health dashboard

If you encounter this issue again, for a deeper investigation and immediate assistance, please file a support request @ https://aka.ms/azsupt?

Hugo Castalan 5 Reputation points

2024-10-02T01:28:16.85+00:00

Hi. Not sure if it is known issue but have been getting a lot of 'no healthy upstream' errors on gpt-4o in the last few hours. Api and playground.

Lior Mechlovich 0 Reputation points

2024-10-02T01:59:53.9766667+00:00

"Getting lot of 'no healthy upstream' errors on gpt-4o in the last few hours. Api and playground" Here as well. Random errors in the last 3.5 hours
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to solve error messages 'no healthy upstream' and 'The operation was timeout' in chat playground of Microsoft Azure AI studio?

1 answer

Your answer