Error while doing fine tuning

Aditya 0

Why do i get the following error when i try to fine tune using the code available in documentation.

BadRequestError: Error code: 400 - {'error': {'code': 'invalidPayload', 'message': 'The specified base model does not support fine-tuning.'}}

This is code i am running (same code that is available in documentation for fine-tuning)

# Submit fine-tuning training job

response = client.fine_tuning.jobs.create(
    training_file = training_file_id,
    validation_file = validation_file_id,
    model = "gpt-4o-mini-2024-07-18", # Enter base model name. Note that in Azure OpenAI the model name contains dashes and cannot contain dot/period characters.
    seed = 103 # seed parameter controls reproducibility of the fine-tuning job. If no seed is specified one will be generated automatically.
)

job_id = response.id

# You can use the job ID to monitor the status of the fine-tuning job.
# The fine-tuning job will take some time to start and complete.

print("Job ID:", response.id)
print("Status:", response.status)
print(response.model_dump_json(indent=2))

AshokPeddakotla-MSFT 35,096 Reputation points

2024-10-23T12:02:33.81+00:00

Aditya Greetings & Welcome to Microsoft Q&A forum!

BadRequestError: Error code: 400 - {'error': {'code': 'invalidPayload', 'message': 'The specified base model does not support fine-tuning.'}}

Are you following this documentation Azure OpenAI GPT-4o-mini fine-tuning tutorial?

Did you create OpenAI resource in a region where gpt-4o-mini-2024-07-18 fine-tuning is available?

In which region you are trying the fine tuning?
Aditya 0 Reputation points

2024-10-24T09:43:34.0766667+00:00

Yes, I am following the documentation available here https://learn.microsoft.com/en-us/azure/ai-services/openai/tutorials/fine-tune?tabs=python-new%2Ccommand-line.

Yes, Azure OpenAI resource has a location of "eastus".

I am getting the following error now:

BadRequestError: Error code: 400 - {'error': {'code': 'invalidPayload', 'message': 'The specified base model does not support fine-tuning.'}}

Please let me know what could be the reason for this error.
Aditya 0 Reputation points

2024-10-24T09:45:34.3333333+00:00

This is the error i am getting now. My Azure AI resource has location = eastus.

BadRequestError: Error code: 400 - {'error': {'code': 'invalidPayload', 'message': 'The specified base model does not support fine-tuning.'}}

I am following the documentation available here: https://learn.microsoft.com/en-us/azure/ai-services/openai/tutorials/fine-tune?tabs=python-new%2Ccommand-line
AshokPeddakotla-MSFT 35,096 Reputation points

2024-11-07T08:57:58.6833333+00:00

Aditya Just checking to see if you had a chance to review the below response.

Do let me know if that helps or have any other queries.

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.

1 answer

AshokPeddakotla-MSFT 35,096 Reputation points

2024-10-28T16:17:46.7333333+00:00

Aditya Apologies for the delay in response.I further verified from my end and found that the gpt-4o-mini 2024-07-18 model is not available in East US region for fine-tuning.Only available in below mentioned regions. see region where gpt-4o-mini-2024-07-18 fine-tuning is available?

I would suggest you, please try in any of the available regions and let me know if that solves your issue.
Please sign in to rate this answer.
Aditya 0 Reputation points

2024-11-12T05:31:43.57+00:00

Hello,

I just tried to gpt-4o which is shown available in US East 2 but i get the following error:

BadRequestError: Error code: 400 - {'error': {'code': 'invalidPayload', 'message': 'The specified base model does not support fine-tuning.'}}

I also tried to fine tune gpt-35-turbo but i get the same error.

Please check and let me know what is wrong here.

Aditya 0 Reputation points

2024-11-12T05:33:34.88+00:00

I tried tuning gpt-4o and gpt-35-turbo (models available in US East )but i am getting the following error -

BadRequestError: Error code: 400 - {'error': {'code': 'invalidPayload', 'message': 'The specified base model does not support fine-tuning.'}}

AshokPeddakotla-MSFT 35,096 Reputation points

2024-11-13T09:33:41.7766667+00:00

Aditya I understand your concern.

I tried tuning gpt-4o and gpt-35-turbo (models available in US East )but i am getting the following error -

As mentioned in the doc, gpt-35-turbo - Fine-tuning of this model is limited to a subset of regions, and isn't available in every region the base model is available.

The supported regions for fine-tuning might vary if you use Azure OpenAI models in an AI Studio project versus outside a project.

I just tried and able to see and deploy the gpt-4o (2024-08-06) model for finetuning in EAST US2 region.

I would suggest you, please try with other regions as per the model availability and let me know if you need further help.

Jason Tanuwijaya 0 Reputation points

2024-11-23T08:51:15.8833333+00:00

Hello Microsoft,

I have try using the model from the setting that you send (gpt-4o EAST US 2) is still outputting the same error message. I also try it with North Central US and giving the same error

BadRequestError: Error code: 400 - {'error': {'code': 'invalidPayload', 'message': 'The specified base model does not support fine-tuning.'}}
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Error while doing fine tuning

1 answer

Your answer