Internal error when training custom category

Question

Internal error when training custom category

Tony Williams 5

I'm trying to use the Content Safety Studio to train the AI on a custom category. I uploaded my .jsonl file to a blob storage and have 64 examples in the following format in the file:

{"text": "Message: Temporary Access Token  One-Time Access Token Use this token to access the temporary file viewer. This token is valid for 1 hour only. xxxx Do not refresh the page after entering the code. ", "isPositive": true}
{"text": "Message: Access Token  One-Time Access Token Use this token to access the file viewer. This token is valid for 1 hour only. xxxx Do not refresh the page after entering the code. ", "isPositive": true}

Except every time I try to train the model, the training status fails with 'internal error'. I've tried five times now and I get the internal error every time. Are there certain restricted characters or something? The documentation here is severely lacking and it takes at least two hours for it to error out so it's incredibly difficult to troubleshoot.

Manas Mohanty 16,190 Reputation points Microsoft External Staff Moderator

2025-12-09T05:56:52.02+00:00

Hi Tony Williams

I am trying to replicate this issue. Could you share the region used in replication here.

Analysis and Replication

Contents in input does not look suspicious except this word "xxxx". Could you replace this content

xxxx Do not refresh the page after entering the code.

Could not test a content safety resource in East Us/Switzerland north region as it is showing "Region not supported" error as the document suggests (should have been service depreciation which can be confirmed from product group side)

Recommendation

Could you test "Custom Categories" from AI foundry available under "Guardrails+controls" and let us know. (To rule out service depreciation)

Omit the "XXXX" and re-try

Hope it helps.

Thank you.
Tony Williams 5 Reputation points

2025-12-09T18:38:40.41+00:00

Hi Manas - I get the same error when using AI foundry. The reason why you're getting the prompt that the region isn't supported is because you don't have a resource selected on the top right under your name. Note in your screenshot it just shows as --, indicating you don't have a resource selected. If you select something that prompt should go away and it'll allow you to submit training data.

In my actual training data, I have the actual code as an example. I just redacted it and replaced it with xxxx here in my posting.

Is there a list anywhere of the allowed characters/content in the training data? I've tried probably 10 different iterations of my data, and I keep getting Internal Error.
Saurabh Gupta 0 Reputation points

2025-12-19T19:19:07.3433333+00:00

was there any solution to this? I am getting the same internal error no matter how simple of a description or training data i provide

1 answer

Your answer

Manas Mohanty 16,190 Reputation points Microsoft External Staff Moderator

2025-12-09T05:56:52.02+00:00

Hi Tony Williams

I am trying to replicate this issue. Could you share the region used in replication here.

Analysis and Replication

Contents in input does not look suspicious except this word "xxxx". Could you replace this content

xxxx Do not refresh the page after entering the code.

Could not test a content safety resource in East Us/Switzerland north region as it is showing "Region not supported" error as the document suggests (should have been service depreciation which can be confirmed from product group side)

Recommendation

Could you test "Custom Categories" from AI foundry available under "Guardrails+controls" and let us know. (To rule out service depreciation)

Omit the "XXXX" and re-try

Hope it helps.

Thank you.
Tony Williams 5 Reputation points

2025-12-09T18:38:40.41+00:00

Hi Manas - I get the same error when using AI foundry. The reason why you're getting the prompt that the region isn't supported is because you don't have a resource selected on the top right under your name. Note in your screenshot it just shows as --, indicating you don't have a resource selected. If you select something that prompt should go away and it'll allow you to submit training data.

In my actual training data, I have the actual code as an example. I just redacted it and replaced it with xxxx here in my posting.

Is there a list anywhere of the allowed characters/content in the training data? I've tried probably 10 different iterations of my data, and I keep getting Internal Error.
Saurabh Gupta 0 Reputation points

2025-12-19T19:19:07.3433333+00:00

was there any solution to this? I am getting the same internal error no matter how simple of a description or training data i provide

Answer 1

Hi Tony Williams and Saurabh Gupta

Apologize for the delay in response.

It is not able to pick up my content safety resource in personal subscription.

Have not got a chance to sync internally with relevant teams for confirming depreciation on content safety resources.

Workaround solution is to test "Custom Categories " feature under "Guard Rails and Controls"/"Try out" option.

User's image

Available region for Standard - East Us and Australia East, you can leverage an East Us2 AI resource for evaluation too.

Reference

https://learn.microsoft.com/en-us/azure/ai-services/content-safety/quickstart-custom-categories?tabs=curl&pivots=programming-language-foundry-portal

https://learn.microsoft.com/en-us/azure/ai-services/content-safety/overview#region-availability

Thank you for understanding.

Share via

Internal error when training custom category

1 answer

Your answer