Unable to create HDInsight On Demand Cluster in Azure Data Factory

Tan Check Leam 5

I am getting the issue to creating the On Demand HDInsights in Azure Data Factory. The status is stuck at "PreparingCluster".

User's image

Here's my LinkedService configuration.

OS type : Linux

User's image

PRADEEPCHEEKATLA 90,231 Reputation points

2024-11-13T05:26:24.14+00:00

Tan Check Leam - Thanks for the question and using MS Q&A platform.

Creating an HDInsight cluster takes usually around 15-20 minutes.

Could you please try to connect after few minutes and see if that works. In case, if you experiencing the same issue, I would request you to create a new on-demand HDInsight cluster and see if you experiencing the same issue?
Meanwhile, checkout: Tutorial: Create on-demand Apache Hadoop clusters in HDInsight using Azure Data Factory.

Hope this helps. Do let us know if you have any questions.
Tan Check Leam 5 Reputation points

2024-11-13T06:05:32.6933333+00:00

Hi,

The status is still the same even I had leave it for more than 2 hours.

Is there any where I can check at which stage the provisioning have issues?
Tan Check Leam 5 Reputation points

2024-11-13T06:38:57.5366667+00:00

Hi,

It's stuck at the progress "PreparingCluster" after 3 hours.

Is there any where I can check which stage actually have issues?
PRADEEPCHEEKATLA 90,231 Reputation points

2024-11-13T10:37:37.8866667+00:00

@Tan Check Leam - This issue looks strange. As I suggested earlier, could you to create a new on-demand HDInsight cluster and see if you experiencing the same issue?
Tan Check Leam 5 Reputation points

2024-11-13T10:47:37.88+00:00

Hi ,

I have deleted and recreated the linked service for many times and same thing happened.

If not mistaken, I cannot create the cluster because it's supposed to be auto created when I execute my task.

Share via

Unable to create HDInsight On Demand Cluster in Azure Data Factory

Your answer