Azure compute creation failure on Personal Compute policy in Sweden Central/West Europe

Hussain Doctor 0 Reputation points
2026-07-28T12:33:20.8+00:00

Hello,

I am unable to create or start compute in my Azure Databricks workspace. This has been failing for several days. The affected compute is in Azure Sweden Central, using the Personal Compute policy/Unrestricted. It is a classic single-node cluster with DBR 19.x-scala2.13, access mode Standard, and current node type Standard_D4ds_v4. The failure message shows quota/capacity-related errors, including: QuotaExceeded: Operation could not be completed... and The VM size you are specifying is not available, and the cluster sits in PENDING / TERMINATED.

  • I already checked Azure quota and there appears to be enough quota in the subscription/region, so this looks inconsistent with the actual availability/error being returned. I also tried multiple allowed node types under the same policy, including Standard_D4ds_v5 and Standard_D4ds_v4, and previously Standard_DS3_v2 was shown as unsupported in the subscription. Please investigate whether this is an Azure capacity issue, stale quota validation, or a Databricks-side provisioning problem for this workspace/policy. This is urgent because my access/trial expiry is near and I am blocked from deploying any compute.
Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.


1 answer

Sort by: Most helpful
  1. AI answer

    2026-07-28T12:33:51.1333333+00:00

    For this Azure Databricks scenario, the supported causes are quota limits, Azure permission or policy restrictions, and regional VM capacity/stockout.

    Based on the reported errors:

    1. Check the exact cluster event log error code first.
      • In the compute event log, look for whether the failure maps to AZURE_QUOTA_EXCEEDED_EXCEPTION or AZURE_OPERATION_NOT_ALLOWED_EXCEPTION.
      • AZURE_QUOTA_EXCEEDED_EXCEPTION means the requested VM family quota would be exceeded.
      • AZURE_OPERATION_NOT_ALLOWED_EXCEPTION means the Azure operation failed because of permission restrictions, policy violations, or account limitations.
    2. Re-verify quota at the VM family level, not only overall regional quota.
      • In Azure portal, go to Subscriptions > Usage + quotas.
      • Confirm the quota for the exact VM family used by the node type, and review current usage from other VMs or clusters in the same subscription.
      • The documented fix for quota failures is to request a quota increase, terminate unused clusters, or use a different VM type with available quota.
    3. Treat the “VM size is not available” message as a regional capacity issue if quota looks sufficient.
      • The documented Q&A guidance for this pattern is that the SKU can be temporarily unavailable in a region due to stockout/capacity constraints, even when quota exists.
      • Since multiple node types in Sweden Central and West Europe are failing, test another allowed VM size or another region if available to isolate whether the issue is regional capacity.
    4. Check Azure-side restrictions that can look like quota problems.
      • Review Azure activity logs for the failed deployment.
      • Check service principal permissions on the resource group.
      • Verify Azure policies are not blocking the operation.
      • Check the subscription state and status.
      • Review recent permission or policy changes.
    5. Confirm the policy path is not the blocker.
      • Personal Compute is available by default to all users for single-machine compute resources.
      • If a user does not have unrestricted cluster creation, compute creation is limited by granted policies.
      • If the policy dropdown is visible and Personal Compute is selectable, that indicates policy access exists; the documented failure patterns for the reported messages still point to quota, Azure restrictions, or capacity.
    6. If custom container settings are involved, verify they are not contributing.
      • If the compute uses a custom Docker image, image pull or container creation failures can also terminate compute.
      • If no custom container is configured, this can be ruled out.

    What is supported by the available guidance for this case:

    • A Databricks-side provisioning defect for this specific workspace or Personal Compute policy is not established by the provided documentation.
    • The documented causes that match the reported symptoms are:
      • VM family quota exhaustion
      • Azure permission/policy/account restrictions
      • Regional VM SKU capacity unavailability

    Most direct next path:

    1. Open the compute event log and capture the exact termination code.
    2. In Azure portal, check Subscriptions > Usage + quotas for the exact VM family.
    3. Check Azure activity logs for the failed create/start attempt.
    4. If quota is available and activity logs show SKU unavailability, retry with another allowed VM size or region.
    5. If activity logs show permission/policy/account restriction, correct that Azure-side issue.
    6. If the failure remains after those checks, contact Azure support for quota/permission configuration assistance.

    AI-generated content may be incorrect. Read our transparency notes for more information.

    Was this answer helpful?

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.