2,799 questions with Azure Databricks tags

Sort by: Updated
1 answer

Intermittent DBSQL / Power BI failures in Azure Databricks Unity Catalog DLT objects Cannot time travel Delta table to version X only in PRD workspace

Hi all We are seeing an intermittent production issue in Azure Databricks that impacts both Databricks SQL and Power BI refreshes Environment Azure Databricks Unity Catalog enabled DLT pipeline producing bronze to silver to gold Output objects are DLT…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-26T22:15:48.6566667+00:00
CookiesBrammer 0 Reputation points
commented 2025-12-31T02:02:15.6266667+00:00
VRISHABHANATH PATIL 3,225 Reputation points Microsoft External Staff Moderator
3 answers

How to enable Unity Catalog legacy access for External Location fallback mode (Snowflake Iceberg federation)?

How to enable Unity Catalog legacy access for External Location fallback mode (Snowflake Iceberg federation)? I'm federating Snowflake-managed Iceberg tables into Azure Databricks Unity Catalog (Serverless). PROBLEM: Snowflake External Volumes only…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-29T19:52:39.65+00:00
Risto Saari 0 Reputation points
commented 2025-12-30T20:37:23.76+00:00
Pilladi Padma Sai Manisha 1,160 Reputation points Microsoft External Staff Moderator
0 answers

Unexpected Azure Databricks charges — no active Databricks workspace visible

I am seeing Databricks-related charges in my Cost Analysis view for my subscription, but I do not see any active Databricks workspace or resources under the Azure Databricks service blade. Details: — Subscription: Azure for Students (University of…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-29T18:00:47.7233333+00:00
Gaurav Sinha 0 Reputation points
commented 2025-12-30T20:20:29.52+00:00
Pilladi Padma Sai Manisha 1,160 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Unexpected Databricks charges continuing after resource deletion

Hi Azure Support Team, The Databricks resource groups have already been deleted, however the cost for raggg is still increasing each day in Cost Analysis. This appears abnormal compared to delayed posting — and I am concerned that an orphaned or hidden…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-30T19:54:04.4933333+00:00
Gaurav Sinha 0 Reputation points
accepted 2025-12-30T19:54:52.17+00:00
Gaurav Sinha 0 Reputation points
2 answers

DAB for only notebook deployments from dev to test/prod?

“Is it worth adopting Databricks Asset Bundles (DAB) solely for deploying notebooks from Dev to Test/Prod workspaces, given that our current architecture uses Azure Data Factory (ADF) to orchestrate notebook execution and we do not use Databricks Jobs or…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-22T14:22:26.08+00:00
commented 2025-12-30T05:35:27.46+00:00
VRISHABHANATH PATIL 3,225 Reputation points Microsoft External Staff Moderator
2 answers

Azure Free Trial shows vCPU quota but Databricks compute cannot start (approved quota = 0)

I am using an Azure Free Trial subscription. I created an Azure Databricks workspace successfully, but I am unable to start even a single-node cluster. Databricks shows a message that the default compute size has been reduced due to existing cloud…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-18T12:32:08.2+00:00
MANI RATNAM 0 Reputation points
edited a comment 2025-12-29T23:52:23.81+00:00
Pilladi Padma Sai Manisha 1,160 Reputation points Microsoft External Staff Moderator
2 answers

Increasing free trail

I need to increase my free trail quota in data bricks

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-17T14:09:29.7266667+00:00
Ram Godugu 0 Reputation points
commented 2025-12-29T09:48:37.0866667+00:00
VRISHABHANATH PATIL 3,225 Reputation points Microsoft External Staff Moderator
2 answers

Unable to create cluster in Databricks azure

I wanted to create a personal compute in Azure Databricks with Standard_D4ds_v5. But im not able to select other options. I am on "pay as you go" subscription and also have 200$ credits. Here is the screenshot attached:

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-29T08:15:37.35+00:00
Yash Nilesh Brid 0 Reputation points
answered 2025-12-29T09:38:33.69+00:00
VRISHABHANATH PATIL 3,225 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

how to fix the nsg port communation alret problem in azrue databricks compute plane and control plane

Open new ports for Azure Databricks by 30 January 2026 You're receiving this notice because you have one or more Azure subscriptions with workspaces that haven't opened new ports for Azure Databricks. We previously communicated in March 2024 that Azure…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-16T09:17:39.15+00:00
Surya R 20 Reputation points
accepted 2025-12-29T05:49:52.0766667+00:00
Surya R 20 Reputation points
2 answers

How to create two recipients use the same Sharing identifier

Hi there, I want to create two recipients in Delta Sharing, and both of them are under the same metastore. Is there a way to do this? Thanks & Regards, zmsoft

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-25T08:50:28.13+00:00
zmsoft 615 Reputation points
commented 2025-12-25T09:04:06.11+00:00
zmsoft 615 Reputation points
3 answers

Azure Databricks ML Playground Rate Limit Errors on all models

Hi Team, We're encountering rate limit errors in the ML Playground (under the ML section) of our Azure Databricks workspace. This feature allows us to query default Azure Databricks models for answers, and it was working fine until yesterday evening. …

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-18T14:24:29.82+00:00
Sooriya E 35 Reputation points
commented 2025-12-24T07:42:44.65+00:00
Kalyani Kondavaradala 4,675 Reputation points Microsoft External Staff Moderator
2 answers

Troubleshooting Azure Databricks Cluster Pools & spot_bid_max_price Validation Error

Hope you’re doing well! I’m reaching out for some guidance on an issue I’ve encountered while setting up Azure Databricks Cluster Pools to reduce cluster spin-up and scale times for our jobs. Background: To optimize job execution wait times, I’ve created…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-07T14:03:21.0266667+00:00
Anuj Singh 1 Reputation point
commented 2025-12-18T19:09:20.16+00:00
Manoj Kumar Boyini 2,520 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

How to find/use the file by "dbutils.fs.ls" & "dbutils.fs.cp" on notebook in Azure Databricks

I'd like to batch insert data to Databricks, and I used uploading one file and insert data by notebook. At the first step, I can uploaded the file to Databtick DBFS successfully, The DBFS path I used is…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-16T08:00:45.2866667+00:00
Hank Hong 20 Reputation points
commented 2025-12-18T11:49:15.7466667+00:00
Hank Hong 20 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Databricks Unity Catalog deployment

We are a data team of 6 , data governance experts , data product engineer and data platform engineers. As a data platform architect i am trying to implement unity catalogue across 3 serverless adb workspaces. Dev , test and prod. Which would be the…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-17T15:30:48.5133333+00:00
accepted 2025-12-18T09:53:39.5766667+00:00
2 answers

How can i reset the admin user for azure databricks account?

Hi, since we lost the access to the databricks admin account console we would like to reset the admin user. How can we do so or whom can we contact to do so? Regards Marius

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-18T08:01:09.1+00:00
Faig, Marius 0 Reputation points
answered 2025-12-18T09:03:25.8866667+00:00
Manoj Kumar Boyini 2,520 Reputation points Microsoft External Staff Moderator
2 answers

ADB WS error

Not able to create a Workspace . error :-The workspace 'adb2' is in a failed state and cannot be launched. Please review error details in the activity log tab and retry your operation. Status Failed Resource group db-training-001 Location West…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-03T22:14:14.42+00:00
Biswajit Mohapatra 0 Reputation points
commented 2025-12-18T07:30:29.4566667+00:00
VRISHABHANATH PATIL 3,225 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

Inconsistency in Null Values While copying data from delta lake to AzSQL

We build a ADF pipeline to copy data from delta lake to Azure SQL db. Below are Sink configuration in ADF copy activity Write Behaviour: Insert Bulk Insert Table lock: No Autocreate Table: None enable staging: Yes when the data loaded to sql table, empty…

Azure SQL Database
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,014 questions
asked 2024-01-20T03:09:35.68+00:00
Rakesh Reddy 20 Reputation points
recommended 2025-12-17T10:47:54.51+00:00
JuliaMarvin 17,290 Reputation points Volunteer Moderator
3 answers

unity catalog

Hi Team how to configure databricks untity catalog using azure free trial or any other option

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-03T09:41:52.6066667+00:00
Vineet S 1,390 Reputation points
commented 2025-12-17T07:37:49.21+00:00
VRISHABHANATH PATIL 3,225 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Can we disable public access for unity catalog metastore storage account?

Hi, I have a requirement of disabling public access for unity catalog metastore storage account which currently enabled from all networks. All my databricks which are connected to unity catalog are vnet injected Is it possible to disable public access…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-12-09T06:08:01.9633333+00:00
Sahil Chaudhry 20 Reputation points
accepted 2025-12-16T13:36:40.0533333+00:00
Sahil Chaudhry 20 Reputation points
1 answer

Unable to delete Databricks managed resource group after it's Databricks workspace deletion

I recently deleted a Databricks workspace (databricks-test), but the associated managed resource group (databricks-rg-databricks-test-wuvmnal2weo6e) still remains in my Azure subscription. When I try to delete it manually, it fails, it seems like the…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,799 questions
asked 2025-07-21T11:07:15.9933333+00:00
Balaji Krishnan 5 Reputation points
commented 2025-12-15T18:33:05.1333333+00:00
Shreya manohar Joshi 0 Reputation points