5,531 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers

Issues with Synapse Workflows After Auto-Update of Self-Hosted Integration Runtime to 5.55.9315.1 (Salesforce V2 Empty-Result Parquet Schema Regression)

Description After our Self-Hosted Integration Runtime (SHIR) auto-updated to v5.55.9315.1 on November 15, 2025, Synapse pipelines that use the Salesforce V2 connector began producing Parquet files with an incomplete schema when an incremental load…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-17T20:19:47.57+00:00
Jeff S 5 Reputation points
commented 2025-12-02T13:45:25.2466667+00:00
Jeff S 5 Reputation points
2 answers One of the answers was accepted by the question author.

Please help me restore a deleted deployment

I mistakenly deleted some deployments that were in a failed state, not knowing that these failed deployments basically deleted everything in my dev environment. I have lost all our data extraction pipelines, linked services, almost everything. From what…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-26T16:02:09.8933333+00:00
Roshan Govind 25 Reputation points
accepted 2025-12-02T09:18:01.5366667+00:00
Roshan Govind 25 Reputation points
2 answers

Trouble connecting from synapse notebook to eventhub using managed identity

I am trying to write to eventhub from synapse notebook using managed identity but hitting an error. I have enabled the session to use and have managed identity as well. Code Error: com.azure.identity.CredentialUnavailableException: Managed Identity…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-23T16:34:05.1+00:00
Tharangini Anandan 0 Reputation points Microsoft Employee
answered 2025-12-02T04:21:37.72+00:00
Pratyush Vashistha 4,815 Reputation points Microsoft External Staff Moderator
2 answers

Terraform setup to collect container logs in analytics workspace

Hello, I've got a small PoC setup involving: An AKS cluster A Log Analytics workspace A data collection rule linking the AKS cluster to the log analytics workspace When I deploy a demo namespace (the contoso pet shop) the application works, but none…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-27T14:26:43.04+00:00
Erik Heeren 60 Reputation points
commented 2025-12-02T01:17:40.21+00:00
Bharath Y P 2,480 Reputation points Microsoft External Staff Moderator
4 answers

Does ANALYZE TABLE work with Spark 3.5 and are statistics exposed to AQE?

I am running a notebook in a Spark 3.5 cluster in which I am basically using MERGE to incrementally add to my delta tables. While I was monitoring my spark log execution, I noticed messages like this: 2025-11-24 08:36:36,924 INFO…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-24T11:28:28.5+00:00
fred31330 81 Reputation points
answered 2025-11-27T16:47:46.4133333+00:00
fred31330 81 Reputation points
1 answer

I’m experiencing issues loading Netsuite transaction table data into ADLS Gen2 via an ODBC connection in Azure Synapse. What are the recommended troubleshooting steps or configuration changes to fix this?

{ "errorCode": "2200", "message": "Failure happened on 'Source' side. 'Type=System.InvalidOperationException,Message=The connection has been…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-27T15:23:44.1333333+00:00
Suraj Surendran 60 Reputation points
answered 2025-11-27T15:23:56.9666667+00:00
Q&A Assist
2 answers One of the answers was accepted by the question author.

"Cannot acquire MSI token for a Vault audience" from Azure synapse integrate pipeline

Hello, I'm trying to execute an Azure Synapse Notebook using Notebook Activity in Synapse Pipelines and it keeps coming up with errors while debuging the Pipelines, the Notebook is using mssparkutils.credentials.getSecret() and it looks like accessing…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2021-12-07T19:14:35.867+00:00
Shubham Mehta 61 Reputation points Microsoft Employee
answered 2025-11-27T10:32:07.2866667+00:00
Gopal Stemerding 0 Reputation points
3 answers

Redshift][ODBC Driver][Server]SSL error: certificate verify failed

ERROR [HY000] [Redshift][ODBC Driver][Server]SSL error: certificate verify failed ,Source=Microsoft.DataTransfer.Connectors.Odbc.OdbcConnectorV2,''Type=Microsoft.DataTransfer.Connectors.Odbc.Interop.OdbcException,Message=ERROR [HY000] [Redshift][ODBC…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-26T13:23:45.0233333+00:00
Siarhei Melnikau 0 Reputation points
edited an answer 2025-11-27T09:33:30.6433333+00:00
Pilladi Padma Sai Manisha 495 Reputation points Microsoft External Staff Moderator
2 answers

CI/CD deployment of synapse workspace failing on second set of artifacts...

I have a CICD pipeline for deploying my synapse workspace and additional artifacts to production. Step 1 (succeeds) deploys/creates the workspace. Step 2 (succeeds) uses the TemplateForWorkspace.json to deploy all the artifacts (notebooks, pipelines,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-14T20:13:57.02+00:00
Jane Illarionova 1 Reputation point Microsoft Employee
commented 2025-11-25T17:01:08.4266667+00:00
Swapnesh Panchal 1,365 Reputation points Microsoft External Staff Moderator
1 answer

Generic error when running a Synapse pipeline containing a dataflow or trying to start a debug session

I have 2 Synapse instances in UK South. Error only occurs in one of them and doesn't seem to show up in the workspace logs - 'Internal server error executing the request.' This happens when trying to start debug cluster or run a pipeline with a dataflow…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-10-17T11:46:08.4666667+00:00
MS 0 Reputation points
commented 2025-11-24T21:54:37.2133333+00:00
Manoj Kumar Boyini 1,165 Reputation points Microsoft External Staff Moderator
2 answers

Azure Synapse Link in Power Apps stopped sending new files after Oct 16 – now appending to existing files

We have an Azure Synapse Link configured with a Data Lake in Power Apps.Previously, we received new folders with date and timestamp every hour, each containing fresh data. However, since October 16th, no new timestamped folders have been created.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-05T15:41:17.4066667+00:00
Devika Dev 25 Reputation points
commented 2025-11-24T11:52:23.72+00:00
Douglas Hildebrand 0 Reputation points
2 answers

User gets "Login failed for user '<token-identified principal>'" when creating a DB in Synapse serverless SQL pool, despite having admin roles

Hi everyone, I have an Azure Synapse Analytics workspace, and I’m trying to give another user access to create a database in the Built-in serverless SQL pool. Here’s what I’ve done so far: In the Synapse workspace, under Manage → Security → Access…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-10-23T10:49:18.9866667+00:00
Priyesh Shrestha 0 Reputation points
commented 2025-11-24T09:28:58.39+00:00
VRISHABHANATH PATIL 1,725 Reputation points Microsoft External Staff Moderator
1 answer

Synapse link and security

Hi All. I am looking for any form of white paper on securing dataverse data access from synapse link/data lake and serverless synapse formerly SQL DW. From my investigation, when synapse link gets the data over to a data lake, there are concerns that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-09-12T18:04:29.38+00:00
MrFlinstone 706 Reputation points
edited a comment 2025-11-21T20:49:05.1933333+00:00
Swapnesh Panchal 1,365 Reputation points Microsoft External Staff Moderator
1 answer

Synapse Spark Pool stuck in Provisioning state and cannot be deleted

Hello Azure Support, Our Azure Synapse Spark Pool "spicebergsmall" is stuck in the Provisioning state, and we cannot delete or update it. Error Message: ResourceInUnupdatableState: Spark pool is not in a terminal state (Succeeded or Failed).…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-20T20:21:11.35+00:00
seonghyeon heo 0 Reputation points
commented 2025-11-21T18:22:46.3333333+00:00
seonghyeon heo 0 Reputation points
5 answers

unable to create dataset in azure data factory

Hi Team, I am unable to create dataset in azure data factory. i am getting the below issue Failed to load Failed to resolve the server name "dpwesteurope.svc.datafactory.azure.com", please refer to troubleshooting doc and check network…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2023-01-20T12:51:19.5566667+00:00
Ramakrishnan Sivasubramanian 0 Reputation points
answered 2025-11-21T10:12:47.76+00:00
Tayyab Awais 0 Reputation points
1 answer

Optimized Apache Spark pools cluster to run parallel notebook in Synapse

I have a cluster(apache spark pool) in azure synapse analytics of the below size With the above cluster configuration when I am using this same cluster in my synapse pipeline to run notebooks I am only able to run 8 notebooks in foreach parallelly. …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-11T13:36:17.43+00:00
ADITYA SINGH 0 Reputation points
commented 2025-11-21T07:11:54.0266667+00:00
ADITYA SINGH 0 Reputation points
3 answers

Intermittent Spark Pool Failures and Increased Startup Time After Upgrading to Spark 3.5 in Azure Synapse

We recently upgraded our Synapse Spark pools from version 3.4 to 3.5. As part of the upgrade process, we followed these steps: Removed custom packages from the pools Upgraded the Spark pool version to 3.5 Re-attached the required packages After the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-09-22T10:41:50.43+00:00
Nikhil Singh 50 Reputation points
commented 2025-11-21T04:23:12.9433333+00:00
VRISHABHANATH PATIL 1,725 Reputation points Microsoft External Staff Moderator
1 answer

Why doesn't the storage account show in the dropdown when creating an Azure Synapse Link?

Trying to create an Azure Synapse Analytics link for a newly created Azure Synapse workspace. Both the workspace and the storage account are in the same region, but the storage account doesn't show in the dropdown. Please see attached.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-19T20:35:45.9966667+00:00
Kevin Boteler 5 Reputation points
answered 2025-11-20T00:39:52.48+00:00
Swapnesh Panchal 1,365 Reputation points Microsoft External Staff Moderator
3 answers

Repeated failure to deploy an Azure Synapse Analytics workspace

I need to create an Azure Synapse Analytics workspace to support report development for our D365 Commerce project that has just started. I've created a resource group and storage account, both in the EastUS region. But I am repeatedly getting the below…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-14T02:51:43.22+00:00
Kevin Boteler 5 Reputation points
answered 2025-11-19T20:37:40.52+00:00
Kevin Boteler 5 Reputation points
2 answers One of the answers was accepted by the question author.

How to collect information of Users running Insert/Update/Delete Command on the Synapse Pool?

I am looking for a solution which collects information of users who have executed Insert/Update/Delete command on synapse. Tried the Log Analytics Route but the table SynapseSQLPoolRequests only contains Statement type and not Login ID, DMVs store 10,000…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,531 questions
asked 2025-11-10T08:45:03.1933333+00:00
Pradyumn Joshi 60 Reputation points
accepted 2025-11-19T13:48:51.5066667+00:00
Pradyumn Joshi 60 Reputation points