5,338 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

Unable to create a managed private endpoint in synapse (because it already exists)

If i try to create a managed endpoint in synapse i get the following error message: Failed to save AzureSynapseAnalytics695. Error: {"CorrelationId":null,"StatusCode":409,"Message":"Resource already exists:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-23T10:12:20.8733333+00:00
Roman Rietmann 0 Reputation points
commented 2025-05-27T12:55:25.8866667+00:00
Dileep Raj Narayan Thumula 100 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Azure Synapse: Failure happened on 'Sink' side, when copying data from ADLS2 to Cosmos database

Only for one specific dataset, copying data from ADLS2 to Cosmos database is failing. This is a consistent repro. But error details not providing any information on the reason for this issue. I see input data is working as expected. Error: {…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2022-11-23T17:17:33.777+00:00
Rosi Reddy 21 Reputation points Microsoft Employee
commented 2025-05-27T12:50:14.95+00:00
Gorie, Maria 0 Reputation points
0 answers

Extract Relationships and description

Hi Community, Greetings! I am exploring on the lake database templates in Azure synapse analytics to understand dynamics mapping. I am able to fetch the table, column and data type info with the information schema and sys tables, however I can see there…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-27T06:26:10.3233333+00:00
Hrishikesh K M 20 Reputation points
commented 2025-05-27T07:15:04.53+00:00
Hrishikesh K M 20 Reputation points
2 answers

How to pass parameter from pipeline to synapse notebook ?

Hi, I have added based parameter on my notebook from pipeline but I am unsure how I can use them in the notebook. May I know is there a way to use it ? Thanks in advance.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-09T10:31:01.6366667+00:00
Lotus88 176 Reputation points
commented 2025-05-27T05:21:23.3033333+00:00
Lotus88 176 Reputation points
0 answers

Can't ask for bigger limit for Synapse workspaces on subscription

When I try requesting a bigger limit, I'm faced with the following: So, no value is ever gonna be accepted. Also, the limit I'm told I actually have when I try creating a new workspace is 20. Couldn't open an actual support request, because it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-26T21:23:03.49+00:00
João Florido 0 Reputation points
edited a comment 2025-05-26T22:22:55.69+00:00
Chandra Boorla 12,925 Reputation points Microsoft External Staff Moderator
0 answers

There are not enough vcores resources available in the workspace while running the synapse dataflows

Hi Team, we are getting the below error dataflow while running in for each activity, Could you please help us to fix this **There are not enough resources available in the workspace, details: 'Your job requested 8 vcores. However, the workspace…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-04-15T11:09:50.6333333+00:00
commented 2025-05-26T09:45:50.72+00:00
2 answers One of the answers was accepted by the question author.

Unable to Create Azure Synapse Workspace with Free Trial Subscription

Hi Team, I'm trying to create Azure Synapse Workspace with my free trial subscription. It is failing with the error message. {"code":"ValidationFailed","message":"Workspace request validation failed, check error…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-23T11:16:28.72+00:00
Venkata Phani Pavan Kumar 20 Reputation points
accepted 2025-05-24T06:12:22.14+00:00
Venkata Phani Pavan Kumar 20 Reputation points
2 answers One of the answers was accepted by the question author.

Copying complex JSON data dynamically using Mapping Data Flows in Azure

In my current data engineering project, I am tasked with building a pipeline that can efficiently handle various JSON structures. One of the key requirements is the ability to dynamically flatten nested arrays within the JSON data using parameters, and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,532 questions
asked 2024-04-02T09:01:14.78+00:00
Curiel, H. (Hosé) 25 Reputation points
commented 2025-05-23T15:09:06.6466667+00:00
Vinay Kumar Thum 0 Reputation points
1 answer One of the answers was accepted by the question author.

Update DB when whole Synapse pipeline fail

Hi, Is there a way to update the DB (I already have a stored procedure) when the whole pipeline fail instead of update DB from individual activity ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-20T02:43:58.09+00:00
Lotus88 176 Reputation points
accepted 2025-05-23T08:36:55.02+00:00
Lotus88 176 Reputation points
1 answer

Best Practice for Excluding Linked Services from Overwrite During Azure Synapse Workspace Deployment via Azure DevOps

I've implemented a complete CI/CD system for Azure Synapse using Azure DevOps. When deploying content from the development workspace to the QA workspace, all artifacts are currently overwritten — which is expected and helps maintain consistency between…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-18T15:17:56.09+00:00
Napsty Dev 20 Reputation points
commented 2025-05-22T04:27:02.73+00:00
phemanth 15,660 Reputation points Microsoft External Staff Moderator
1 answer

How can I speed up slow queries in Synapse dedicated SQL pool?

I’m working with large fact tables in a dedicated SQL pool in Azure Synapse, and some of my queries are running pretty slow. What are the practical steps I can take to improve performance? Mainly wondering about things like table distribution,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-19T22:37:04.05+00:00
Stephen27 60 Reputation points
commented 2025-05-21T16:43:51.45+00:00
Ganesh Gurram 7,115 Reputation points Microsoft External Staff Moderator
0 answers

com.microsoft.dataflow.broker.InvalidOperationException: Only one valid authentication should be used for linkedservice

Hello, I am trying to create a linked service in synapse connecting to Azure SQL Database. The test connection works successfully with credentials in Key Vault. But when linked service used in the dataflow, the pipeline fails with below…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-19T18:33:20.6466667+00:00
Kumar, Arun 336 Reputation points
commented 2025-05-20T21:30:25.5833333+00:00
Chandra Boorla 12,925 Reputation points Microsoft External Staff Moderator
3 answers

I am not able to create a new dedicated SQL pool

I am getting below error while creating dedicated sql pool. I have upgraded my account to pay as you go but it is not reflecting even after 2 days. Also not allowing me to add resources, when i try t add from usage+quotas the button to add new quotas is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-10T07:06:23.6366667+00:00
Hitesh Narula 0 Reputation points
answered 2025-05-20T10:02:09.89+00:00
Krupal Bandari 420 Reputation points Microsoft External Staff Moderator
2 answers

How can I optimize the upsert method in a Synapse Copy activity when transferring data from ADLS (using a SQL query) to MongoDB?

I’ve built a pipeline that copies data to MongoDB using an on-demand SQL query with upsert functionality. The MongoDB collection currently holds around 300 million records. My goal is to update approximately 50,000 records daily and insert around 700,000…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-04-24T12:57:55.43+00:00
Maverick 0 Reputation points
commented 2025-05-20T09:29:35.9566667+00:00
Venkat Reddy Navari 1,950 Reputation points Microsoft External Staff Moderator
0 answers

Lake Database table created Delta Location not populating schema for Table in Synapse UI

I have migrated Synapse from one subscription to another including all the data that is stored in Storage account ( Which also consist Delta tables ). While migrating all the things got migrated except Lake Database tables in synapse workspace. Now I am…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-15T12:49:06.53+00:00
Anish, Sukhathankar 5 Reputation points
commented 2025-05-20T07:23:07.07+00:00
Anish, Sukhathankar 5 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.

Dear Support, I am receiving the following error when running a SQL Query on a Synapse Serverless Pool. Can you assist. thank you. Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2024-07-10T10:01:27.9+00:00
Doug 55 Reputation points
answered 2025-05-20T07:09:03.7933333+00:00
1 answer

Synapse Spark command execution vs job execution

I am trying to run a row count on a Synapse Spark dataframe. There are only around 14000 rows and the data frame has been materialised. The cell runs for 4 and a half minutes (command execution time), but when I look at the details beneath it, the job…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-15T14:29:57.6466667+00:00
UKjonnyb 20 Reputation points
commented 2025-05-19T17:28:16.8433333+00:00
Chandra Boorla 12,925 Reputation points Microsoft External Staff Moderator
3 answers

SAP Table Connector - How to querying SAP table using RFC from Azure Synapse

Hello Experts, We are using SAP Table Connector on Azure Synapse to extract SAP tables. However, we would like to filter the data in the copy activity. I tried using the RFC table options using the COLUMN EQ 'SOME VALUE' pattern, This…

SAP HANA on Azure Large Instances
SAP HANA on Azure Large Instances
Microsoft branding terminology for an Azure offer to run HANA instances on SAP HANA hardware deployed in Large Instance stamps in different Azure regions.
126 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,532 questions
asked 2022-12-27T23:17:26.193+00:00
Rafael Mendonca 1 Reputation point
answered 2025-05-19T10:55:04.7633333+00:00
Marc Cases 0 Reputation points
1 answer

Error code 11408: The operation has timed out. Id. de actividad

Hello, I am starting with Azure Synapse, and when I want to ingest data with a copy, when I configure the connection to the data source (In this case, it is HTTP with a URL), I get this error, and I don't know why. I have configured the storage account…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-14T14:47:58.8666667+00:00
Juan Esteban Mahecha Trujillo 20 Reputation points
commented 2025-05-16T11:14:18.1433333+00:00
Venkat Reddy Navari 1,950 Reputation points Microsoft External Staff Moderator
0 answers

Change Feed in Synapse Link for SQL Server 2022 – Getting change data as CSV file without header and starting with 4 meta data columns

I'm using Azure Synapse Link with SQL Server 2022 (on-premises), and my change data is being stored in ADLS Gen2 as CSV files. I’ve observed that the first four columns in the CSV files contain metadata, but I couldn't find clear documentation explaining…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,338 questions
asked 2025-05-13T09:30:08.7166667+00:00
Vignesh K 20 Reputation points
commented 2025-05-15T11:53:24.98+00:00
Vignesh K 20 Reputation points