Cannot access secrets from notebook call by pipeline
Hi, I have grant secrets permission to my Synapse workspace and my microsoft entra ID. I have notebooks that read the secrets created by me. I can run the notebook to access my secrets and it is working. However when I tried to run the notebook from…
Azure Synapse Analytics
Create DB identity in synapse notebook
Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…
Azure Synapse Analytics
Issues with Synapse Workflows After Updating Self-hosted Integration Runtime
After updating the Self-hosted Integration Runtime to version 5.54.9267.1 from 5.44.xx on June 10th, the pipeline runs that previously completed in about 30 minutes are now taking several hours and worsening daily. The Integration Runtime operates…
Azure Synapse Analytics
How to resolve an error with too many vcores being requested?
I'm trying to run a simple script on a spark notebook. But I keep running into this error. Your Spark job requested 672 vcores. However, the workspace has a 12 core limit. The script in itself should not require that many vcores as it is only checking…
Azure Synapse Analytics
Not able to create an azure synaps analytics workspace in west europe
I'm trying to create an Azure Synapse Analytics workspace located in westeurope but when I try, I recieve the error: {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for…
Azure Synapse Analytics
There are not enough vcores resources available in the workspace while running the synapse dataflows
Hi Team, we are getting the below error dataflow while running in for each activity, Could you please help us to fix this **There are not enough resources available in the workspace, details: 'Your job requested 8 vcores. However, the workspace…
Azure Synapse Analytics
Can't ask for bigger limit for Synapse workspaces on subscription
When I try requesting a bigger limit, I'm faced with the following: So, no value is ever gonna be accepted. Also, the limit I'm told I actually have when I try creating a new workspace is 20. Couldn't open an actual support request, because it…
Azure Synapse Analytics
Unable to create a managed private endpoint in synapse (because it already exists)
If i try to create a managed endpoint in synapse i get the following error message: Failed to save AzureSynapseAnalytics695. Error: {"CorrelationId":null,"StatusCode":409,"Message":"Resource already exists:…
Azure Synapse Analytics

com.microsoft.dataflow.broker.InvalidOperationException: Only one valid authentication should be used for linkedservice
Hello, I am trying to create a linked service in synapse connecting to Azure SQL Database. The test connection works successfully with credentials in Key Vault. But when linked service used in the dataflow, the pipeline fails with below…
Azure Synapse Analytics
Lake Database table created Delta Location not populating schema for Table in Synapse UI
I have migrated Synapse from one subscription to another including all the data that is stored in Storage account ( Which also consist Delta tables ). While migrating all the things got migrated except Lake Database tables in synapse workspace. Now I am…
Azure Synapse Analytics
Change Feed in Synapse Link for SQL Server 2022 – Getting change data as CSV file without header and starting with 4 meta data columns
I'm using Azure Synapse Link with SQL Server 2022 (on-premises), and my change data is being stored in ADLS Gen2 as CSV files. I’ve observed that the first four columns in the CSV files contain metadata, but I couldn't find clear documentation explaining…
Azure Synapse Analytics
Deltalake change data feed on synapse notebook
Hi Team, Could you please help us we are looking to enable change data feed to existing delta file but it is not working, we have used below steps to enable. set spark.databricks.delta.properties.defaults.enableChangeDataFeed =…
Azure Synapse Analytics
When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message.Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.
When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message. Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.
Azure Synapse Analytics

errorCode": "2402 unable to load bulk data using COPY command to table
I am unable to execute COPY command to table . COPY INTO stg.Temp_FctSOSTracking_TPS_India FROM 'https://mfgdasynapseprod01sa.dfs.core.windows.net/landing/RSA/2024-02/2024-02-07/2024-02-07_00:00/fct_sos_details_*.csv' WITH ( FILE_TYPE='CSV', FIRSTROW=2,…
Azure SQL Database
Azure Synapse Analytics
How to fix an established connection was aborted by the server error while making SFTP connection using Azure Synapse?
Hello Team, While we are trying to connect SFTP using SSH public key authentication we are getting following error. Established connection was aborted by the server let me share the steps which we followed so far to connect the sftp. [1] Open PuttyGen…
Azure Synapse Analytics
Azure Data Factory
How to create a incremental pipeline in dataflow need to delete records if that is not present in source
Hi Team, Could you please help us, we have to create incremental pipeline in synapse dataflow, we should have to handle insert, update and delete(if the record not present in source we have to delete in target Azure sql), can you please confirm is it…
Azure Synapse Analytics
Spark 3.4 not supporting CDM
Hello I have a problem. Currently, we run notebooks that are connected to Dataverse via an Azure Synapse link. Within these notebooks, data is read into CDM. However, Microsoft has stated that Spark Pool 3.4 does not support the CDM connector. What…
Azure Synapse Analytics
Error generated in Synapse when I query dataverse data in Spark Notebook
Hey there, I am having an issue querying the data from the Synapse Link for Dataverse in a Spark Notebook within Synapse. I am able to run a SQL query against the data (which appears in Synapse as a Lake Database) and it returns data. See below …
Azure Data Lake Storage
Azure Synapse Analytics
Developer technologies | .NET | .NET Machine Learning
Unable to generate MSI token from Synapse while writing data to ServiceBus and EventHub
As per doc https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/microsoft-spark-utilities?pivots=programming-language-scala only the services for which Audience is available in list are allowed to generate a token using MsSparkUtils credential…
Azure Synapse Analytics
Error : External table 'habitant_gold' is not accessible because location does not exist or it is used by another process.
When I run my code : CREATE DATABASE datalake_gold_db; CREATE MASTER KEY ENCRYPTION BY PASSWORD ='Welcome@MS92'; CREATE DATABASE SCOPED CREDENTIAL MyCred WITH IDENTITY='SHARED ACCESS SIGNATURE', SECRET='SAS Token'; CREATE EXTERNAL DATA SOURCE…