Getting error message "Invoking Azure function failed with HttpStatusCode - Unauthorized"
I have a synapse pipeline which contains a single component, an azure function activity component. The objective is to send a test JSON payload to a private endpoint using POST call. The azure function activity is configured to use the POST method and an…
How to Retrieve the Original SELECT Statements
At present, the data warehouse contains numerous views, and I need to modify several of them. The challenge is that I’m not sure how these views were originally created. Is there a query in Synapse to check the view definitions, particularly the SELECT…
Trouble Granting Managed Identity Access for Pausing/Resuming Azure synpase
I’m fairly new to Azure and even though this might seem like a simple task, I’m finding it challenging. I’ve set up an Azure Synapse workspace with a dedicated SQL pool, and my assignment is to schedule pausing and resuming the pool. I followed a…
Unable to see all the lake database tables in synapse workspace
Hello, I am unable to see the Lake Database tables inside db blade on left side of synapse workspace, only few are visible but rest are not visible but I am able to see them through SSMS and also execute query on them. In fact, these tables are not…
Encrypt data on transit - Oracle OCI to Azure Synapse -
Hello - We are implementing a solution like this: Extract data from Oracle OCI database use Azure Synapse Analytics Store Data to Data lake gen 2 We have created linked service in Synapse to connect to oracle OCI db We have been asked how to make…
Azure Synapse pipeline copy data activity from on-prem to Azure sql db issue
{ "errorCode": "2200", "message": "ErrorCode=SqlFailedToConnect,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Cannot connect to SQL Database. Please contact SQL server team for further…
How to Set Up Automatic D365 Finance and Operations Data Replication to Azure Data Lake for Reporting?
Hi everyone, We have a D365 Finance and Operations environment hosted in the Central US region. Our Accounts Receivable (AR) data, including customers and invoices, is integrated from an on-premises Oracle database into D365 FinOps. I would like to…
Not able to run notebooks in spark cluster
Exception: Failed to create Livy session for executing notebook. Error: Your Spark job requested 12 vcores. However, the workspace has a 0 core limit. Try reducing the numbers of vcores requested or increasing your vcore quota.
adf/synapse - how to copy all files based on given lastmodified date from source container and save in sink container in respective folder based on extension
Req: Copy files from one container and store in another container- I am specifying the last modified date , i want to copy files only before that last last modified date. The files are of any type. csv,xml,json,txt etc. Also, in source container my files…
Dynamic Mapping of Source to JSON Sink in Azure Data Factory
We are able to preview the source data from the Salesforce linked service in ADF, and I can also view the sink data using the REST linked service for Business Central in ADF. However, I'm facing an issue where importing the schema is not supported…
Access roles and Permission
Hi Team, We need to access synapse views from power bi and create dashboard reports. We have created AD group and provided SQL grant access to the AD groups. What else do we require so the power bi users can have least privileged access. Is it Synapse…
DATA_COMPRESSION = COLUMNSTORE_ARCHIVE not working for partitioned table
I created partition table(24 partition) with DISTRIBUTION = ROUND_ROBIN, CLUSTERED COLUMNSTORE INDEX . Table size was 300 GB but after DATA_COMPRESSION = COLUMNSTORE_ARCHIVE the size increased many folds(7-8 times).Does partitioned table archive is not…
How to troubleshoot Azure Synapse Link failing to create/modify model.json
Hello, I am having issues with Azure Synapse Link failing to create or modify the model.json file in the blob. This only started happening yesterday. Can someone provide advice on what might be causing this issue and how to resolve it? Thank you. Best…
Notebook clusters in pipeline parallel processes
I have a pipeline triggered daily which loops through a list of notebooks, and runs them using a cluster in a for each run in parallel. At the moment I have seven notebooks running and adding more over time. What would happen when the cluster runs more…
How to configure use of access token and API key in a linked service
Authorization and x-api-key headers have been added to linked service for connection to C365 cloud service. Can't understand reason for error. Please help { "errorCode": "2200", "message": "Failure happened on 'Source'…
Open row source
nsnapshot.txt Hi, how to run json file on synapse workspace.. Tried with open row set but not working.. Pls share screenshot if sny
How to query in synapse pipeline activity runs using api
Hi, How to query in synapse pipeline activity runs using api, i want to know inside pipeline how many activities we are running per day any option is there to find out this in synapse
Creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory
Hi everyone, I’m working on creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory. Here are the steps I’ve taken so far: Copy Data: I’m using the Copy Data activity to get the data into a CSV file. Azure Blob…
Can we execute Synapse Spark Notebook on synapse workspace from azure DevOps pipeline ?
Hi, I want to know Can I execute Synapse Spark Notebook on synapse workspace from the Azure DevOps pipeline ?
How to overwrite a table from SQL Server to SQL Dedicated Pool using Copy Data Activity in Azure Synapse Analytics
I am trying to use the Copy Data Activity in Azure Synapse Analytics to copy data from SQL Server to SQL Dedicated Pool. However, I want to ensure that every time I run the Copy Data Activity, the table in SQL Dedicated Pool is overwritten. How can I…