Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
1 answer
how to grand MI/SP permission for ALL upstream folders and the file system?
Hi, good morning. I have the error below and I would like to know how to fix it. I am using the Azure Data Factory to load data from Azure Blob Storare. The connection between Azure Data Factoty and Blog Storare are OK. The data factory can reach the…
Azure Data Factory
asked 2025-11-05T03:10:15.65+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 40%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECE%3C/text%3E%3C/svg%3E)
CARLOS EDUARDO TEBALDI
0
Reputation points
commented 2025-11-07T19:07:57.43+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator
1 answer
Need Help with Detailed Notification Setup for ADF Pipeline
Hi Team, I have configured notification emails in Logic Apps for ADF pipeline success and failure alerts. Currently, we are only receiving notifications indicating whether the pipeline ran successfully or failed. However, I would like to enhance this by…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-05T16:04:41.9933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
731
Reputation points
commented 2025-11-07T19:04:38.05+00:00
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator
1 answer
What is this error code: 11402?
The value of the property '' is invalid: 'Unknown SQL type - -99.'. Unknown SQL type - -99. I keep getting this error when trying to copy certain tables from a DB2 database with the ODBC connector. Most of the tables copied with no problem. I've…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-05T21:26:41.02+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 46%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AE90
85
Reputation points
commented 2025-11-07T18:49:38.84+00:00
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator
1 answer
How to Implement Error Logging at Sink in Azure data Factory when use Dataverse as destination
I want to know how to implement error logging in azure data factory when we use Dataverse as destination or Sink in Copy data activity.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-07T06:31:54.8266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 70%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Mareedu, Tulasiram (Cognizant)
0
Reputation points
answered 2025-11-07T06:32:39.3166667+00:00
Q&A Assist
2 answers
How to cast columns from multiple tables as new data type?
I'm migrating a bunch of tables from a DB2 database to Azure Data Lake. Several of these tables have CLOB and BLOB column types, which Data Lake doesn't recognize. How do I convert them in Data Factory? I have a look up query that gets the columns…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-03T21:19:57.6133333+00:00
AE90
85
Reputation points
edited an answer 2025-11-07T05:24:50.2166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 13%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Pratyush Vashistha
4,410
Reputation points Microsoft External Staff
Moderator
1 answer
ADF Branching and Release Management Strategy
Hello Team, Is there any Git Branching & Release Strategy available for ADF which we can use for multiple teams with multiple features can be worked together and can be released independently to higher environment from DEV to TEST, UAT and…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-05T15:57:08.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 27%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKD%3C/text%3E%3C/svg%3E)
Kaushik Dutta
40
Reputation points
commented 2025-11-07T04:50:23.6733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 2%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Manoj Kumar Boyini
590
Reputation points Microsoft External Staff
Moderator
1 answer
Multiple triggers runs for a single pipeline
Is there any limitation of parallel runs of same pipeline with multiple triggers. I have a pipeline called pip_generic ,and there are some 50 linked triggers associated with this pipeline. While scheduling how many can I schedule in same time , so that…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-07T02:34:37+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 76%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Abirami subramani
0
Reputation points
answered 2025-11-07T02:34:50.3833333+00:00
Q&A Assist
1 answer
When using "Copy data" recursively to copy by last modified, what is the difference between "File path in dataset" vs "Wildcard file path"?
A pipeline that copies files from Source to Destination runs every 2 hours and at one point few weeks ago it missed files in the source that were modified and not copied to the Destination. The files were in a subdirectory. When I reran the pipeline with…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-04T13:24:41.04+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 83%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVO%3C/text%3E%3C/svg%3E)
Vadim O
0
Reputation points
commented 2025-11-06T19:07:10.2866667+00:00
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator
1 answer
One of the answers was accepted by the question author.
How to add properties when running batch endpoints using REST API?.
We currently have a pipeline in ADF that we are using to train a given model using Pipelines components, and if we check this doc PipelineJob we can see the properties available, that way I am being able to use displayName, tags, etc normally for…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-10-07T21:06:58.02+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 65%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGM%3C/text%3E%3C/svg%3E)
Guilherme Matheus
140
Reputation points Microsoft Employee
edited the question 2025-11-06T19:03:33.32+00:00
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Azure Jira Connector - Upgraded Version and Dataset Warning.
When trying to upgrade my Azure Linked Service to the new (non-deprecated) version of Jira Connector, my dataset referencing the new linked service will not update (still getting the warning "...older version will be deprecated soon. ..." on…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-10-13T19:50:49.1433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 17%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGD%3C/text%3E%3C/svg%3E)
Gue, David
110
Reputation points
accepted 2025-11-06T18:16:42.8933333+00:00
Gue, David
110
Reputation points
1 answer
Unable to connect to Smartsheet from ADF using Token
There are 4 Smartsheet in which I am able to connect to 3 of them using a token, whereas getting the error while trying to connect to 4th Smartsheet using the same Token. This token was used earlier and started to fail now. Error - The gateway did not…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-06T16:50:08.1+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 37%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKI%3C/text%3E%3C/svg%3E)
Keerthi Ingalahalli
0
Reputation points
answered 2025-11-06T17:52:39.1566667+00:00
hossein jalilian
13,200
Reputation points
Volunteer Moderator
0 answers
Send Calculated Insights data from Data Cloud (Salesforce) to Azure blob storage.
Hello Team, We have a requirement to send Calculated Insights data from Data Cloud (Salesforce) to Azure blob storage. Can we do it by exposing API. I believe a new linked service has to be created for Salesforce on Azure Data Factory. I see there are…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-05T08:52:30.7633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 16%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMR%3C/text%3E%3C/svg%3E)
Mahadev, Rakesh [HAEA]
225
Reputation points
commented 2025-11-06T15:45:58.7066667+00:00
Mahadev, Rakesh [HAEA]
225
Reputation points
6 answers
One of the answers was accepted by the question author.
Unable to download Purview exports
Hello I have tried to download the export packages from the ediscovery menu. I have tried on mac & linux Edge and firefox browsers. When I push the download button, nothing happens. The close button does work. Is there another way to access these…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-03-03T07:21:08.6833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 10%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECL%3C/text%3E%3C/svg%3E)
Christopher Lowden
185
Reputation points
commented 2025-11-06T13:38:23.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 87%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Phillip Pennicott
0
Reputation points
1 answer
One of the answers was accepted by the question author.
ADF storage event trigger pipeline triggered by SFTP upload in storage account. Filters are deleted if trigger is stopped and start.
Hi everyone, When you create a storage event trigger in Azure Data Factory, it automatically creates a new Event Grid system topic along with a webhook subscription: To ensure that the trigger works when you upload files to the storage account using…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2024-08-15T16:06:25.88+00:00
Paul Hernandez
686
Reputation points Microsoft Employee
commented 2025-11-06T12:57:34.5733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 4%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Mohammed Siddiq Cheruvu
25
Reputation points
1 answer
Pipeline disappeared from Azure Data Factory Author tab; need help to restore without Git.
My Azure Data Factory pipeline suddenly disappeared from the Author tab, even though the last pipeline run completed successfully. I’m not using Git integration. The factory name is tokyonewproject-df01. Please guide me to restore the pipeline or recover…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-10-31T14:58:40.31+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 83%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
Sandhya Adapa
0
Reputation points
commented 2025-11-06T12:25:58.04+00:00
Manoj Kumar Boyini
590
Reputation points Microsoft External Staff
Moderator
1 answer
One of the answers was accepted by the question author.
Enable Data Factory access to users under resource group
I have a resource group named RG-DF, which contains Azure Data Factory. I have granted Data Factory Contributor role to the relevant users under this resource group. However, the users are unable to access the data factory. Are there any steps needed to…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-10-28T05:46:11.72+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 20%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECH%3C/text%3E%3C/svg%3E)
Chun Hanssen
110
Reputation points
accepted 2025-11-06T10:46:29.98+00:00
Chun Hanssen
110
Reputation points
1 answer
PowerBI charts do not load for users I've shared the dashboard with, the navigation buttons work though.
I'm having issues sharing my PowerBI dashboard with consumers and need some SME help. I have a MS Fabric workspace with an F16 capacity. All my data is stored within my OneLake data Lakehouse I've created a semantic model using the tables from the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-06T07:30:00.42+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 82%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHJ%3C/text%3E%3C/svg%3E)
Humberto Jimenez
0
Reputation points
answered 2025-11-06T10:09:49.4866667+00:00
Amira Bedhiafi
40,576
Reputation points
Volunteer Moderator
1 answer
how do i fix Auto table creation in sink side is not applicable for your sink dataset
Auto table creation in sink side is not applicable for your sink dataset It seems that i cannot auto create tables in a Azure Sql Server when table names are parameterized when trying to debug run it tells me …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-06T09:44:40.7666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 34%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESH%3C/text%3E%3C/svg%3E)
Simon Højberg Jespersen
0
Reputation points
answered 2025-11-06T09:44:56.6866667+00:00
Q&A Assist
1 answer
One of the answers was accepted by the question author.
Copy files from SharePoint document library to Blob using client certificate authentication in Azure Data Factory
Hi everyone, I’m trying to copy files from a SharePoint document library to Azure Blob Storage using Azure Data Factory, with client certificate–based authentication (no username/password or client secret). Here’s the setup and issues I’m facing: I…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-11-04T06:42:44.54+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 68%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB1%3C/text%3E%3C/svg%3E)
BharathKumarS-1759
60
Reputation points
accepted 2025-11-06T03:55:29.32+00:00
BharathKumarS-1759
60
Reputation points
4 answers
Failed to run resource validation using @microsoft/azure-data-factory-utilities on Github
Hi Team, I am creating a workflow for ADF deployment on GitHub and encountering an issue when running the npm validate command. The validation fails with the following error: ERROR === Validator: Unhandled validation error for: pipeline - ***, error:…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,926 questions
asked 2025-10-23T13:20:01.8266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 85%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES3%3C/text%3E%3C/svg%3E)
ShaikNisharunnisa-3795
30
Reputation points
answered 2025-11-06T02:20:38.51+00:00
ShaikNisharunnisa-3795
30
Reputation points