12,095 questions with Azure Data Factory tags

Sort by: Updated
1 answer

ADF Custom Activity for Batch accounts intermittently throws error 'XML nodes is not in the correct format'

I have multiple pipelines that use ADF Custom Activity to Batch Account. They normally run successfully. However they were failing consistently for 18 hours yesterday with the following error " The value for one of the XML nodes is not in the…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-16T16:18:51.5333333+00:00
Sonika Sharma 40 Reputation points Microsoft Employee
answered 2026-03-19T14:17:58.3066667+00:00
Manoj Kumar Boyini 10,340 Reputation points Microsoft External Staff Moderator
2 answers

Storing REST API Response as Raw JSON in SQL Table Instead of Mapped Columns in Azure Data Factory

I am using Copy Activity in Azure Data Factory in which I am using REST API for getting the Response from the API I am getting an array contain multiple JSON. I wanted to Store the Response as a Raw Format in the SQL Table but In the Mapping I am getting…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-13T16:56:23.03+00:00
Shayan Siddique 0 Reputation points
commented 2026-03-19T02:31:14.0766667+00:00
SAI JAGADEESH KUDIPUDI 795 Reputation points Microsoft External Staff Moderator
1 answer

Handling Nested JSON Arrays from Business Central APIs using Rest in Azure Data Factory – Best Approach?

I’m building a dynamic ingestion pipeline in Azure Data Factory to load data from Microsoft Business Central APIs into Azure SQL staging tables, and I’ve encountered several challenges related to the JSON structure returned by the API. A typical Business…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-17T06:12:33.5933333+00:00
Riddhi 0 Reputation points
commented 2026-03-18T22:54:28.62+00:00
Pilladi Padma Sai Manisha 5,480 Reputation points Microsoft External Staff Moderator
1 answer

Copy Merchant Data, Error: Failure happened on 'Sink' side. ErrorCode=UserErrorDocumentDBWriteError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Documents failed to import. Error message:Missing partition key header for point

Operation on target ForEach failed: Activity failed because an inner activity failed; Inner activity name: Copy Merchant Data, Error: Failure happened on 'Sink' side.…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-16T07:21:35.49+00:00
Venkat Pendyala - Azure 5 Reputation points
commented 2026-03-18T14:45:28.28+00:00
YUZUKI AYASE 116 Reputation points
1 answer

ADF to Snowflake sync setup UPSERT

I Azure Data Factory pipeline setup to sync data into my Snowflake account. Currently I use Snowflake V2 connector, but in my Copy Data action I can't select it to be UPSERT as INSERT duplicates entries which is not correct in my case. How can I setup…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-18T10:06:43.4433333+00:00
Lina Vaitkiene 0 Reputation points
answered 2026-03-18T11:10:26.1266667+00:00
Jorre De Backer 0 Reputation points
1 answer

Dataflow UTF8 withoutBOM is wrong

According to the article https://learn.microsoft.com/en-us/azure/data-factory/format-delimited-text data flow doesn't support UTF-8 encoding with Byte Order Mark (BOM) but support UTF8 without bom. I made a test but the result diversed. I made dataset…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-17T03:58:40.2466667+00:00
Li, Xingjian 0 Reputation points
answered 2026-03-18T10:40:25.0033333+00:00
Smaran Thoomu 34,155 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

How to fix: Request Id: fccd854a-cfc2-43a1-89dd-0403c2493700 Correlation Id: 4fb66761-4ec3-477e-8c3b-d9c2a5c8562e Timestamp: 2024-01-16T19:29:03Z Message: AADSTS900561: The endpoint only accepts POST requests. Received a GET request.

Request Id: fccd854a-cfc2-43a1-89dd-0403c2493700 Correlation Id: 4fb66761-4ec3-477e-8c3b-d9c2a5c8562e Timestamp: 2024-01-16T19:29:03Z Message: AADSTS900561: The endpoint only accepts POST requests. Received a GET request. I can´t login in the web anymore…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2024-01-16T19:32:51.41+00:00
Guillermo Camacho 45 Reputation points
answered 2026-03-18T09:28:10.1133333+00:00
nasirbaba-3576 0 Reputation points
1 answer

SharePoint Online ACS Retirement - What's the correct way to migrate Azure Data Factory (ADF) SPO List Linked Services

As per the title, I couldn't find any way I can use ADF Linked Services to ingest SharePoint Online List through copy data etc. I found a guide towards File / Library. But not Normal list without the usage of ACS. I've done everything that is needed in…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-14T08:24:02.1666667+00:00
ZuheirZ 41 Reputation points
commented 2026-03-18T05:48:56.1766667+00:00
Smaran Thoomu 34,155 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Error code - 23353 Getting Error 403 Forbidden while using the copy activity

I am using the copy activity and when i use the mapping section then this showing the error - Rest call failed with client error, status code 403 Forbidden, please check your activity settings. Request URL:…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-13T12:51:14.19+00:00
nishant garg 20 Reputation points
accepted 2026-03-18T05:26:19.51+00:00
nishant garg 20 Reputation points
2 answers

Moving SHIR binaries from C: to D: drive

Hi, We have installed Microsoft Selfhosted Integration Runtime(SHIR (both Azure and On‑Premises) on a virtual machine, where the default installation is on the C: drive. We came to know that there is a possibility to move the SHIR binaries from C: to…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-03T10:26:47.0033333+00:00
Seshamanikumarchava-6950 0 Reputation points
commented 2026-03-17T10:34:01.58+00:00
Manoj Kumar Boyini 10,340 Reputation points Microsoft External Staff Moderator
1 answer

Invalid linked service properties provided. The length of argument 'password' exceeds its limit of '128'.

Invalid linked service properties provided. The length of argument 'password' exceeds its limit of '128'.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-14T06:20:27.13+00:00
Lorence Xevier Lakra 0 Reputation points
answered 2026-03-17T06:39:44.5033333+00:00
Smaran Thoomu 34,155 Reputation points Microsoft External Staff Moderator
2 answers

Adf Pipeline created date

Hi Team, How can we find the excat adf pipeline created date. I tried to get detils from Activity log but i can see ony 3 months data can be fetched. Please suggested how can i get the pipeline creation date. Regards Saim

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-12T10:32:27.0266667+00:00
shamim 0 Reputation points
commented 2026-03-15T09:07:19.25+00:00
Manoj Kumar Boyini 10,340 Reputation points Microsoft External Staff Moderator
2 answers

What are the supported Open SSH Key Formats when it is using in Azure ADF - Linked services for SFTP access

Hi, I created a ADF Linked services with Open SSH key for SFTP access. It is supports only with RSA format key but not ECDSA format. As per the security requirement, I need to use only ECDSA format. Please help me to provide the suggestions and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-09T17:29:46.63+00:00
Lekkala, MuraliKrishna 0 Reputation points
commented 2026-03-15T09:03:35.4333333+00:00
Manoj Kumar Boyini 10,340 Reputation points Microsoft External Staff Moderator
2 answers

Connection to UiPath with Service Principal in Azure Data Factory

Dear All, I'm very new to Azure Data Factory and recently I got a request to connect to UiPath using Service Principal. I have received Directory (tenant) ID, Application (client) ID, Client secret Value and Secret ID. I could also see that it is already…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-09T13:39:25.3066667+00:00
WerciaS 0 Reputation points
commented 2026-03-15T09:03:09.6466667+00:00
Manoj Kumar Boyini 10,340 Reputation points Microsoft External Staff Moderator
0 answers

ADF - Az function activity 499 error

WE get an error while executing azure function activity inside adf pipeline. Azure function is calling an API and extracts and stores the data returned by api to a storage account. Call to provided Azure function 'api_blob' failed with status-'499'…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-09T06:54:47.4266667+00:00
Santhi Dhanuskodi 365 Reputation points
commented 2026-03-13T19:43:09.2766667+00:00
SAI JAGADEESH KUDIPUDI 795 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Fix format of a datetime column in Copy Activity's Mapping section

We have set format of a Datetime column to "G" and "en-US" in mapping section of copy activity. Here our source is Azure SQL db and Destination is ADLS. The format of the datatype is as expected. Here is the type conversion setting:…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-10T05:26:33.38+00:00
BadMan 40 Reputation points
edited the question 2026-03-13T14:04:27.8333333+00:00
Manoj Kumar Boyini 10,340 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Can the Azure SQL database be scaled up (in the DTU model) automatically before running a pipeline and then scaled down afterwards?

I have several pipelines in ADF that when executed write data to an azure sql database. I am using the Standard DTU model for the pricing tier. Using any available ADF activities, can the Azure SQL database be scaled up (in the DTU model) automatically…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-12T23:23:07.55+00:00
Caesar 20 Reputation points
accepted 2026-03-13T04:46:03.2933333+00:00
Caesar 20 Reputation points
0 answers

How to Call a ORACLE DATABASE PACKAGE from Azure data factory and receive the output of that package.

Team I need to call a ORACLE DATABASE PACKAGE from azure data factory and use its output in other activities but i am not able to call a PACKAGE. Inside the package there are many stored procedures written so i need to call a specific stored procedure…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2025-03-05T11:24:06.85+00:00
ADFUser 1 Reputation point
edited a comment 2026-03-13T00:19:57+00:00
LEIGHTON Olivia 0 Reputation points
2 answers

I have to copy data from share point (Unstructured Data Photo/Video)to Azure blob storage using ADF pipeline

Can anyone tell me which activities I have to use as well which access I have required on share point level as well On Entra ID As well which linked service I have to use

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-11T20:25:46.23+00:00
Prashant Vidhate 0 Reputation points
answered 2026-03-12T17:20:21.8933333+00:00
Manoj Kumar Boyini 10,340 Reputation points Microsoft External Staff Moderator
1 answer

Column level type conversion in Mapping section of Copy Activity in Azure Data Factory.

Earlier, I used to get the option to change type conversion settings of a particular datetime column in mapping section of a copy data activity. Here my source is Azure SQL DB and Destination is Azure blob storage. Now, If I am changing my source to…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,095 questions
asked 2026-03-11T08:19:27.9433333+00:00
BadMan 40 Reputation points
commented 2026-03-12T06:03:49.7533333+00:00
Smaran Thoomu 34,155 Reputation points Microsoft External Staff Moderator