Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
0 answers
How can I connect my Linked Service to other cloud databases through a managed integration runtime (IR)?
Scenario: Azure Cosmos DB NoSQL migration to Huawei Cloud DDS, with Azure Data Factory replicating the active migration data. The Azure public cloud IP range has been enabled in the security group of the target cloud database. My tag is…
Azure Data Factory
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 62%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
1 answer
We are facing an issue while copying data from Oracle to Azure SQL using ADF Copy Activity.
We are facing an issue while copying data from Oracle to Azure SQL using ADF Copy Activity. The pipeline fails or produces incorrect numeric values due to high-precision decimals in Oracle. Details: Source (Oracle): TABLE_FIN Target (Azure SQL):…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-13T05:33:24.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 73%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anandhswarupp
205
Reputation points
answered 2025-11-13T05:33:49.8233333+00:00
Q&A Assist
1 answer
We are facing an issue while copying data from Oracle to Azure SQL using ADF Copy Activity.
We are facing an issue while copying data from Oracle to Azure SQL using ADF Copy Activity. The pipeline fails or produces incorrect numeric values due to high-precision decimals in Oracle. Details: Source (Oracle): TABLE_FIN Target (Azure SQL):…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-13T05:27:27.8133333+00:00
Anandhswarupp
205
Reputation points
answered 2025-11-13T05:27:54.2233333+00:00
Q&A Assist
1 answer
How to add an additional QueryParameter to a RestAPI after the first call for Pagination?
In my Data Factory setup every job reads the config for that job and passes that config to the Copy Data Activity. To retrieve data from a RESTAPI I use the base url and the relative url along with the query parameters for that call which generally…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 28.000000000000004%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
1 answer
How to fix tablular data type error in ADF?
I am consistently getting this error recently after my pipeline had ran successfully for over a year. My data source is a PostgreSQL api, but I have no clue why it has all of a sudden stopped working Operation on target Copy Canvas Billing Reporting…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-12T22:22:40.16+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 22%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBH%3C/text%3E%3C/svg%3E)
Brodey Heaton
0
Reputation points
answered 2025-11-12T22:23:03.0966667+00:00
Q&A Assist
1 answer
Azure Data Factory - Azure SSIS Runtime Start Faild with InternalServerError
Hello, 2 out of 3 of our ADF Azure SSIS Runtime fail to Start with "InternalServerError", the 3rd one is up. 1 was starting without issue on the 6th of November, the other one on the 24th of October. We didn’t make any change to their…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-12T13:02:15.65+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 44%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA1%3C/text%3E%3C/svg%3E)
AurelienBAUX-1854
20
Reputation points
edited a comment 2025-11-12T18:51:50.84+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 72%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Swapnesh Panchal
845
Reputation points Microsoft External Staff
Moderator
1 answer
How do I delete old folders from multiple subfolders in ADLS through ADF pipeline using delete activity
/has/MainFolder/SubfolderA/2024-11-23/abcd.csc /raw/MainFolder/SubfolderBf/2023-02-05/acj.csv /has/MainFolder/Subfolderc/2024-12-23/c.csv /has/MainFolder/SubfolderB/2024-03-05/ac.csv /has/MainFolder/Subfolderd/2024-09-13/abcde.csv I am trying to delete…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-12T15:16:24.8333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 91%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHL%3C/text%3E%3C/svg%3E)
Hasnain Lokhandwala
0
Reputation points
answered 2025-11-12T15:16:49.6766667+00:00
Q&A Assist
1 answer
Clarification on Azure Data Factory metrics — ResourceCount, MaxAllowedResourceCount, FactorySizeInGbUnits, and MaxAllowedFactorySizeInGbUnits
Hi Team, Referring to the documentation: 🔗 Azure Monitor metrics for Microsoft.DataFactory/factories I would like to get a detailed description and usage clarification for the following four metrics: …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-12T13:20:54.5533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 82%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC%3C/text%3E%3C/svg%3E)
cloudteam
60
Reputation points
answered 2025-11-12T13:21:15.06+00:00
Q&A Assist
2 answers
Multiple triggers runs for a single pipeline
Is there any limitation of parallel runs of same pipeline with multiple triggers. I have a pipeline called pip_generic ,and there are some 50 linked triggers associated with this pipeline. While scheduling how many can I schedule in same time , so that…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-07T02:34:37+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 76%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Abirami subramani
0
Reputation points
answered 2025-11-12T07:16:14.4533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 13%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Pratyush Vashistha
4,650
Reputation points Microsoft External Staff
Moderator
1 answer
how to fix : Client IP not authorized to access the API error while debug running any pipeline in ADF
Hi All, I get the inline error while triggering/debugging an ADF pipeline. I am able to configure the pipeline without any issues. Any guidance around this is much…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-11T23:31:45.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 32%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPR%3C/text%3E%3C/svg%3E)
Poonam Raikar (ALLEGIS GROUP HOLDINGS INC)
0
Reputation points Microsoft External Staff
answered 2025-11-11T23:32:03.7566667+00:00
Q&A Assist
4 answers
Failed to run resource validation using @microsoft/azure-data-factory-utilities on Github
Hi Team, I am creating a workflow for ADF deployment on GitHub and encountering an issue when running the npm validate command. The validation fails with the following error: ERROR === Validator: Unhandled validation error for: pipeline - ***, error:…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-10-23T13:20:01.8266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 85%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES3%3C/text%3E%3C/svg%3E)
ShaikNisharunnisa-3795
30
Reputation points
edited a comment 2025-11-11T19:34:52.4266667+00:00
Swapnesh Panchal
845
Reputation points Microsoft External Staff
Moderator
1 answer
One of the answers was accepted by the question author.
Unable to connect to Smartsheet from ADF using Token
There are 4 Smartsheet in which I am able to connect to 3 of them using a token, whereas getting the error while trying to connect to 4th Smartsheet using the same Token. This token was used earlier and started to fail now. Error - The gateway did not…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-06T16:50:08.1+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 37%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKI%3C/text%3E%3C/svg%3E)
Keerthi Ingalahalli
20
Reputation points
accepted 2025-11-11T14:48:21.8866667+00:00
Keerthi Ingalahalli
20
Reputation points
2 answers
One of the answers was accepted by the question author.
how do i fix Auto table creation in sink side is not applicable for your sink dataset
Auto table creation in sink side is not applicable for your sink dataset It seems that i cannot auto create tables in a Azure Sql Server when table names are parameterized when trying to debug run it tells me …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-06T09:44:40.7666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 34%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESH%3C/text%3E%3C/svg%3E)
Simon Højberg Jespersen
20
Reputation points
accepted 2025-11-11T08:23:59.5466667+00:00
Simon Højberg Jespersen
20
Reputation points
2 answers
How to cast columns from multiple tables as new data type?
I'm migrating a bunch of tables from a DB2 database to Azure Data Lake. Several of these tables have CLOB and BLOB column types, which Data Lake doesn't recognize. How do I convert them in Data Factory? I have a look up query that gets the columns…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-03T21:19:57.6133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 46%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AE90
85
Reputation points
commented 2025-11-11T05:52:13.12+00:00
Pratyush Vashistha
4,650
Reputation points Microsoft External Staff
Moderator
1 answer
ADF Branching and Release Management Strategy
Hello Team, Is there any Git Branching & Release Strategy available for ADF which we can use for multiple teams with multiple features can be worked together and can be released independently to higher environment from DEV to TEST, UAT and…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-05T15:57:08.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 27%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKD%3C/text%3E%3C/svg%3E)
Kaushik Dutta
40
Reputation points
edited a comment 2025-11-10T22:33:34.69+00:00
Swapnesh Panchal
845
Reputation points Microsoft External Staff
Moderator
1 answer
Operation on target Copy data1 failed: ErrorCode=UserErrorPropertyInvalidOrMissing,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The property 'clientSecret' is invalid or missing.,Source=Microsoft.DataTransfer.ClientLibrary,'
Hi, I've been encountering this issue and was hoping to get help from microsoft team. Our team has a ADF pipeline that contains copy data activity. We have dev and production versions of data factories and are doing deployments using this architecture.…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-10T07:07:02.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 44%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPG%3C/text%3E%3C/svg%3E)
Patrick Gabatan
0
Reputation points
answered 2025-11-10T17:19:13.5166667+00:00
Amira Bedhiafi
40,726
Reputation points
Volunteer Moderator
1 answer
Network features in ADF
What does the below setting in ADF mean? When we have an SHIR, doesn't the flow of data happen from via the server hosting the SHIR. What does the below setting mean? And once the private endpoint is enabled, the SHIR fails. So can someone show step by…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-10T13:42:39.01+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 14.000000000000002%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
BadMan
0
Reputation points
answered 2025-11-10T14:01:51.8033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 38%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Marcin Policht
65,935
Reputation points MVP
Volunteer Moderator
1 answer
how to grand MI/SP permission for ALL upstream folders and the file system?
Hi, good morning. I have the error below and I would like to know how to fix it. I am using the Azure Data Factory to load data from Azure Blob Storare. The connection between Azure Data Factoty and Blog Storare are OK. The data factory can reach the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-05T03:10:15.65+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 40%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECE%3C/text%3E%3C/svg%3E)
CARLOS EDUARDO TEBALDI
0
Reputation points
commented 2025-11-07T19:07:57.43+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator
1 answer
Need Help with Detailed Notification Setup for ADF Pipeline
Hi Team, I have configured notification emails in Logic Apps for ADF pipeline success and failure alerts. Currently, we are only receiving notifications indicating whether the pipeline ran successfully or failed. However, I would like to enhance this by…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-05T16:04:41.9933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
731
Reputation points
commented 2025-11-07T19:04:38.05+00:00
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator
1 answer
What is this error code: 11402?
The value of the property '' is invalid: 'Unknown SQL type - -99.'. Unknown SQL type - -99. I keep getting this error when trying to copy certain tables from a DB2 database with the ODBC connector. Most of the tables copied with no problem. I've…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,937 questions
asked 2025-11-05T21:26:41.02+00:00
AE90
85
Reputation points
commented 2025-11-07T18:49:38.84+00:00
Smaran Thoomu
32,255
Reputation points Microsoft External Staff
Moderator