Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
2 answers
Custom Catalog Not Visible to ADF and Looker in Databricks
Hi Databricks community, I’ve created a catalog called azure_data_factory and a database called studytube_azure_mysql_production. Within that database, I have three tables: academies, academy_naming_settings, and users. See the left side of the…
Azure Data Factory
asked 2025-11-17T17:08:22.2266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 1%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Adrian P - Studytube
25
Reputation points
commented 2025-12-02T21:11:58.9233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 24%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Pilladi Padma Sai Manisha
495
Reputation points Microsoft External Staff
Moderator
3 answers
Email Notifcation in ADF Pipline
Hello Team, I am using the Web activity to received the email notification in my outlook.So i have mentioned this formula @json(concat( '{', '"message": "ERP-DW-UAT TRANSACTION_PARTITION INPROGRESS",', …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-13T18:41:39.97+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
731
Reputation points
edited a comment 2025-12-02T21:08:36.1466667+00:00
Pilladi Padma Sai Manisha
495
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Copy files to a FTP server from SFTP using ADF
Hi, I have a requirement to drop files to a FTP server. But ADF does not support FTP as a sink. How can I use FTP as a sink in ADF? Thanks, Jeevi
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2022-09-29T12:51:32.547+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 70%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJD%3C/text%3E%3C/svg%3E)
Jeevi Danda
71
Reputation points
answered 2025-12-02T18:27:49.23+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 23%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Nhan, Phuong
0
Reputation points
3 answers
Is this a documentation error?
On the webpage https://learn.microsoft.com/en-us/azure/data-factory/connector-oracle?tabs=data-factory, I think the bold text here "The number of bytes the connector can fetch in a single network round trip. E.g., ArraySize=10485760. Larger values…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-27T16:39:21.4+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 24%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYH%3C/text%3E%3C/svg%3E)
Yao, Hua (he/him/his)
0
Reputation points
answered 2025-12-02T17:45:30.38+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
32,520
Reputation points Microsoft External Staff
Moderator
1 answer
Feature Request: Add Gate Condition for ADF scheduled Trigger
Hi Team, I would like to propose an enhancement for Azure Data Factory (ADF) triggers: the ability to add a Gate Condition before a trigger executes. Currently, ADF triggers (such as schedule triggers) do not allow conditional logic beyond basic…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-12-02T06:29:45.6233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 67%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHN%3C/text%3E%3C/svg%3E)
Hitesh N
0
Reputation points
recommended 2025-12-02T17:33:55.23+00:00
Amira Bedhiafi
41,036
Reputation points
Volunteer Moderator
2 answers
In an high availability configuration of Azure Data Factory, how can I reduce the 5-minute failover/recovery time for nodes that fail during pipeline runs?
I am developing enterprise-grade pipelines that ingest from on-premises data sources using a self-hosted integration runtime and am utilizing a multi-node high-availability configuration in Azure Data Factory. During runs, I've noticed that if a node…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-12-01T00:23:14.81+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 97%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAW%3C/text%3E%3C/svg%3E)
Alex WB
0
Reputation points
answered 2025-12-02T17:18:49.43+00:00
Smaran Thoomu
32,520
Reputation points Microsoft External Staff
Moderator
2 answers
Authentication type is null in oracle linked service.
Hi, I created the Oracle linked service in my feature branch and merged it into the main branch. The Git pipeline then published these changes to Data Factory live mode. The Oracle linked service was deployed to live mode, but the authentication type is…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-26T21:05:03.6666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 37%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Mani
45
Reputation points
commented 2025-12-02T11:11:57.0033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 18%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVP%3C/text%3E%3C/svg%3E)
VRISHABHANATH PATIL
1,810
Reputation points Microsoft External Staff
Moderator
2 answers
Datafactory Self hosted integration runtime auto updates
Hi, We have enabled auto-update for our self-hosted integration runtime. Initially, we deployed it with version '5.48.9076.1'. Over time, it was updated to '5.55.9315.1' via auto-update with our interventions. However, we've noticed that the latest…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-20T09:05:44.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 39%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
SC
0
Reputation points
answered 2025-12-02T09:21:45.56+00:00
VRISHABHANATH PATIL
1,810
Reputation points Microsoft External Staff
Moderator
2 answers
third-party SFTP with ADF
We are trying to connect Azure Data Factory to a third-party SFTP endpoint provided by Bloomberg. The connection fails when using the Azure Integration Runtime (AutoResolve IR). Is it possible to connect to Bloomberg SFTP using Azure IR + IP…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-20T13:23:48.72+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 97%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER1%3C/text%3E%3C/svg%3E)
RTG-1064
40
Reputation points
answered 2025-12-02T09:05:27.3266667+00:00
VRISHABHANATH PATIL
1,810
Reputation points Microsoft External Staff
Moderator
1 answer
I want to write a logic to trigger adf pipeline in cqrs architecture so where can i write in shared folder or feature folder
I want to write a logic to trigger adf pipeline in cqrs architecture so where can i write in shared folder or feature folder
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-12-02T04:27:22.9233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 99%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Ashwini Kanjapur
0
Reputation points
answered 2025-12-02T04:27:28.4433333+00:00
Q&A Assist
1 answer
for api changes, what if we move the trigger pipeline code to shared?
for api changes, what happens if we move the trigger adf pipeline code to shared? now it is in feature in cqrs architecture
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-12-02T04:22:24.2466667+00:00
Ashwini Kanjapur
0
Reputation points
answered 2025-12-02T04:22:31.76+00:00
Q&A Assist
2 answers
Fabric login/Authenticator app keeps asking for authentication code
I am trying to login to Microsoft fabric using the registered email account (not outlook.com) and it keeps asking for authentication code even after i select I don't have access to the authentication code. It is a loop and no alternate way to…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-21T14:19:59.02+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 28.999999999999996%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJP%3C/text%3E%3C/svg%3E)
Jatin Pangging
0
Reputation points
answered 2025-12-02T03:43:46.5266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 13%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Pratyush Vashistha
4,815
Reputation points Microsoft External Staff
Moderator
3 answers
Azure Data Factory - Is it possible to tune for faster failover?
I'm working on a project in which we are utilizing Azure Data Factory for data migration. We are using a high availability architecture and currently our issue is that if a node fails it takes more than 5 minutes for the worker node to return to normal.…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-27T08:25:50.36+00:00
Alex WB
0
Reputation points
commented 2025-12-02T03:21:01.78+00:00
VRISHABHANATH PATIL
1,810
Reputation points Microsoft External Staff
Moderator
1 answer
Need help installation of OLE DB drivers to SSIS IR for DB2 connect
Hi Team, I am trying to run an SSIS package in Azure Data Factory using an SSIS Integration Runtime. The SSIS package uses IBM DB2 as the source and SQL MI as the destination. However, the package execution is failing due to a DB2 connection…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-30T05:24:05.9466667+00:00
PHANEENDRADIVI-5643
0
Reputation points
answered 2025-12-01T16:59:47.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 97%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHR%3C/text%3E%3C/svg%3E)
Haris Rashid
81
Reputation points
2 answers
Not able to process the blob data
Hi, We are extracting data from an on-premises DB2 LUW database and loading it into an Azure Database for PostgreSQL. The source tables contain BLOB data types used to store PDF files, and the data copy process is getting stuck on tables with BLOB…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-26T21:27:32.3633333+00:00
Mani
45
Reputation points
commented 2025-12-01T07:07:29.74+00:00
VRISHABHANATH PATIL
1,810
Reputation points Microsoft External Staff
Moderator
2 answers
We are facing an issue while copying data from Oracle to Azure SQL using ADF Copy Activity.
We are facing an issue while copying data from Oracle to Azure SQL using ADF Copy Activity. The pipeline fails or produces incorrect numeric values due to high-precision decimals in Oracle. Details: Source (Oracle): TABLE_FIN Target (Azure SQL):…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-13T05:27:27.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 73%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anandhswarupp
205
Reputation points
commented 2025-12-01T05:19:48.17+00:00
Pratyush Vashistha
4,815
Reputation points Microsoft External Staff
Moderator
2 answers
Is Azure Data Factory planning to add support for ztsd compression on parquet files?
I've run into some issues previewing parquet data using a pipeline Copy Activity when that data was compressed using the zstd codec. Are there plans for ADF to add support for this (now default in Databricks) compression method? Example error: An…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-21T02:06:04.1833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 9%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGE%3C/text%3E%3C/svg%3E)
Gabriel Eckers
0
Reputation points
commented 2025-11-30T05:46:43.27+00:00
VRISHABHANATH PATIL
1,810
Reputation points Microsoft External Staff
Moderator
1 answer
How to handle pagination with $skipToken in Azure Data Factory
I'm curious how to handle pagination with $skipToken in Azure Data Factory According to the documentation (Pagination support) it seems quite simple in case when we have @odata.nextLink to use as next URL (Microsoft Graph API), but it's more complicated…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2023-02-27T20:15:26.1933333+00:00
Bartosz Pelikan
46
Reputation points
edited the question 2025-11-28T22:52:02.1233333+00:00
Bartosz Pelikan
46
Reputation points
1 answer
Precision loss when migrating data from SQL Server to Snowflake using ADF via CSV staging (but not with Direct Copy)
I’m migrating SQL Server tables to Snowflake using Azure Data Factory. Direct Copy from SQL Server to Snowflake works, but I can’t use it because of the 100 MB row size limit. That forces me to take an intermediate staging approach. Approach 1: Direct…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-27T05:50:05.4233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 19%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Arud Seka Berne S
0
Reputation points
answered 2025-11-28T15:22:18.3733333+00:00
Vinodh247
40,031
Reputation points MVP
Volunteer Moderator
3 answers
One of the answers was accepted by the question author.
error with numeric columns in a PostgreSQL connection via ADF integration runtime 5.55.9315.1
Since November 15 (likely coinciding with the update of the self-hosted integration runtime to version 5.55.9315.1), numeric columns in our PostgreSQL tables have been displaying incorrect values when decimals are involved—the numbers appear to be…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,976 questions
asked 2025-11-18T14:19:21.2833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 94%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWV%3C/text%3E%3C/svg%3E)
Wilfred Vonk
20
Reputation points
accepted 2025-11-28T09:21:28.5133333+00:00
Wilfred Vonk
20
Reputation points