Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,491 questions
1 answer
Copy Files from sharepoint online site to azure datalake storage
Hello We are trying to setup the flow which will copy files from sharepoint online site to azure datalake storage. As per my understanding there are 2 options : Using ADF to pull the files as mentioned in the link below…
asked 2024-11-06T22:12:34.5+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 35%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Sourav
105
Reputation points
edited the question 2024-11-13T08:57:32.6533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 17%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGM%3C/text%3E%3C/svg%3E)
Givary-MSFT
33,241
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Web activity is throwing an error in adf pipeline
One of the web activities in my adf pipeline is throwing an error : Error calling the endpoint 'https://acp-01-appkv.vault.azure.net'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] The remote…
asked 2023-11-16T17:55:56.0766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 76%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAJ%3C/text%3E%3C/svg%3E)
Ashish Jayantibhai Kadavla
20
Reputation points
commented 2024-11-13T08:48:31.6066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 77%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
ABDULLA, MAHAMMAD
21
Reputation points
0 answers
Regarding the AI-102 - Designing and Implementing a Microsoft Azure AI Solution - English (ENU) being revoked without any violation
I am Venkat Vardhan and I have registered to appear for AI-102 - Designing and Implementing a Microsoft Azure AI Solution - English (ENU) on November 6th at 1:30 pm IST. While I was attempting the test, I got a message from the proctor on the chat…
asked 2024-11-13T07:53:54.0833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 71%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVJ%3C/text%3E%3C/svg%3E)
Venkat Jonala
0
Reputation points
asked 2024-11-13T07:53:54.0833333+00:00
Venkat Jonala
0
Reputation points
1 answer
One of the answers was accepted by the question author.
How to connect to salesforce through Delta copy database template?
I have attached a screenshot, For the source dataset when I try to connect to Salesforce Linked service, it automatically opens a new linked service for Azure SQL Database. Can you please help me to understand if I am missing somethingDelta.png
asked 2024-11-11T06:42:17.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 47%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
S D, Sudevika
20
Reputation points
accepted 2024-11-13T07:09:43.6266667+00:00
S D, Sudevika
20
Reputation points
0 answers
Unable to create HDInsight On Demand Cluster in Azure Data Factory
I am getting the issue to creating the On Demand HDInsights in Azure Data Factory. The status is stuck at "PreparingCluster". Here's my LinkedService configuration. OS type : Linux
asked 2024-11-13T03:52:15.9866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 19%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETC%3C/text%3E%3C/svg%3E)
Tan Check Leam
5
Reputation points
commented 2024-11-13T06:38:57.5366667+00:00
Tan Check Leam
5
Reputation points
1 answer
Azure-ADF pipeline failure while coping data to parquet file as Sink.
We are facing below error while copying data from RDBMS source to ADLS(Parquet File) as Sink. Error Message: ParquetJavaInvocationException,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=An error occurred when invoking java,…
asked 2024-11-12T12:58:02.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 72%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Sandeep
0
Reputation points
commented 2024-11-13T06:16:22.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
2,990
Reputation points Microsoft Vendor
2 answers
How to give Sharepoint folder granular access to a Service Principal ?
Our team is working to get data from Sharepoint to Azure blob storage. We decided to use ADF as logic apps has size limitations. The doc referred is Microsoft Learn To complete this solution, we need to give the sharepoint site full access to the…
asked 2024-10-24T09:06:37.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 62%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
Khadraoui, Said
0
Reputation points
commented 2024-11-13T06:08:01.58+00:00
Chandra Boorla
2,990
Reputation points Microsoft Vendor
0 answers
error code 2011
i am testing a pipeline, i introduced a repeated row in one of the files that i want to upload. i was expecting that the pipeline would have run anyway, uploading the correct files and not the incorrect one. actually, the entire pipeline did not work...…
asked 2024-11-11T16:28:19.3633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 83%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGE%3C/text%3E%3C/svg%3E)
Galvan, Elena (Bip Group)
0
Reputation points
commented 2024-11-13T06:05:36.08+00:00
Chandra Boorla
2,990
Reputation points Microsoft Vendor
2 answers
Azure Data Factory - Getting data from D365 partylist attributes
Hi I have read that the ADF dynamic 365 connectors (when using Copy) cannot extract data from partylist attributes nor can populate them when loading data in D365. If that is the case is there a work around or do i have to revert to using…
asked 2024-11-12T06:28:56.4066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 39%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETG%3C/text%3E%3C/svg%3E)
Tim Goodsell (AP)
1
Reputation point
commented 2024-11-13T06:02:14.98+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
16,890
Reputation points Microsoft Vendor
2 answers
Azure Data Factory (ADF) — where the Data Flow activity shows a status of "Successful" taking about 52 minutes to write to the SINK but the pipeline trigger still shows "In Progress" util duration 10 hours.
I'm getting issue when using adf pipeline call to execute ADF Dataflow. Dataflow name: df_attachment Pipeline name: pl_ingest_attachment. I'm using pl_ingest_attachment trigger to df_attachment. but i see some issue: i see status write to sink in…
asked 2024-11-11T14:48:26.8166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 97%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKN%3C/text%3E%3C/svg%3E)
Khang Nguyen Ba
0
Reputation points
commented 2024-11-13T06:01:10.28+00:00
Smaran Thoomu
16,890
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
adf cost reduction
Hello , I am trying to use the Powershell script to reduce the costs in ADF. I am not a Powershell expert, below are the snippets of PowerShell Invoke-AzDataFactoryV2Pipeline -DataFactory $df -PipelineName "Adfv2QuickStartPipeline"…
asked 2024-11-12T11:43:53.45+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 88%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azure_learner
420
Reputation points
accepted 2024-11-13T05:20:00.3266667+00:00
azure_learner
420
Reputation points
2 answers
One of the answers was accepted by the question author.
Connect ADF to on-premise D365
Is there a good article that explains fully how one can connect ADF to an on-premise D365 instance that clearly explains how to set up the Self-Hosted IR and the recommended linked service option values (i.e. authentication type) when extracting data…
asked 2024-11-11T06:29:55.52+00:00
Tim Goodsell (AP)
1
Reputation point
commented 2024-11-13T03:49:15.25+00:00
Tim Goodsell (AP)
1
Reputation point
0 answers
Azure AD Seamless SSO and Teams error
We have successfully enabled seamless SSO in our Active Directory - Microsoft Entra ID environment by following Microsoft's quickstart guide (https://learn.microsoft.com/en-us/entra/identity/hybrid/connect/how-to-connect-sso-quick-start) and tested it by…
Microsoft Teams
Microsoft Teams
A Microsoft customizable chat-based workspace.
10,326 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,864 questions
Not Monitored
Not Monitored
Tag not monitored by Microsoft.
39,779 questions
Microsoft Entra ID
Microsoft Entra ID
A Microsoft Entra identity service that provides identity management and access control capabilities. Replaces Azure Active Directory.
22,162 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 97%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 43%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
1 answer
Unable to copy payload from snowflake sql rest api to Azure blob
Hi , I am using web activity to get oauth token and passing subscription key and token to get method source dataset in a copy activity. postman is giving correct result but getting below error:- "Code": 22755, "Message":…
asked 2024-11-10T23:09:03.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 5%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
John
190
Reputation points
commented 2024-11-13T03:08:24.6633333+00:00
Chandra Boorla
2,990
Reputation points Microsoft Vendor
0 answers
How do I dynamically replace manual value here?
I am trying to set some type of variable (or possibly parameter) inside this expression where there is '-1' so that I do not have to go each step individually but able to modify at one location to make the effect for other pipelines as well. Sometimes, I…
asked 2024-11-12T23:31:50.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 39%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKJ%3C/text%3E%3C/svg%3E)
King Java
540
Reputation points
edited a comment 2024-11-13T03:00:58.7766667+00:00
Chandra Boorla
2,990
Reputation points Microsoft Vendor
0 answers
Azure Data Factory in Gov Cloud Linking to Fabric Data Warehouse in Azure Commercial
I have a tiered data architecture where: controlled data gets processed in Gov Cloud using Azure Data Factory (ADF) non-controlled data get processed in Commercial Cloud using Fabric I'm trying to write some aggregated data from a pipeline in ADF…
asked 2024-11-13T02:06:38.56+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 75%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDT%3C/text%3E%3C/svg%3E)
Daniel Treiman
0
Reputation points
asked 2024-11-13T02:06:38.56+00:00
Daniel Treiman
0
Reputation points
0 answers
Azure, how to process only the first row of Excel file?
I use MS Azure Data Factory online in the portal. I have some type of premium license. All blob storage is the newer Gen2. One of the fields in row 1 is named "TrackNum" via a Derived Column step, and in row 1 has the contents…
asked 2024-11-06T11:51:18.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 77%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECR%3C/text%3E%3C/svg%3E)
Chuck Roberts
110
Reputation points
commented 2024-11-13T01:57:07.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
11,295
Reputation points Microsoft Vendor
1 answer
could you please let us know the use of map drift in data preview tab and how it internally works, if pivot key always changing
source pointing to product ,profit and region group by :-region pivot key -product name pivoted columns- sum(profit)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 38%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
0 answers
In my ADF I have few pipelines, is it possible to Export / Migrate those pipelines in Synapse Analytics...?
In ADF I have grouped all the activities in the form of Pipelines, So is it possible to migrate or export those pipelines in Azure Synapse.
asked 2024-11-13T01:17:17.1666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 89%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Shreyash Betwar
0
Reputation points
edited the question 2024-11-13T01:27:00.13+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 2%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHB%3C/text%3E%3C/svg%3E)
Hari Babu Vattepally
635
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
GraphQL source, SQL Azure Database Destination, is Azure Data Factory the best choice?
Hi Relatively new to the world of Data Factory and pulling information via API, in this case GraphQL. Issue I'm having is there is little examples out there of GraphQL queries in Azure Data Factory. And when it comes to pagination, which I can perform…
asked 2024-11-11T22:10:24.1566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 1%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
G Goldspink
20
Reputation points
commented 2024-11-12T22:43:11.69+00:00
G Goldspink
20
Reputation points