Access issue with DB post deployment
Hi, I just learned how to do CI/CD for ADF and am trying out a test. I have the sql db's in a different Resource group (rg_sql_dev) and the ADF's resource group is RG_ADF_DEV. Likewise, for the production i have it rg_sql_prod and RG_ADF_PROD I created…
Power Query merge query on two colums
Hello: I have two datasets (UserQueries) in Power Query, I now want to merge them on two columns that are common. Should be easy, right. I use Merge Queries on the tool bar, get a dialogue box as follows: The col's are correct and the order is correct.…
Salesforce Connector deprecation details
As part of Sales force legacy connector, can we get confirmation for below ask please: "You can continue to use existing Linked services and datasets of the legacy connector and make changes to them. You cannot create a new Linked service for the…
Failed to get MI access token.
I have 25 pipelines running but all are failing from yesterday due to this error: ErrorCode=AdlsGen2OperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Failed to get MI access token.…
Error on sink data to MySQL - communications link failure
I've got a Pipeline with some Data Flow activities that runs in parallel. I've got the error on last night's execution and I'd like some help to understand why and how to prevent it from happenning. Job failed due to reason: at Sink 'EnviaFerias':…
Pipeline run stucked on queue
I have some pipelines that ingest data from Oracle and write directly to Delta in a lakehouse on Fabric. I have other pipelines that ingest data from Oracle and write to a .parquet file in a lakehouse on Fabric. The pipelines that write directly to Delta…
Azure Data Factory Until loop slow to end/terminate
We have an until loop in a ADFv2 pipeline. The time it takes to stop/terminate once the expression condition is met seems to corrolate between the length of time the until loop takes to completes its activities. This particular until loop…
ADF logging mechanism
I have a few options to get logging from Azure data factory for performing key metric analysis such as Having SQL table store procedures and capture all key metrics from Azure monitor such pipeline runtimes and durations Programmatically grap these…
Azure Synapse pipeline copy data activity from on-prem to Azure sql db issue
{ "errorCode": "2200", "message": "ErrorCode=SqlFailedToConnect,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Cannot connect to SQL Database. Please contact SQL server team for further…
Azure data lake folder structure
Hi, the link provided in the below thread is not working, any way to find the information or a new URL/link: FAQs About Organizing a Data…
Json response could not parse successfully in Copy activity (source)
For the same HTTP request, Web activity gives us the correct response all correctly parse, but Copy activity couldnt. This has worked fine before. Screenshots are cut from Preview data. When I actually run the copy activity there is no data coming from…
The specified network name is no longer available - error code - 22852
Hello Team, Today I faced an error, when i am trying to do test connection. Please resolved as soon as possible. I need to resolve please help me to resolve. 
I am trying to get ADF to connect to Microsoft Purview.
Azure is having a new UI. I am not able to activate the ADF flow to push metadata to Microsoft purview. The documentation explains the following: I don't even see Management option in Microsoft Purview. Follow the steps below to connect an existing…
Connecting Azure Data factory to Oracle ADW
Hi, While trying to connect to Oracle ADW using Wallet file, facing the below error, how to resolve ? Tried: https://learn.microsoft.com/en-ca/azure/data-factory/connector-oracle-service-cloud?tabs=data-factory#linked-service-properties ERROR [HY000]…
Failing to copy large dataset from Salesforce using new salesforce V2 connector in Azure data factory
I am trying to migrate the salesforce legacy linked service to new salesforce V2 linked service in Azure data factory. The test connection is successful and I am able to copy the smaller datasets using new salesforce V2 linked service. But when i am…
gRPC connection errors in copy activity
I have a copy data activity in ADF that copies from Google BigQuery to Blob storage. Occasionaly I get one of these errors: "grpc_message":"End of TCP stream" "grpc_message":"keepalive watchdog timeout" We are…
Why am I unable to create a cluster in Azure databricks?
Currently, I am using a student account. I tried selecting different configurations. It would be great if someone recommend a configuration for student account!
adf/synapse - how to copy all files based on given lastmodified date from source container and save in sink container in respective folder based on extension
Req: Copy files from one container and store in another container- I am specifying the last modified date , i want to copy files only before that last last modified date. The files are of any type. csv,xml,json,txt etc. Also, in source container my files…
facing HTTP request was forbidden for 365 Dynamics linked service
The HTTP request was forbidden with client authentication scheme 'Anonymous'. The remote server returned an error: (403) Forbidden.
Dynamic Mapping of Source to JSON Sink in Azure Data Factory
We are able to preview the source data from the Salesforce linked service in ADF, and I can also view the sink data using the REST linked service for Business Central in ADF. However, I'm facing an issue where importing the schema is not supported…