An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Best Practice for ADLS Gen2 (HNS) Soft Delete in Terraform: Explicit Configuration vs. Relying on Platform Defaults (blob_properties)
Hello, We are currently deploying an Azure Storage Account with Hierarchical Namespace (HNS) enabled (ADLS Gen2) for a production environment using Terraform (azurerm provider). We are facing a design debate regarding data protection (Soft Delete) and…
Azure Data Lake Storage
Azure SFTP Connection Disconnects on Port 22 from Linux VM
I have a window vm in that i have a another hyper v window-A vm and another linux vm whole connectivity is completely private when i try to connect sftp server i got Disconnected from port 22 error while i am able to reach the my storage privateEndpoint…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Product notifications from Microsoft for Azure/Data Lake
Good morning, New to the Azure realm, I am looking for the mechanism that Microsoft sends out notices beside just clicking within Azure and getting notices like this. Had my employee not clicked here, we wouldn't have known about this deadline.
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure ML v2 mode=upload output to an ADLS Gen1 datastore fails with "MSCONCAT 0x83090a70 (gen1-to-gen2 symlink)" for files larger than ~8 MB
I have an Azure Machine Learning v2 pipeline (azure-ai-ml SDK). A step writes an output file to an ADLS Gen1 datastore (datastore type AzureDataLakeGen1) using a uri_file output with mode=upload. My script writes the file to the local output mount and…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
what choices do I have for storage within Azure?
I'm a leader of a new data and analytics CoE. We are contracted with MCA Connect to implement their Inspire platform to have a common data dictionary and reporting environment. To get started with building the environment to support the Inspire platform,…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure ML v2 mode=upload output to an ADLS Gen1 datastore fails with "MSCONCAT 0x83090a70 (gen1-to-gen2 symlink)" for files larger than ~8 MB
I have an Azure Machine Learning v2 pipeline (SDK azure-ai-ml) whose step writes an output file to an ADLS Gen1 datastore (datastore type AzureDataLakeGen1). The output is declared as: Output( My training script just writes the file locally to the…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Fabric Environment - What are major differences between Workspace and lakehouse
Fabric Environment - What are major differences between Workspace and lakehouse.? As when we do some lab during learning. Many times we start withtout creating workspace. We directly jump into creating pipelines, or Dataflow gen 2.
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Unable to copy data from Snowflake to Azure Data Lake storage via Azure Data Factory
Hi Request help on below: We are able to preview snowflake data in Azure data factory after successful connection. But unable to write the data in ADLS. SAS token and IP whitelisting has been used but need help on setting private connection at…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
AI answer
How to connect 21v data lake storage using excel
Hi there, How to connect 21v data lake storage using excel Thanks & Regards, zmsoft
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
how to Restrict public network access to azure Data Lake with private endpoint?
AuthorizationFailure (403) when Synapse tries to access the storage account — both when browsing in Synapse Studio and when testing via Azure CLI using our own (Owner-level) identity, and even via a pipeline run how do we implement it then for this issue…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Integration with Azure Data lake & powerBI via VNet Data Gateway
Hello Team, How to implement below using terraform .Currently I have created Azure Sql server along with ADLS Stoarge account using terraform. External Data Source -> Secure File Transfer Platform -> ADLS Gen2 Landing Zone -> Validation Pipeline…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Data Quality issue in the Purview
Hello Team, We have configured the ADLS2 as source and scan it. For the data Quality, we did the following the steps : Create the Governance domain and publish it. Create the Data Product and add the tables. In the Data Quality section, add the…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Microsoft Security | Microsoft Purview
A unified data governance solution that helps manage, protect, and discover data across your organization
not able to deploy fabric app (rayfin app)
Toggled "Fabric Apps (preview)" tenant setting off→on, confirmed it shows enabled, waited overnight, re-authenticated — still 403 on every attempt
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
AI answer
d108205dla2hftraazu3n6s - ACL policy is Forbidden
We have container and have "Storage Blob Data Owner" RBAC role still uanbel to see ACL list , it says Forbidden.
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Microsoft Fabric Mirrored Azure Databricks Catalog: PowerBINotAuthorizedException with cross-tenant firewalled ADLS Gen2
Hi all, I have a Fabric + Azure Databricks setup that I cannot find a documented working configuration for, and I am hoping someone here has solved it. Setup: Microsoft Fabric workspace in Tenant A. Azure Databricks workspace in Tenant B, with its…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Power automate to azure storage
Hello, We are not able to connect using power automate connector to azure storage getting error 403 Authorization failure. This storage account has pvt end point and network setting as selected virtual network. What could be the cause of this issue and…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
RequestDisallowedByAzure: Synapse Link for Dataverse D365FO
Hi 1 year or so ago, we successfully created a Synapse link for Dataverse (D365FO) using the MS doco here. https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-synapse We are now doing the same with another environment…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Microsoft Fabric BCDR storage
As using Azure price calculator for Fabric SKU, I wonder if I select hot, cool and cold storage as BCDR OneLake hot, cool and cold storage then the whole of those hot, cool and storage will be replicated from this primary region to another region? And…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Data Lake Storage rename folder with 10M files
Hello. I want to rename a folder with 10 million files, but I have doubts about the cost and the difference between write operations and iteractive write operations. What is the cost of rename a folder with 10M files in an ADLS RA-GRS west europe and how…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Interative Write Operation vs Write Operation
All, Why is "Iterative Write" operations which is based on meta-data more expensive than Write operations for Hierarchical Namespace? Thanks, Gopi
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.