An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure File storage SAS TOKEN
I can upload files to ADLS Gen 2 blob storage with AzCopy through OAuth authorization, but I am unable to upload to file storage with the same. It is asking for SAS token. Please tell me the process of generating SAS token. Thanks. [Note: As we…
Azure Data Lake Storage
Copy files from Sharepoint into Azure Data Lake Store Gen 2 using ADF linked services ?
I have to copy files from Sharepoint into Azure Data Lake Store Gen 2 using ADF linked services
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Microsoft 365 and Office | SharePoint | For business | Windows
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
inferschema error on parquet files, mergeSchema is time consuming
I stored the parequet files in ADLS Gen2. Most time I read the file with no problem, but some time the collected parquet files triggered the "can not inferSchema" errors. I googled the error, most likely it was caused by an empty parquet…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
How to identify corrupt Parquet Files
How can I detect corrupt Parquet files? I recently ran a Synapse Pipeline/Data Flow, and when I previewed the data in the source data flow component, I received the following error: "Synapse Pipeline ADF at Source Job aborted due to stage failure:…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Unable to copying from blob storage account to gen2 storage account between different subnets or vnets
Is Microsoft will start supporting copying from blob storage account to gen2 storage account between different subnets or vnets? The target storage account is gen2 and we are trying to achieve via databricks job copy(python blob copy url) not via…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Storage
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
Azure Synapse Link for Dataverse: Create Link to Data lake
We have fallowed the below steps. 1. Created a Storage account with Hierarchical namespace2. Disabled Public endpoint and created Private endpoint3. Create the Managed Identity Enterprise Policy 4. Associate the Enterprise Policy with Dataverse5.…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
AI answer
Power automate to azure storage
Hello, We are not able to connect using power automate connector to azure storage getting error 403 Authorization failure. This storage account has pvt end point and network setting as selected virtual network. What could be the cause of this issue and…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Getting Status: 403 (Key based authentication is not permitted on this storage account.) when using a service principal
Hi, When I run a script that reads the contents of a Gen 2 data lake storage account using my Entra account, it works fine however I am trying to automate a process, the automation process uses a service principal for authentication, when it runs I get…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Best Practice for ADLS Gen2 (HNS) Soft Delete in Terraform: Explicit Configuration vs. Relying on Platform Defaults (blob_properties)
Hello, We are currently deploying an Azure Storage Account with Hierarchical Namespace (HNS) enabled (ADLS Gen2) for a production environment using Terraform (azurerm provider). We are facing a design debate regarding data protection (Soft Delete) and…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure SFTP Connection Disconnects on Port 22 from Linux VM
I have a window vm in that i have a another hyper v window-A vm and another linux vm whole connectivity is completely private when i try to connect sftp server i got Disconnected from port 22 error while i am able to reach the my storage privateEndpoint…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Product notifications from Microsoft for Azure/Data Lake
Good morning, New to the Azure realm, I am looking for the mechanism that Microsoft sends out notices beside just clicking within Azure and getting notices like this. Had my employee not clicked here, we wouldn't have known about this deadline.
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure ML v2 mode=upload output to an ADLS Gen1 datastore fails with "MSCONCAT 0x83090a70 (gen1-to-gen2 symlink)" for files larger than ~8 MB
I have an Azure Machine Learning v2 pipeline (azure-ai-ml SDK). A step writes an output file to an ADLS Gen1 datastore (datastore type AzureDataLakeGen1) using a uri_file output with mode=upload. My script writes the file to the local output mount and…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
what choices do I have for storage within Azure?
I'm a leader of a new data and analytics CoE. We are contracted with MCA Connect to implement their Inspire platform to have a common data dictionary and reporting environment. To get started with building the environment to support the Inspire platform,…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure ML v2 mode=upload output to an ADLS Gen1 datastore fails with "MSCONCAT 0x83090a70 (gen1-to-gen2 symlink)" for files larger than ~8 MB
I have an Azure Machine Learning v2 pipeline (SDK azure-ai-ml) whose step writes an output file to an ADLS Gen1 datastore (datastore type AzureDataLakeGen1). The output is declared as: Output( My training script just writes the file locally to the…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Fabric Environment - What are major differences between Workspace and lakehouse
Fabric Environment - What are major differences between Workspace and lakehouse.? As when we do some lab during learning. Many times we start withtout creating workspace. We directly jump into creating pipelines, or Dataflow gen 2.
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Unable to copy data from Snowflake to Azure Data Lake storage via Azure Data Factory
Hi Request help on below: We are able to preview snowflake data in Azure data factory after successful connection. But unable to write the data in ADLS. SAS token and IP whitelisting has been used but need help on setting private connection at…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
AI answer
How to connect 21v data lake storage using excel
Hi there, How to connect 21v data lake storage using excel Thanks & Regards, zmsoft
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
how to Restrict public network access to azure Data Lake with private endpoint?
AuthorizationFailure (403) when Synapse tries to access the storage account — both when browsing in Synapse Studio and when testing via Azure CLI using our own (Owner-level) identity, and even via a pipeline run how do we implement it then for this issue…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Integration with Azure Data lake & powerBI via VNet Data Gateway
Hello Team, How to implement below using terraform .Currently I have created Azure Sql server along with ADLS Stoarge account using terraform. External Data Source -> Secure File Transfer Platform -> ADLS Gen2 Landing Zone -> Validation Pipeline…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Data Quality issue in the Purview
Hello Team, We have configured the ADLS2 as source and scan it. For the data Quality, we did the following the steps : Create the Governance domain and publish it. Create the Data Product and add the tables. In the Data Quality section, add the…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Microsoft Security | Microsoft Purview
A unified data governance solution that helps manage, protect, and discover data across your organization