Share via

Read sharepoint list data and convert to csv using ADF

sankon437 41 Reputation points
2024-09-23T14:39:19.3766667+00:00

Is it possible to read sharepoint list data using ADF with having 60 sites and 100+ list items and automate XML response to CSV files ?

We already did POC using databricks, its working fine, but want to know whether ADF can handle without reading/creating schema and can create CSV files like dbx.

we already know the answer, but wanted to ask here.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,663 questions
SharePoint
SharePoint
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
10,675 questions
Accepted answer
  1. Nandan Hegde 32,256 Reputation points MVP
    2024-09-24T03:39:35.4+00:00

    Based on my understanding the current SPList connector is only for SP online and not for sharepoint hosted on On Prem.

    So you would anyhow have to write your own custom logic to extract data from on Prem SPlists.

    Also Service principals are present in your Entra ID (cloud AD) and since your SPlist is hosted on On-Prem, the Service principals cannot be reveres synced into on Prem AD hence you cannot grant SP access on On-Prem SP

1 additional answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. hossein jalilian 6,980 Reputation points
    2024-09-23T17:00:39.2233333+00:00

    Thanks for posting your question in the Microsoft Q&A forum.

    • ADF has a built-in SharePoint Online List connector that can read data from SharePoint lists, it supports both SharePoint Online and SharePoint Serve.
    • You can create multiple datasets, one for each SharePoint list, alternatively, use parameters in your dataset to dynamically point to different sites and lists.
    • ADF typically requires schema definition for structured data operations. however, you can use dynamic schemas in some scenarios, especially with Mapping Data Flows.

    Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.