Share via

Couldn't able to see the hierarchy in the MS Fabric files on copying the files from blob to fabric using ADF copy activity

Siva Reddy 40 Reputation points
2024-08-10T13:54:52.98+00:00

I'm trying to ingest the files(txt) from blob to fabric files. I have the hierarchy in blob like container/main_folder/sub_folder/Date_folder/files. When I use the ADF copy activity to copy all the files from the Date_folder to Fabric files. I can't able to see the same hierarchy in the fabric files like main_folder/sub_folder/Date_folder/files. Instead it is ingesting as flatten hierarchy like Files -> files
Note: I'm using the preserve hierarchy as copy behavior

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,924 questions
Microsoft Fabric Training
Microsoft Fabric Training
Microsoft Fabric: A Microsoft unified data platform.Training: Instruction to develop new skills.
52 questions
Accepted answer
  1. Pinaki Ghatak 4,840 Reputation points Microsoft Employee
    2024-08-13T13:57:10.6966667+00:00

    Hello @Siva Reddy

    To preserve the hierarchy of the files while copying from Blob storage to Service Fabric, you need to make sure that you have specified the correct settings in the ADF Copy activity. Here are some things you can check:

    1. Make sure that you have specified the correct source and sink datasets in the ADF Copy activity. The source dataset should point to the Blob storage and the sink dataset should point to the Service Fabric.
    2. In the sink dataset, make sure that you have specified the correct file path where you want to copy the files. You can use the following format to specify the file path: fabric:////.
    3. In the ADF Copy activity, make sure that you have specified the correct copy behavior. Since you want to preserve the hierarchy of the files, you should set the copy behavior to "PreserveHierarchy".
    4. If you are still not seeing the same hierarchy in the Service Fabric files, you can try using the "FlattenHierarchy" copy behavior instead. This will copy all the files from the Date_folder to the Service Fabric files without preserving the hierarchy. However, the files will still be copied to the correct location based on the file path you specified in the sink dataset.

    I hope that this response has addressed your query and helped you overcome your challenges. If so, please mark this response as Answered. This will not only acknowledge our efforts, but also assist other community members who may be looking for similar solutions.

    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.