The issue you're experiencing is likely due to the hierarchical namespace (HNS) not being enabled on your Azure Data Storage account. An HNS allows you to organize objects and files within an account into a hierarchy of directories and subdirectories, providing file system semantics that are familiar to analytics engines and frameworks. This enables atomic directory manipulation and offers a familiar interface style.
To resolve this issue, you need to enable the hierarchical namespace on your storage account. Here is the documentation that provides detailed steps on how to migrate to a storage account with HNS enabled:
Additionally, if you encounter throttling issues, which are not related to the HNS configuration, you can refer to the following troubleshooting guide for further assistance:
Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.
Please do not forget to "Accept the answer" and "up-vote" wherever the information provided helps you, as this can be beneficial to other community members.