Hi Sharad,
As I understand from the description, your pipelines are failing because they are unable to fetch access token of the MI which is likely causing an authentication issue.
I'm assuming it already has a minimum of Storage Blob reader access on ADLS since it was working before. Please correct me if that assumption is wrong.
Sometimes, Microsoft Entra ID is too busy to handle the requests and as a result, the runs might fail. Therefore, my recommendation would be to -
- Verify if the default linked services are able to connect with linked ADLS account. You will find the "Validate" option when you click and edit the linked service.
- Check if any existing runs are still queued and if there are any long running jobs. If they are running longer than expected, I would suggest killing the job.
- Re-run the pipelines one by one after some time or preferably tomorrow to see if it is working.
Document Reference : https://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-data-lake
If you find my answer helpful, please consider marking it as the ‘Answer’ and giving it an ‘Upvote’ using the thumbs-up option. This can also benefit other community members who may have the same question.
Thanks,
Karni.G