Share via

Error When Creating Managed AirFlow in Azure Data Factory

Ahwan Mishra 140 Reputation points
2024-08-20T05:37:14.39+00:00

I attempted to create a Managed AirFlow environment in Azure Data Factory, but I encountered the following error:

User's image

"Failed to save Airflow1. Error: Failed to save integration runtime. Airflow IR creation is not allowed. Please create new Data workflows for your Apache Airflow needs in Microsoft Fabric. It offers a wider range of Apache Airflow capabilities and enhanced features to better serve your needs."

Can anyone help me understand why this error occurred and what steps I should take to resolve it? Is Microsoft Fabric the only option now for creating AirFlow workflows?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,924 questions
Microsoft Fabric Training
Microsoft Fabric Training
Microsoft Fabric: A Microsoft unified data platform.Training: Instruction to develop new skills.
52 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. NIKHILA NETHIKUNTA 3,585 Reputation points Microsoft Vendor
    2024-08-21T16:28:58.6+00:00

    Hi @Ahwan Mishra
    Thank you for the question and using Microsoft Q&A platform.
    The error you're encountering suggests that Azure Data Factory is no longer supporting new Managed Apache Airflow integration runtime environments. Instead, Microsoft is directing users toward Microsoft Fabric for creating and managing Apache Airflow workflows.

    Microsoft Fabric has integrated Apache Airflow capabilities and offers additional features and flexibility compared to ADF's Managed Airflow, such as enhanced scalability, better performance, and tighter integration with other Microsoft services. It seems that Microsoft is gradually transitioning users from Azure Data Factory's Airflow environment to Fabric for managing workflows.

    To resolve this issue, you can:

    1. Explore Microsoft Fabric: Set up a new Apache Airflow workflow environment within Microsoft Fabric, where you'll find more advanced features and broader support for workflow automation.
    2. Migrate existing workflows: If you already have Airflow workflows in ADF, you might need to migrate those workflows to Fabric to take advantage of the enhanced capabilities.

    For more information you can refer to the below links:
    https://blog.fabric.microsoft.com/en-us/blog/introducing-data-workflows-in-microsoft-fabric/
    https://learn.microsoft.com/en-us/fabric/data-factory/data-workflows-migrate-azure-workflow-orchestration-manager
    https://learn.microsoft.com/en-us/fabric/data-factory/data-workflows-hello-world

    Hope this helps. Do let us know if you any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.