Create Materialized Views via DLT Pipelines

Ashwini Gaikwad 130

I am attempting to create materialized views via DLT pipelines in the "abc" catalog and "gold" schema based on different catalog and schema ("fmv"), which contains 20 tables.

Workspace binding , NSG connections and access part is already achieved between both the catalogs.

However, the DLT pipelines fail during the initialization stage with the following error:

"You attempted to update an empty pipeline. This error usually means no tables were discovered in your specified source code. Please verify your source code contains table definitions."

Is it possible to create materialized views in one catalog and schema based on tables residing under different catalog and schema? If so, what are the steps to achieve this?

YutongTie-MSFT 53,221 Reputation points

2024-11-23T01:00:47.3033333+00:00

@Ashwini Gaikwad Thanks for reaching out to us, we are checking on this issue internally and will let you know soon.

Regards,

Yutong
AnnuKumari-MSFT 33,556 Reputation points Microsoft Employee

2024-11-23T17:56:58.99+00:00
Hi Ashwini Gaikwad ,

Thankyou for using Microsoft Q&A platform and thanks for posting your query here.

Based on the provided information, it seems that you are trying to create materialized views via DLT pipelines . However, the DLT pipelines fail during the initialization stage with the error message "You attempted to update an empty pipeline. This error usually means no tables were discovered in your specified source code. Please verify your source code contains table definitions."

To answer your question, it is possible to create materialized views in one catalog and schema based on tables residing under different catalog and schema. However, it is important to ensure that the necessary permissions and access are granted to the user or service principal creating the materialized views. Specifically, Kindly ensure that the service principal running the DLT pipeline has:

Read access to the source catalog/schema where the base tables reside.

Write access to the target catalog/schema where the materialized views will be created.

Additionally, kindly make sure to use fully qualified table name.

Hope it helps. Kindly let us know how it goes. Thankyou

Share via

Create Materialized Views via DLT Pipelines

Your answer