You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?
A . AUTO LOADER
B. JOBS and TASKS
C. SQL Endpoints
D. DELTA LIVE TABLES
E. STRUCTURED STREAMING with MULTI HOP

Answer: D

Explanation:

The answer is, DELTA LIVE TABLES

DLT simplifies data dependencies by building DAG-based joins between live tables. Here is a view of how the dag looks with data dependencies without additional meta data,

Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments