You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?A . AUTO LOADERB . JOBS and TASKSC . SQL EndpointsD...

November 11, 2023 No Comments READ MORE +

Which of the following statements can be used to test the functionality of code to test number of rows in the table equal to 10 in python?

Which of the following statements can be used to test the functionality of code to test number of rows in the table equal to 10 in python? row_count = spark.sql("select count(*) from table").collect()[0][0]A . assert (row_count = 10, "Row count did not match")B . assert if (row_count = 10, "Row...

November 11, 2023 No Comments READ MORE +

You noticed that colleague is manually copying the notebook with _bkp to store the previous versions, which of the following feature would you recommend instead.

You noticed that colleague is manually copying the notebook with _bkp to store the previous versions, which of the following feature would you recommend instead.A . Databricks notebooks support change tracking and versioningB . Databricks notebooks should be copied to a local machine and setup source control locally to version...

November 11, 2023 No Comments READ MORE +

What is the purpose of a silver layer in Multi hop architecture?

What is the purpose of a silver layer in Multi hop architecture?A . Replaces a traditional data lakeB . Efficient storage and querying of full and unprocessed history of dataC . A schema is enforced, with data quality checks.D . Refined views with aggregated dataE . Optimized query performance for...

November 11, 2023 No Comments READ MORE +

What is the expected behavior when a batch of data containing data that violates these constraints is processed?

A dataset has been defined using Delta Live Tables and includes an expectations clause: CON-STRAINT valid_timestamp EXPECT (timestamp > '2020-01-01') ON VIOLATION FAIL What is the expected behavior when a batch of data containing data that violates these constraints is processed?A . Records that violate the expectation are added to...

November 11, 2023 No Comments READ MORE +

You are asked to write a python function that can read data from a delta table and return the Data-Frame, which of the following is correct?

You are asked to write a python function that can read data from a delta table and return the Data-Frame, which of the following is correct?A . Python function cannot return a DataFrameB . Write SQL UDF to return a DataFrameC . Write SQL UDF that can return tabular dataD...

November 11, 2023 No Comments READ MORE +

Which of the following data workloads will utilize a Bronze table as its destination?

Which of the following data workloads will utilize a Bronze table as its destination?A . A job that aggregates cleaned data to create standard summary statisticsB . A job that queries aggregated data to publish key insights into a dashboardC . A job that ingests raw data from a streaming...

November 11, 2023 No Comments READ MORE +

Which of the following SQL statements can be used to update a transactions table, to set a flag on the table from Y to N

Which of the following SQL statements can be used to update a transactions table, to set a flag on the table from Y to NA . MODIFY transactions SET active_flag = 'N' WHERE active_flag = 'Y'B . MERGE transactions SET active_flag = 'N' WHERE active_flag = 'Y'C . UPDATE transactions...

November 11, 2023 No Comments READ MORE +