You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?A . AUTO LOADER B. JOBS and TASKS C. SQL Endpoints...

March 18, 2023 No Comments READ MORE +

Which of the following SQL command can be used to insert or update or delete rows based on a condition to check if a row(s) exists?

Which of the following SQL command can be used to insert or update or delete rows based on a condition to check if a row(s) exists?A . MERGE INTO table_name B. COPY INTO table_name C. UPDATE table_name D. INSERT INTO OVERWRITE table_name E. INSERT IF EXISTS table_nameView AnswerAnswer: A Explanation:...

March 18, 2023 No Comments READ MORE +

Which of the following technique can be used to implement fine-grained access control to rows and columns of the Delta table based on the user's access?

Which of the following technique can be used to implement fine-grained access control to rows and columns of the Delta table based on the user's access?A . Use Unity catalog to grant access to rows and columns B. Row and column access control lists C. Use dynamic view functions D....

March 18, 2023 No Comments READ MORE +

Which of the following statements can be used to test the functionality of code to test number of rows in the table equal to 10 in python?

Which of the following statements can be used to test the functionality of code to test number of rows in the table equal to 10 in python? row_count = spark.sql("select count(*) from table").collect()[0][0]A . assert (row_count = 10, "Row count did not match") B. assert if (row_count = 10, "Row...

March 18, 2023 No Comments READ MORE +

Data engineering team has provided 10 queries and asked Data Analyst team to build a dashboard and refresh the data every day at 8 AM, identify the best approach to set up data refresh for this dashaboard?

Data engineering team has provided 10 queries and asked Data Analyst team to build a dashboard and refresh the data every day at 8 AM, identify the best approach to set up data refresh for this dashaboard?A . Each query requires a separate task and setup 10 tasks under a...

March 18, 2023 No Comments READ MORE +

What is the purpose of a gold layer in Multi-hop architecture?

What is the purpose of a gold layer in Multi-hop architecture?A . Optimizes ETL throughput and analytic query performance B. Eliminate duplicate records C. Preserves grain of original data, without any aggregations D. Data quality checks and schema enforcement E. Powers ML applications, reporting, dashboards and adhoc reports.View AnswerAnswer: E...

March 18, 2023 No Comments READ MORE +

What is the purpose of the silver layer in a Multi hop architecture?

What is the purpose of the silver layer in a Multi hop architecture?A . Replaces a traditional data lake B. Efficient storage and querying of full, unprocessed history of data C. Eliminates duplicate data, quarantines bad data D. Refined views with aggregated data E. Optimized query performance for business-critical dataView...

March 18, 2023 No Comments READ MORE +