You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?A . AUTO LOADER B. JOBS and TASKS C. SQL Endpoints...

February 19, 2023 No Comments READ MORE +

You were asked to setup a new all-purpose cluster, but the cluster is unable to start which of the following steps do you need to take to identify the root cause of the issue and the reason why the cluster was unable to start?

You were asked to setup a new all-purpose cluster, but the cluster is unable to start which of the following steps do you need to take to identify the root cause of the issue and the reason why the cluster was unable to start?A . Check the cluster driver logs...

February 18, 2023 No Comments READ MORE +

How can we address this limitation?

When defining external tables using formats CSV, JSON, TEXT, BINARY any query on the exter-nal tables caches the data and location for performance reasons, so within a given spark session any new files that may have arrived will not be available after the initial query. How can we address this...

February 18, 2023 No Comments READ MORE +

Which of the following SQL statements can be used to update a transactions table, to set a flag on the table from Y to N

Which of the following SQL statements can be used to update a transactions table, to set a flag on the table from Y to NA . MODIFY transactions SET active_flag = 'N' WHERE active_flag = 'Y' B. MERGE transactions SET active_flag = 'N' WHERE active_flag = 'Y' C. UPDATE transactions...

February 18, 2023 No Comments READ MORE +

You are currently working on a production job failure with a job set up in job clusters due to a data issue, what cluster do you need to start to investigate and analyze the data?

You are currently working on a production job failure with a job set up in job clusters due to a data issue, what cluster do you need to start to investigate and analyze the data?A . A Job cluster can be used to analyze the problem B. All-purpose cluster/ interactive...

February 18, 2023 No Comments READ MORE +