Which of the following describes why the statement might not have copied any new records into the table?

A data engineer runs a statement every day to copy the previous day’s sales into the table transactions. Each day’s sales are in their own file in the location "/transactions/raw".

Today, the data engineer runs the following command to complete this task:

After running the command today, the data engineer notices that the number of records in table transactions has not changed.

Which of the following describes why the statement might not have copied any new records into the table?
A . The format of the files to be copied were not included with the FORMAT_OPTIONS keyword.
B . The names of the files to be copied were not included with the FILES keyword.
C . The previous day’s file has already been copied into the table.
D . The PARQUET file format does not support COPY INTO.
E . The COPY INTO statement requires the table to be refreshed to view the copied rows.

Answer: C

Explanation:

https://docs.databricks.com/en/ingestion/copy-into/index.html

The COPY INTO SQL command lets you load data from a file location into a Delta table. This is a re-triable and idempotent operation; files in the source location that have already been loaded are skipped. if there are no new records, the only consistent choice is C no new files were loaded because already loaded files were skipped.

Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments