Databricks Certified Professional Data Engineer - Databricks-Certified-Professional-Data-Engineer Free Exam Questions

A. Update the task by adding the missing task parameter, and manually run the job.

B. Share the analysis with the failing notebook owner so that they can fix it quickly.

C. Repair the run with the new parameter, and update the task by adding the missing task parameter.

D. Repair the run with the new parameter.

A. Set spark.sql.files.maxPartitionBytes to 512 MB, ingest the data, execute the narrow transformations, and then write to parquet.

B. Ingest the data, execute the narrow transformations, repartition to 2,048 partitions (1TB* 1024*1024
/512), and then write to parquet.

C. Set spark.sql.shuffle.partitions to 2,048 partitions (1TB*1024*1024/512), ingest the data, execute the narrow transformations, optimize the data by sorting it (which automatically repartitions the data), and then write to parquet.

D. Set spark.sql.adaptive.advisoryPartitionSizeInBytes to 512 MB bytes, ingest the data, execute the narrow transformations, coalesce to 2,048 partitions (1TB*1024*1024/512), and then write to parquet.

E. Set spark.sql.shuffle.partitions to 512, ingest the data, execute the narrow transformations, and then write to parquet.

A. %sh executes shell code on the driver node. The code does not take advantage of the worker nodes or Databricks optimized Spark.

B. Python will always execute slower than Scala on Databricks. The run.py script should be refactored to Scala.

C. %sh triggers a cluster restart to collect and install Git. Most of the latency is related to cluster startup time.

D. Instead of cloning, the code should use %sh pip install so that the Python code can get executed in parallel across all nodes in a cluster.

E. %sh does not distribute file moving operations; the final line of code should be updated to use %fs instead.

A. ignoreChanges = false

B. validateSchema = false

C. overwriteSchema = true

D. mergeSchema = true

A. Can Read

B. Can manage

C. Can edit

D. Can run

A. A batch job will update the gold_customer_lifetime_sales_summary table, replacing only those rows that have different values than the current version of the table, using customer_id as the primary key.

B. The silver_customer_sales table will be overwritten by aggregated values calculated from all records in the gold_customer_lifetime_sales_summary table as a batch job.

C. An incremental job will detect if new rows have been written to the silver_customer_sales table; if new rows are detected, all aggregates will be recalculated and used to overwrite the gold_customer_lifetime_sales_summary table.

D. The gold_customer_lifetime_sales_summary table will be overwritten by aggregated values calculated from all records in the silver_customer_sales table as a batch job.

E. An incremental job will leverage running information in the state store to update aggregate values in the gold_customer_lifetime_sales_summary table.

A. No; only one stream can write to a Delta Lake table.

B. No; each of the streams needs to have its own checkpoint directory.

C. Yes; Delta Lake supports infinite concurrent writers.

D. No; Delta Lake manages streaming checkpoints in the transaction log.

E. Yes; both of the streams can share a single checkpoint directory.

A. All columns will be displayed normally for those records that have an age greater than 18; records not meeting this condition will be omitted.

B. All records from all columns will be displayed with the values in user_ltv.

C. All age values less than 18 will be returned as null values all other columns will be returned with the values in user_ltv.

D. All columns will be displayed normally for those records that have an age greater than 17; records not meeting this condition will be omitted.

A. When tables are created, make sure that the EXTERNAL keyword is used in the CREATE TABLE statement.

B. When the workspace is being configured, make sure that external cloud object storage has been mounted.

C. When a database is being created, make sure that the LOCATION keyword is used.

D. When data is saved to a table, make sure that a full file path is specified alongside the Delta format.

E. When configuring an external data warehouse for all table storage, leverage Databricks for all ELT.

A. Add a table comment warning all users that the table schema and field names will be changing on a given date; overwrite the table in place to the specifications of the customer-facing application.

B. Create a new table with the required schema and new fields and use Delta Lake ' s deep clone functionality to sync up changes committed to one table to the corresponding table.

C. Configure a new table with all the requisite fields and new names and use this as the source for the customer-facing application; create a view that maintains the original data schema and table name by aliasing select fields from the new table.

D. Replace the current table definition with a logical view defined with the query logic currently writing the aggregate table; create a new table to power the customer-facing application.

E. Send all users notice that the schema for the table will be changing; include in the communication the logic necessary to revert the new table schema to match historic queries.