Question 1

The data engineering team is looking to add a new column to the table, but the QA team would like to test the change which of the below options allow you to quickly copy the table from Prod to QA environment, modify and run the tests

Options :

A : DEEP CLONE

B : SHADOW CLONE

C :

ZERO COPY CLONE

D : SHALLOW CLONE

E : METADATA CLONE

Answer: D

Question 2

A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.

Which command could the data engineering team use to access sales in PySpark?

Options :

A : SELECT * FROM sales

B : spark.table("sales")

C : spark.sql("sales")

D : spark.delta.table("sales")

Answer: B

Question 3

Which SQL keyword can be used to convert a table from a long format to a wide format?

Options :

A : TRANSFORM

B : PIVOT

C : SUM

D : CONVERT

E : WHERE

Answer: B

Question 4

Operations team is using a centralized data quality monitoring system, a user can publish data quality metrics through a webhook, you were asked to develop a process to send messages using webhook if there is atleast one duplicate record, which of following approaches can be taken to integrate with current data quality monitoring system

Options :

A : Use notebook and Jobs to use python to publish DQ metrics

B : Setup an alert to send an email, use python to parse email, and publish a webhook message

C : Setup an alert with custom template

D : Setup an alert with custom Webhook destination

E : Setup an alert with dynamic template

Answer: D

Question 5

Which of the following benefits is provided by the array functions from Spark SQL?

Options :

A : An ability to work with data in a variety of types at once

B : An ability to work with data within certain partitions and windows

C : An ability to work with time-related data in specified intervals

D : An ability to work with complex, nested data ingested from JSON files

E : An ability to work with an array of tables for procedural automation

Answer: B