Question 1

If we want to create a constant string 1 as a new column ‘new_column’ in the dataframe df, which code block should we select ?

Options :

A : df.withColumn(new_column, lit(1))

B : df.withColumn(“new_column”, 1)

C : df.withColumn(“new_column”, lit(1))

D : df.withColumnRenamed('new_column', lit(1))

E : df.withColumn(”new_column”, lit(“1”))

Answer: A

Question 2

Which of the following is the deepest level in Spark's execution hierarchy?

Options :

A : Job

B : Task

C : Executor

D : Slot

E : Stage

Answer: B

Question 3

Which of the following transformation is not evaluated lazily ?

Options :

A : repartition()

B : select()

C : None of the responses, all transformations are lazily evaluated.

D : filter()

E : sample()

Answer: C

Question 4

Which of the following is correct for the cluster manager ?

Options :

A : Executes code assigned to it.

B : Keeps track of the resources available.

C :

It is interchangeable with job.

D : Reports the state of the computation back to the driver.

E : All of the answers are correct.

Answer: B

Question 5

When joining two dataframes, if there is a need to evaluate the keys in both of the DataFrames or tables and include all rows from the right DataFrame as well as any rows

in the left DataFrame that have a match in the righ DataFrame also If there is no equivalent row in the left DataFrame, we want to instert null: which join type we should

select ? df1.join(person, joinExpression, joinType)

Options :

A :

joinType = “right_outer”

B : joinType = “rightSemi”

C :

joinType = “rightAnti”

D :

joinType = “rightOuter”

Answer: A