The optimizer used by Spark SQL is the Catalyst optimizer. Its main job is to optimize queries that are written in Spark SQL and DataFrame DSL. The Catalyst Optimizer runs queries much faster than its counterpart, RDD.

Suggest An Answer

No suggestions avaliable!