What is query planning and optimization in distributed data engines?

Query planning converts a SQL query into an optimized execution strategy.

Query planners in systems like Spark or Presto transform SQL into logical and physical execution plans. Optimization techniques include predicate pushdown, join reordering, cost-based optimization (CBO), and column pruning. The goal is to minimize I/O, network shuffle, and compute cost while maximizing parallel execution efficiency.