Advanced Dynamic Partition Pruning (DPP).

DPP allows Spark to prune partitions of a dimension table based on results from a fact table during join.

When joining a large Fact table with a small Dimension table, Spark injects a subquery to find matching IDs from the dimension table and uses them to skip reading Fact partitions.