1. [SPARK-23040][BACKPORT][CORE] Returns interruptible iterator for shuffle (commit: f1f10da2b4a0913dd230b4a4de95bf05a4672dce) (details)
Commit f1f10da2b4a0913dd230b4a4de95bf05a4672dce by wenchen
[SPARK-23040][BACKPORT][CORE] Returns interruptible iterator for shuffle
Backport and to branch-2.3
## What changes were proposed in this pull request? Before this commit,
a non-interruptible iterator is returned if aggregator or ordering is
specified. This commit also ensures that sorter is closed even when task
is cancelled(killed) in the middle of sorting.
## How was this patch tested? Add a unit test in JobCancellationSuite
Author: Xianjin YE <> Author: Xingbo Jiang
Closes #20954 from jiangxb1987/SPARK-23040-2.3.
(commit: f1f10da2b4a0913dd230b4a4de95bf05a4672dce)
The file was modifiedcore/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala (diff)
The file was modifiedcore/src/test/scala/org/apache/spark/JobCancellationSuite.scala (diff)