1. [SPARK-24309][CORE] AsyncEventQueue should stop on interrupt. (commit: 70b86654857a93deecc1e97f0af9faa7ef91326d) (details)
Commit 70b86654857a93deecc1e97f0af9faa7ef91326d by vanzin
[SPARK-24309][CORE] AsyncEventQueue should stop on interrupt.
EventListeners can interrupt the event queue thread.  In particular,
when the EventLoggingListener writes to hdfs, hdfs can interrupt the
thread.  When there is an interrupt, the queue should be removed and
stop accepting any more events.  Before this change, the queue would
continue to take more events (till it was full), and then would not stop
when the application was complete because the PoisonPill couldn't be
Added a unit test which failed before this change.
Author: Imran Rashid <>
Closes #21356 from squito/SPARK-24309.
(cherry picked from commit 32447079e9d0fa9f7e180b94ecac19091b6af1ab)
Signed-off-by: Marcelo Vanzin <>
(commit: 70b86654857a93deecc1e97f0af9faa7ef91326d)
The file was modifiedcore/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala (diff)
The file was modifiedcore/src/main/scala/org/apache/spark/util/ListenerBus.scala (diff)
The file was modifiedcore/src/main/scala/org/apache/spark/scheduler/AsyncEventQueue.scala (diff)
The file was modifiedcore/src/test/scala/org/apache/spark/scheduler/SparkListenerSuite.scala (diff)