SuccessChanges

Summary

  1. [SPARK-23491][SS] Remove explicit job cancellation from (details)
  2. [SPARK-23416][SS] Add a specific stop method for ContinuousExecution. (details)
Commit 7f13fd0c5a79ab21c4ace2445127e6c69a7f745c by yamamuro
[SPARK-23491][SS] Remove explicit job cancellation from
ContinuousExecution reconfiguring
## What changes were proposed in this pull request?
Remove queryExecutionThread.interrupt() from ContinuousExecution. As
detailed in the JIRA, interrupting the thread is only relevant in the
microbatch case; for continuous processing the query execution can
quickly clean itself up without.
## How was this patch tested?
existing tests
Author: Jose Torres <jose@databricks.com>
Closes #20622 from jose-torres/SPARK-23441.
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousExecution.scala (diff)
Commit 55d5a19c8e01de945c4c9e42752ed132df4b9110 by yamamuro
[SPARK-23416][SS] Add a specific stop method for ContinuousExecution.
## What changes were proposed in this pull request?
Add a specific stop method for ContinuousExecution. The previous
StreamExecution.stop() method had a race condition as applied to
continuous processing: if the cancellation was round-tripped to the
driver too quickly, the generic SparkException it caused would be
reported as the query death cause. We earlier decided that
SparkException should not be added to the
StreamExecution.isInterruptionException() whitelist, so we need to
ensure this never happens instead.
## How was this patch tested?
Existing tests. I could consistently reproduce the previous flakiness by
putting Thread.sleep(1000) between the first job cancellation and thread
interruption in StreamExecution.stop().
Author: Jose Torres <torres.joseph.f+github@gmail.com>
Closes #21384 from jose-torres/fixKafka.
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala (diff)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala (diff)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousExecution.scala (diff)