SuccessChanges

Summary

  1. [SPARK-23475][WEBUI] Skipped stages should be evicted before completed (commit: a0d7949896e70f427e7f3942ff340c9484ff0aab) (details)
  2. Preparing Spark release v2.3.0-rc5 (commit: 992447fb30ee9ebb3cf794f2d06f4d63a2d792db) (details)
  3. Preparing development version 2.3.1-SNAPSHOT (commit: 285b841ffbfb21c0af3f83800f7815fb0bfe3627) (details)
Commit a0d7949896e70f427e7f3942ff340c9484ff0aab by gatorsmile
[SPARK-23475][WEBUI] Skipped stages should be evicted before completed
stages
## What changes were proposed in this pull request?
The root cause of missing completed stages is because `cleanupStages`
will never remove skipped stages.
This PR changes the logic to always remove skipped stage first. This is
safe since  the job itself contains enough information to render skipped
stages in the UI.
## How was this patch tested?
The new unit tests.
Author: Shixiong Zhu <zsxwing@gmail.com>
Closes #20656 from zsxwing/SPARK-23475.
(cherry picked from commit 45cf714ee6d4eead2fe00794a0d754fa6d33d4a6)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
(commit: a0d7949896e70f427e7f3942ff340c9484ff0aab)
The file was modifiedcore/src/test/scala/org/apache/spark/status/AppStatusListenerSuite.scala (diff)
The file was modifiedcore/src/main/scala/org/apache/spark/status/AppStatusListener.scala (diff)
The file was modifiedexternal/kafka-0-8-assembly/pom.xml (diff)
The file was modifiedrepl/pom.xml (diff)
The file was modifiedexternal/kafka-0-10-sql/pom.xml (diff)
The file was modifiedresource-managers/kubernetes/core/pom.xml (diff)
The file was modifiedexternal/kafka-0-10/pom.xml (diff)
The file was modifiedmllib/pom.xml (diff)
The file was modifiedsql/catalyst/pom.xml (diff)
The file was modifiedcommon/network-common/pom.xml (diff)
The file was modifiedcommon/sketch/pom.xml (diff)
The file was modifiedexternal/flume-sink/pom.xml (diff)
The file was modifiedexternal/flume/pom.xml (diff)
The file was modifiedexternal/kafka-0-8/pom.xml (diff)
The file was modifiedlauncher/pom.xml (diff)
The file was modifiedcore/pom.xml (diff)
The file was modifieddocs/_config.yml (diff)
The file was modifiedexternal/spark-ganglia-lgpl/pom.xml (diff)
The file was modifiedcommon/network-yarn/pom.xml (diff)
The file was modifiedassembly/pom.xml (diff)
The file was modifiedexamples/pom.xml (diff)
The file was modifiedhadoop-cloud/pom.xml (diff)
The file was modifiedsql/hive-thriftserver/pom.xml (diff)
The file was modifiedcommon/network-shuffle/pom.xml (diff)
The file was modifiedexternal/flume-assembly/pom.xml (diff)
The file was modifiedcommon/kvstore/pom.xml (diff)
The file was modifiedpom.xml (diff)
The file was modifiedpython/pyspark/version.py (diff)
The file was modifiedsql/core/pom.xml (diff)
The file was modifiedcommon/unsafe/pom.xml (diff)
The file was modifiedresource-managers/mesos/pom.xml (diff)
The file was modifiedexternal/kinesis-asl-assembly/pom.xml (diff)
The file was modifiedexternal/kinesis-asl/pom.xml (diff)
The file was modifiedexternal/kafka-0-10-assembly/pom.xml (diff)
The file was modifiedgraphx/pom.xml (diff)
The file was modifiedmllib-local/pom.xml (diff)
The file was modifiedresource-managers/yarn/pom.xml (diff)
The file was modifiedsql/hive/pom.xml (diff)
The file was modifiedcommon/tags/pom.xml (diff)
The file was modifiedR/pkg/DESCRIPTION (diff)
The file was modifiedstreaming/pom.xml (diff)
The file was modifiedtools/pom.xml (diff)
The file was modifiedexternal/docker-integration-tests/pom.xml (diff)
The file was modifiedresource-managers/yarn/pom.xml (diff)
The file was modifiedexternal/flume-sink/pom.xml (diff)
The file was modifiedresource-managers/kubernetes/core/pom.xml (diff)
The file was modifiedcommon/network-shuffle/pom.xml (diff)
The file was modifiedmllib/pom.xml (diff)
The file was modifiedexternal/kafka-0-10/pom.xml (diff)
The file was modifiedsql/core/pom.xml (diff)
The file was modifiedcommon/tags/pom.xml (diff)
The file was modifiedtools/pom.xml (diff)
The file was modifiedcommon/sketch/pom.xml (diff)
The file was modifiedcore/pom.xml (diff)
The file was modifiedcommon/kvstore/pom.xml (diff)
The file was modifiedmllib-local/pom.xml (diff)
The file was modifiedassembly/pom.xml (diff)
The file was modifiedsql/hive-thriftserver/pom.xml (diff)
The file was modifiedexternal/kafka-0-8/pom.xml (diff)
The file was modifiedexternal/docker-integration-tests/pom.xml (diff)
The file was modifiedsql/catalyst/pom.xml (diff)
The file was modifiedcommon/network-yarn/pom.xml (diff)
The file was modifiedexternal/kinesis-asl-assembly/pom.xml (diff)
The file was modifiedexternal/kinesis-asl/pom.xml (diff)
The file was modifiedlauncher/pom.xml (diff)
The file was modifiedcommon/unsafe/pom.xml (diff)
The file was modifiedcommon/network-common/pom.xml (diff)
The file was modifiedexternal/flume/pom.xml (diff)
The file was modifiedgraphx/pom.xml (diff)
The file was modifiedrepl/pom.xml (diff)
The file was modifieddocs/_config.yml (diff)
The file was modifiedexternal/kafka-0-10-sql/pom.xml (diff)
The file was modifiedpom.xml (diff)
The file was modifiedexternal/flume-assembly/pom.xml (diff)
The file was modifiedexamples/pom.xml (diff)
The file was modifiedpython/pyspark/version.py (diff)
The file was modifiedsql/hive/pom.xml (diff)
The file was modifiedR/pkg/DESCRIPTION (diff)
The file was modifiedexternal/spark-ganglia-lgpl/pom.xml (diff)
The file was modifiedhadoop-cloud/pom.xml (diff)
The file was modifiedstreaming/pom.xml (diff)
The file was modifiedresource-managers/mesos/pom.xml (diff)
The file was modifiedexternal/kafka-0-8-assembly/pom.xml (diff)
The file was modifiedexternal/kafka-0-10-assembly/pom.xml (diff)