1. [SPARK-24851][UI] Map a Stage ID to it's Associated Job ID (details)
  2. [SPARK-25535][CORE] Work around bad error handling in commons-crypto. (details)
Commit deb9588b2ab6596b30ab17f56c59951cabf57162 by tgraves
[SPARK-24851][UI] Map a Stage ID to it's Associated Job ID
It would be nice to have a field in Stage Page UI which would show
mapping of the current stage id to the job id's to which that stage
belongs to.
## What changes were proposed in this pull request?
Added a field in Stage UI to display the corresponding job id for that
particular stage.
## How was this patch tested?
<img width="448" alt="screen shot 2018-07-25 at 1 33 07 pm"
Closes #21809 from pgandhi999/SPARK-24851.
Authored-by: pgandhi <> Signed-off-by: Thomas Graves
The file was modifiedcore/src/main/scala/org/apache/spark/status/AppStatusStore.scala (diff)
The file was modifiedcore/src/main/scala/org/apache/spark/status/api/v1/StagesResource.scala (diff)
The file was modifiedcore/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala (diff)
Commit 3eee9e02463e10570a29fad00823c953debd945e by irashid
[SPARK-25535][CORE] Work around bad error handling in commons-crypto.
The commons-crypto library does some questionable error handling
internally, which can lead to JVM crashes if some call into native code
fails and cleans up state it should not.
While the library is not fixed, this change adds some workarounds in
Spark code so that when an error is detected in the commons-crypto side,
Spark avoids calling into the library further.
Tested with existing and added unit tests.
Closes #22557 from vanzin/SPARK-25535.
Authored-by: Marcelo Vanzin <> Signed-off-by: Imran
Rashid <>
The file was modifiedcore/src/main/scala/org/apache/spark/security/CryptoStreamUtils.scala (diff)
The file was modifiedcommon/network-common/src/main/java/org/apache/spark/network/crypto/ (diff)
The file was modifiedcore/src/test/scala/org/apache/spark/security/CryptoStreamUtilsSuite.scala (diff)
The file was modifiedcommon/network-common/src/test/java/org/apache/spark/network/crypto/ (diff)
The file was modifiedcommon/network-common/src/main/java/org/apache/spark/network/crypto/ (diff)