FailedChanges

Summary

  1. [SPARK-25763][SQL][PYSPARK][TEST] Use more `@contextmanager` to ensure (details)
  2. [SPARK-25682][K8S] Package example jars in same target for dev and (details)
  3. [SPARK-25758][ML] Deprecate computeCost on BisectingKMeans (details)
  4. [SPARK-24499][SQL][DOC] Split the page of sql-programming-guide.html to (details)
Commit e80f18dbd8bc4c2aca9ba6dd487b50e95c55d2e6 by hyukjinkwon
[SPARK-25763][SQL][PYSPARK][TEST] Use more `@contextmanager` to ensure
clean-up each test.
## What changes were proposed in this pull request?
Currently each test in `SQLTest` in PySpark is not cleaned properly. We
should introduce and use more `contextmanager` to be convenient to clean
up the context properly.
## How was this patch tested?
Modified tests.
Closes #22762 from ueshin/issues/SPARK-25763/cleanup_sqltests.
Authored-by: Takuya UESHIN <ueshin@databricks.com> Signed-off-by:
hyukjinkwon <gurwls223@apache.org>
The file was modifiedpython/pyspark/sql/tests.py (diff)
Commit 15524c41b27697c478981cb2df7d5d7df02f3ba4 by vanzin
[SPARK-25682][K8S] Package example jars in same target for dev and
distro images.
This way the image generated from both environments has the same layout,
with just a difference in contents that should not affect functionality.
Also added some minor error checking to the image script.
Closes #22681 from vanzin/SPARK-25682.
Authored-by: Marcelo Vanzin <vanzin@cloudera.com> Signed-off-by: Marcelo
Vanzin <vanzin@cloudera.com>
The file was modifiedresource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile (diff)
The file was modifiedbin/docker-image-tool.sh (diff)
Commit c2962546d9a5900a5628a31b83d2c4b22c3a7936 by dongjoon
[SPARK-25758][ML] Deprecate computeCost on BisectingKMeans
## What changes were proposed in this pull request?
The PR proposes to deprecate the `computeCost` method on
`BisectingKMeans` in favor of the adoption of `ClusteringEvaluator` in
order to evaluate the clustering.
## How was this patch tested?
NA
Closes #22756 from mgaido91/SPARK-25758.
Authored-by: Marco Gaido <marcogaido91@gmail.com> Signed-off-by:
Dongjoon Hyun <dongjoon@apache.org>
The file was modifiedpython/pyspark/ml/clustering.py (diff)
The file was modifiedmllib/src/main/scala/org/apache/spark/ml/clustering/BisectingKMeans.scala (diff)
Commit 987f386588de7311b066cf0f62f0eed64d4aa7d7 by gatorsmile
[SPARK-24499][SQL][DOC] Split the page of sql-programming-guide.html to
multiple separate pages
## What changes were proposed in this pull request?
1. Split the main page of sql-programming-guide into 7 parts:
- Getting Started
- Data Sources
- Performance Turing
- Distributed SQL Engine
- PySpark Usage Guide for Pandas with Apache Arrow
- Migration Guide
- Reference
2. Add left menu for sql-programming-guide, keep first level index for
each part in the menu.
![image](https://user-images.githubusercontent.com/4833765/47016859-6332e180-d183-11e8-92e8-ce62518a83c4.png)
## How was this patch tested?
Local test with jekyll build/serve.
Closes #22746 from xuanyuanking/SPARK-24499.
Authored-by: Yuanjian Li <xyliyuanjian@gmail.com> Signed-off-by:
gatorsmile <gatorsmile@gmail.com>
The file was addeddocs/sql-migration-guide-upgrade.md
The file was modifieddocs/_layouts/global.html (diff)
The file was addeddocs/sql-data-sources-json.md
The file was addeddocs/sql-data-sources-orc.md
The file was addeddocs/sql-reference.md
The file was modifieddocs/structured-streaming-programming-guide.md (diff)
The file was modifieddocs/sparkr.md (diff)
The file was addeddocs/sql-data-sources-avro.md
The file was modifieddocs/sql-programming-guide.md (diff)
The file was modifieddocs/_includes/nav-left.html (diff)
The file was addeddocs/sql-getting-started.md
The file was addeddocs/sql-migration-guide.md
The file was addeddocs/sql-data-sources-troubleshooting.md
The file was addeddocs/sql-performance-turing.md
The file was addeddocs/sql-data-sources.md
The file was addeddocs/sql-distributed-sql-engine.md
The file was addeddocs/sql-migration-guide-hive-compatibility.md
The file was removeddocs/avro-data-source-guide.md
The file was addeddocs/_data/menu-sql.yaml
The file was addeddocs/_includes/nav-left-wrapper-sql.html
The file was addeddocs/sql-data-sources-jdbc.md
The file was addeddocs/sql-data-sources-load-save-functions.md
The file was modifieddocs/ml-pipeline.md (diff)
The file was addeddocs/sql-pyspark-pandas-with-arrow.md
The file was addeddocs/sql-data-sources-parquet.md
The file was addeddocs/sql-data-sources-hive-tables.md