SuccessChanges

Summary

  1. [SPARK-24119][SQL] Add interpreted execution to SortPrefix expression (commit: 1462bba4fd99a264ebc8679db91dfc62d0b9a35f) (details)
  2. [SPARK-24224][ML-EXAMPLES] Java example code for Power Iteration (commit: 2c100209f0b73e882ab953993b307867d1df7c2f) (details)
  3. [SPARK-24191][ML] Scala Example code for Power Iteration Clustering (commit: a5d775a1f3aad7bef0ac0f93869eaf96b677411b) (details)
  4. [SPARK-24477][SPARK-24454][ML][PYTHON] Imports submodule in (commit: 173fe450df203b262b58f7e71c6b52a79db95ee0) (details)
  5. resolve comments on docs and addition of unit test (commit: a61d8973a8961fa69e50757f049b04bda292a088) (details)
Commit 1462bba4fd99a264ebc8679db91dfc62d0b9a35f by hvanhovell
[SPARK-24119][SQL] Add interpreted execution to SortPrefix expression
## What changes were proposed in this pull request?
Implemented eval in SortPrefix expression.
## How was this patch tested?
- ran existing sbt SQL tests
- added unit test
- ran existing Python SQL tests
- manual tests: disabling codegen -- patching code to disable beyond
what spark.sql.codegen.wholeStage=false can do -- and running sbt SQL
tests
Author: Bruce Robbins <bersprockets@gmail.com>
Closes #21231 from bersprockets/sortprefixeval.
(commit: 1462bba4fd99a264ebc8679db91dfc62d0b9a35f)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SortOrder.scala (diff)
The file was addedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/SortOrderExpressionsSuite.scala
Commit 2c100209f0b73e882ab953993b307867d1df7c2f by srowen
[SPARK-24224][ML-EXAMPLES] Java example code for Power Iteration
Clustering in spark.ml
## What changes were proposed in this pull request?
Java example code for Power Iteration Clustering  in spark.ml
## How was this patch tested?
Locally tested
Author: Shahid <shahidki31@gmail.com>
Closes #21283 from shahidki31/JavaPicExample.
(commit: 2c100209f0b73e882ab953993b307867d1df7c2f)
The file was addedexamples/src/main/java/org/apache/spark/examples/ml/JavaPowerIterationClusteringExample.java
Commit a5d775a1f3aad7bef0ac0f93869eaf96b677411b by srowen
[SPARK-24191][ML] Scala Example code for Power Iteration Clustering
## What changes were proposed in this pull request?
Added example code for Power Iteration Clustering in Spark ML examples
Author: Shahid <shahidki31@gmail.com>
Closes #21248 from shahidki31/sparkCommit.
(commit: a5d775a1f3aad7bef0ac0f93869eaf96b677411b)
The file was addedexamples/src/main/scala/org/apache/spark/examples/ml/PowerIterationClusteringExample.scala
Commit 173fe450df203b262b58f7e71c6b52a79db95ee0 by meng
[SPARK-24477][SPARK-24454][ML][PYTHON] Imports submodule in
ml/__init__.py and add ImageSchema into __all__
## What changes were proposed in this pull request?
This PR attaches submodules to ml's `__init__.py` module.
Also, adds `ImageSchema` into `image.py` explicitly.
## How was this patch tested?
Before:
```python
>>> from pyspark import ml
>>> ml.image Traceback (most recent call last):
File "<stdin>", line 1, in <module> AttributeError: 'module' object has
no attribute 'image'
>>> ml.image.ImageSchema Traceback (most recent call last):
File "<stdin>", line 1, in <module> AttributeError: 'module' object has
no attribute 'image'
```
```python
>>> "image" in globals() False
>>> from pyspark.ml import *
>>> "image" in globals() False
>>> image Traceback (most recent call last):
File "<stdin>", line 1, in <module> NameError: name 'image' is not
defined
```
After:
```python
>>> from pyspark import ml
>>> ml.image
<module 'pyspark.ml.image' from
'/.../spark/python/pyspark/ml/image.pyc'>
>>> ml.image.ImageSchema
<pyspark.ml.image._ImageSchema object at 0x10d973b10>
```
```python
>>> "image" in globals() False
>>> from pyspark.ml import *
>>> "image" in globals() True
>>> image
<module 'pyspark.ml.image' from
#'/.../spark/python/pyspark/ml/image.pyc'>
```
Author: hyukjinkwon <gurwls223@apache.org>
Closes #21483 from HyukjinKwon/SPARK-24454.
(commit: 173fe450df203b262b58f7e71c6b52a79db95ee0)
The file was modifiedpython/pyspark/ml/image.py (diff)
The file was modifiedpython/pyspark/ml/__init__.py (diff)
Commit a61d8973a8961fa69e50757f049b04bda292a088 by if56
resolve comments on docs and addition of unit test
(commit: a61d8973a8961fa69e50757f049b04bda292a088)
The file was modifieddocs/running-on-kubernetes.md (diff)
The file was modifiedresource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/KubernetesConfSuite.scala (diff)