SuccessChanges

Summary

  1. [SPARK-26538][SQL] Set default precision and scale for elements of (commit: 6d063ee07c3ee591131d2ad1debdb9540428b5ff) (details)
  2. [SPARK-26010][R] fix vignette eval with Java 11 (commit: 20b749021bacaa2906775944e43597ccf37af62b) (details)
  3. [SPARK-25572][SPARKR] test only if not cran (commit: 01511e479013c56d70fe8ffa805ecbd66591b57e) (details)
  4. Preparing Spark release v2.3.3-rc1 (commit: 2e01a70bfac7aedfd5992d49e13a9f8f6a92d8a2) (details)
  5. Preparing development version 2.3.4-SNAPSHOT (commit: 3137dca44b69a0b224842dd727c96c6b5bb0430d) (details)
  6. [SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in (commit: 19797124f1e169138258c8c113874ec6ffedbe3d) (details)
Commit 6d063ee07c3ee591131d2ad1debdb9540428b5ff by dongjoon
[SPARK-26538][SQL] Set default precision and scale for elements of
postgres numeric array
## What changes were proposed in this pull request?
When determining CatalystType for postgres columns with type `numeric[]`
set the type of array element to `DecimalType(38, 18)` instead of
`DecimalType(0,0)`.
## How was this patch tested?
Tested with modified `org.apache.spark.sql.jdbc.JDBCSuite`. Ran the
`PostgresIntegrationSuite` manually.
Closes #23456 from a-shkarupin/postgres_numeric_array.
Lead-authored-by: Oleksii Shkarupin <a.shkarupin@gmail.com>
Co-authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by:
Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit 5b37092311bfc1255f1d4d81127ae4242ba1d1aa)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(commit: 6d063ee07c3ee591131d2ad1debdb9540428b5ff)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/jdbc/PostgresDialect.scala (diff)
The file was modifiedexternal/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/PostgresIntegrationSuite.scala (diff)
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala (diff)
Commit 20b749021bacaa2906775944e43597ccf37af62b by yamamuro
[SPARK-26010][R] fix vignette eval with Java 11
## What changes were proposed in this pull request?
changes in vignette only to disable eval
## How was this patch tested?
Jenkins
Author: Felix Cheung <felixcheung_m@hotmail.com>
Closes #23007 from felixcheung/rjavavervig.
(cherry picked from commit 88c82627267a9731b2438f0cc28dd656eb3dc834)
Signed-off-by: Felix Cheung <felixcheung@apache.org>
(commit: 20b749021bacaa2906775944e43597ccf37af62b)
The file was modifiedR/pkg/vignettes/sparkr-vignettes.Rmd (diff)
Commit 01511e479013c56d70fe8ffa805ecbd66591b57e by yamamuro
[SPARK-25572][SPARKR] test only if not cran
## What changes were proposed in this pull request?
CRAN doesn't seem to respect the system requirements as running tests -
we have seen cases where SparkR is run on Java 10, which unfortunately
Spark does not start on. For 2.4, lets attempt skipping all tests
## How was this patch tested?
manual, jenkins, appveyor
Author: Felix Cheung <felixcheung_m@hotmail.com>
Closes #22589 from felixcheung/ralltests.
(cherry picked from commit f4b138082ff91be74b0f5bbe19cdb90dd9e5f131)
Signed-off-by: Takeshi Yamamuro <yamamuro@apache.org>
(commit: 01511e479013c56d70fe8ffa805ecbd66591b57e)
The file was modifiedR/pkg/tests/run-all.R (diff)
The file was modifiedexternal/kafka-0-10-assembly/pom.xml (diff)
The file was modifiedexternal/kinesis-asl-assembly/pom.xml (diff)
The file was modifiedsql/hive-thriftserver/pom.xml (diff)
The file was modifiedstreaming/pom.xml (diff)
The file was modifieddocs/_config.yml (diff)
The file was modifiedexternal/kafka-0-10/pom.xml (diff)
The file was modifiedcommon/kvstore/pom.xml (diff)
The file was modifiedcommon/network-common/pom.xml (diff)
The file was modifiedcommon/tags/pom.xml (diff)
The file was modifiedmllib-local/pom.xml (diff)
The file was modifiedresource-managers/kubernetes/core/pom.xml (diff)
The file was modifiedsql/core/pom.xml (diff)
The file was modifiedassembly/pom.xml (diff)
The file was modifiedexamples/pom.xml (diff)
The file was modifiedsql/catalyst/pom.xml (diff)
The file was modifiedexternal/kinesis-asl/pom.xml (diff)
The file was modifiedsql/hive/pom.xml (diff)
The file was modifiedexternal/flume-sink/pom.xml (diff)
The file was modifiedmllib/pom.xml (diff)
The file was modifiedrepl/pom.xml (diff)
The file was modifiedcommon/network-shuffle/pom.xml (diff)
The file was modifiedexternal/spark-ganglia-lgpl/pom.xml (diff)
The file was modifiedcommon/sketch/pom.xml (diff)
The file was modifiedexternal/flume/pom.xml (diff)
The file was modifiedgraphx/pom.xml (diff)
The file was modifiedcommon/network-yarn/pom.xml (diff)
The file was modifiedexternal/kafka-0-10-sql/pom.xml (diff)
The file was modifiedexternal/kafka-0-8-assembly/pom.xml (diff)
The file was modifiedcore/pom.xml (diff)
The file was modifiedresource-managers/yarn/pom.xml (diff)
The file was modifiedhadoop-cloud/pom.xml (diff)
The file was modifiedlauncher/pom.xml (diff)
The file was modifiedcommon/unsafe/pom.xml (diff)
The file was modifiedresource-managers/mesos/pom.xml (diff)
The file was modifiedexternal/kafka-0-8/pom.xml (diff)
The file was modifiedtools/pom.xml (diff)
The file was modifiedexternal/docker-integration-tests/pom.xml (diff)
The file was modifiedexternal/flume-assembly/pom.xml (diff)
The file was modifiedpython/pyspark/version.py (diff)
The file was modifiedpom.xml (diff)
The file was modifiedexternal/flume-assembly/pom.xml (diff)
The file was modifiedpython/pyspark/version.py (diff)
The file was modifiedcommon/tags/pom.xml (diff)
The file was modifiedcommon/network-yarn/pom.xml (diff)
The file was modifiedexternal/kafka-0-10/pom.xml (diff)
The file was modifiedexternal/kinesis-asl/pom.xml (diff)
The file was modifiedcommon/network-common/pom.xml (diff)
The file was modifiedexternal/flume-sink/pom.xml (diff)
The file was modifiedcommon/unsafe/pom.xml (diff)
The file was modifiedmllib-local/pom.xml (diff)
The file was modifiedlauncher/pom.xml (diff)
The file was modifiedmllib/pom.xml (diff)
The file was modifiedcommon/network-shuffle/pom.xml (diff)
The file was modifiedtools/pom.xml (diff)
The file was modifiedcore/pom.xml (diff)
The file was modifiedgraphx/pom.xml (diff)
The file was modifiedexternal/spark-ganglia-lgpl/pom.xml (diff)
The file was modifiedpom.xml (diff)
The file was modifiedrepl/pom.xml (diff)
The file was modifiedexternal/kafka-0-10-assembly/pom.xml (diff)
The file was modifiedexternal/docker-integration-tests/pom.xml (diff)
The file was modifiedexternal/kinesis-asl-assembly/pom.xml (diff)
The file was modifiedstreaming/pom.xml (diff)
The file was modifiedexternal/kafka-0-8-assembly/pom.xml (diff)
The file was modifieddocs/_config.yml (diff)
The file was modifiedresource-managers/kubernetes/core/pom.xml (diff)
The file was modifiedsql/catalyst/pom.xml (diff)
The file was modifiedsql/hive/pom.xml (diff)
The file was modifiedresource-managers/yarn/pom.xml (diff)
The file was modifiedassembly/pom.xml (diff)
The file was modifiedexternal/flume/pom.xml (diff)
The file was modifiedcommon/kvstore/pom.xml (diff)
The file was modifiedcommon/sketch/pom.xml (diff)
The file was modifiedresource-managers/mesos/pom.xml (diff)
The file was modifiedexamples/pom.xml (diff)
The file was modifiedexternal/kafka-0-10-sql/pom.xml (diff)
The file was modifiedR/pkg/DESCRIPTION (diff)
The file was modifiedhadoop-cloud/pom.xml (diff)
The file was modifiedexternal/kafka-0-8/pom.xml (diff)
The file was modifiedsql/hive-thriftserver/pom.xml (diff)
The file was modifiedsql/core/pom.xml (diff)
Commit 19797124f1e169138258c8c113874ec6ffedbe3d by felixcheung
[SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in
Structured Streaming R tests
## What changes were proposed in this pull request?
Stop the streaming query in `Specify a schema by using a DDL-formatted
string when reading` to avoid outputting annoying logs.
## How was this patch tested?
Jenkins
Closes #23089 from zsxwing/SPARK-26120.
Authored-by: Shixiong Zhu <zsxwing@gmail.com> Signed-off-by: hyukjinkwon
<gurwls223@apache.org>
(cherry picked from commit 4b7f7ef5007c2c8a5090f22c6e08927e9f9a407b)
Signed-off-by: Felix Cheung <felixcheung@apache.org>
(commit: 19797124f1e169138258c8c113874ec6ffedbe3d)
The file was modifiedR/pkg/tests/fulltests/test_streaming.R (diff)