SuccessChanges

Summary

  1. [SPARK-26078][SQL][BACKPORT-2.3] Dedup self-join attributes on IN (commit: d618d27ac86b17659ec9cb5b3fa5d14612542ee8) (details)
  2. [SPARK-26545] Fix typo in EqualNullSafe's truth table comment (commit: 64fce5caafb42b50bd11707c9db96aa0b6244cdc) (details)
  3. [SPARK-26537][BUILD][BRANCH-2.3] change git-wip-us to gitbox (commit: bb52170d23e61d2d97bfc8c3a280903ee0d9120f) (details)
Commit d618d27ac86b17659ec9cb5b3fa5d14612542ee8 by dongjoon
[SPARK-26078][SQL][BACKPORT-2.3] Dedup self-join attributes on IN
subqueries
## What changes were proposed in this pull request?
When there is a self-join as result of a IN subquery, the join condition
may be invalid, resulting in trivially true predicates and return wrong
results.
The PR deduplicates the subquery output in order to avoid the issue.
## How was this patch tested?
added UT
Closes #23450 from mgaido91/SPARK-26078_2.3.
Authored-by: Marco Gaido <marcogaido91@gmail.com> Signed-off-by:
Dongjoon Hyun <dongjoon@apache.org>
(commit: d618d27ac86b17659ec9cb5b3fa5d14612542ee8)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/subquery.scala (diff)
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/SubquerySuite.scala (diff)
Commit 64fce5caafb42b50bd11707c9db96aa0b6244cdc by gatorsmile
[SPARK-26545] Fix typo in EqualNullSafe's truth table comment
## What changes were proposed in this pull request?
The truth table comment in EqualNullSafe incorrectly marked FALSE
results as UNKNOWN.
## How was this patch tested?
N/A
Closes #23461 from rednaxelafx/fix-typo.
Authored-by: Kris Mok <kris.mok@databricks.com> Signed-off-by:
gatorsmile <gatorsmile@gmail.com>
(cherry picked from commit 4ab5b5b9185f60f671d90d94732d0d784afa5f84)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
(commit: 64fce5caafb42b50bd11707c9db96aa0b6244cdc)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala (diff)
Commit bb52170d23e61d2d97bfc8c3a280903ee0d9120f by dongjoon
[SPARK-26537][BUILD][BRANCH-2.3] change git-wip-us to gitbox
## What changes were proposed in this pull request?
This is a backport of https://github.com/apache/spark/pull/23454
due to apache recently moving from git-wip-us.apache.org to
gitbox.apache.org, we need to update the packaging scripts to point to
the new repo location.
this will also need to be backported to 2.4, 2.3, 2.1, 2.0 and 1.6.
## How was this patch tested?
the build system will test this.
Closes #23472 from dongjoon-hyun/SPARK-26537.
Authored-by: shane knapp <incomplete@gmail.com> Signed-off-by: Dongjoon
Hyun <dongjoon@apache.org>
(commit: bb52170d23e61d2d97bfc8c3a280903ee0d9120f)
The file was modifieddev/create-release/release-build.sh (diff)
The file was modifiedpom.xml (diff)
The file was modifieddev/create-release/release-tag.sh (diff)