1. [SPARK-24385][SQL] Resolve self-join condition ambiguity for (commit: bc7ee758698911d75ffda386ee8048b42b0f2681) (details)
Commit bc7ee758698911d75ffda386ee8048b42b0f2681 by wenchen
[SPARK-24385][SQL] Resolve self-join condition ambiguity for
## What changes were proposed in this pull request?
In Dataset.join we have a small hack for resolving ambiguity in the
column name for self-joins. The current code supports only `EqualTo`.
The PR extends the fix to `EqualNullSafe`.
Credit for this PR should be given to daniel-shields.
## How was this patch tested?
added UT
Author: Marco Gaido <>
Closes #21605 from mgaido91/SPARK-24385_2.
(cherry picked from commit a7c8f0c8cb144a026ea21e8780107e363ceacb8d)
Signed-off-by: Wenchen Fan <>
(commit: bc7ee758698911d75ffda386ee8048b42b0f2681)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/Dataset.scala (diff)
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/DataFrameJoinSuite.scala (diff)