SuccessChanges

Summary

  1. Correct reference to Offset class (commit: ed0060ce786c78dd49099f55ab85412a01621184) (details)
  2. [SPARK-24313][SQL][BACKPORT-2.3] Fix collection operations' interpreted (commit: ded6709dd96ab24f4f4c41ac5fecb2d6022a3796) (details)
Commit ed0060ce786c78dd49099f55ab85412a01621184 by hyukjinkwon
Correct reference to Offset class
This is a documentation-only correction;
`org.apache.spark.sql.sources.v2.reader.Offset` is actually
`org.apache.spark.sql.sources.v2.reader.streaming.Offset`.
Author: Seth Fitzsimmons <seth@mojodna.net>
Closes #21387 from mojodna/patch-1.
(cherry picked from commit 00c13cfad78607fde0787c9d494f0df8ab7051ba)
Signed-off-by: hyukjinkwon <gurwls223@apache.org>
(commit: ed0060ce786c78dd49099f55ab85412a01621184)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/streaming/Offset.java (diff)
Commit ded6709dd96ab24f4f4c41ac5fecb2d6022a3796 by wenchen
[SPARK-24313][SQL][BACKPORT-2.3] Fix collection operations' interpreted
evaluation for complex types
## What changes were proposed in this pull request?
The interpreted evaluation of several collection operations works only
for simple datatypes. For complex data types, for instance,
`array_contains` it returns always `false`. The list of the affected
functions is `array_contains` and `GetMapValue`.
The PR fixes the behavior for all the datatypes.
## How was this patch tested?
added UT
Author: Marco Gaido <marcogaido91@gmail.com>
Closes #21407 from mgaido91/SPARK-24313_2.3.
(commit: ded6709dd96ab24f4f4c41ac5fecb2d6022a3796)
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala (diff)
The file was modifiedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/complexTypesSuite.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeExtractors.scala (diff)
The file was modifiedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CollectionExpressionsSuite.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala (diff)