SuccessChanges

Summary

  1. [SPARK-30267][SQL][FOLLOWUP] Use while loop in Avro Array Deserializer (details)
  2. [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for (details)
Commit 0d589f410ba1f7b8229377f1ce961ee9f740457b by gengliang.wang
[SPARK-30267][SQL][FOLLOWUP] Use while loop in Avro Array Deserializer
### What changes were proposed in this pull request?
This is a follow-up of https://github.com/apache/spark/pull/26907 It
changes the for loop `for (element <- array.asScala)` to while loop
### Why are the changes needed?
As per
https://github.com/databricks/scala-style-guide#traversal-and-zipwithindex,
we should use while loop for the performance-sensitive code.
### Does this PR introduce any user-facing change?
No
### How was this patch tested?
Existing tests.
Closes #27127 from gengliangwang/SPARK-30267-FollowUp.
Authored-by: Gengliang Wang <gengliang.wang@databricks.com>
Signed-off-by: Gengliang Wang <gengliang.wang@databricks.com>
The file was modifiedexternal/avro/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala (diff)
Commit b2ed6d0b880018e4eef5a225d6619cac4f4d6d63 by wenchen
[SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for
namespace commands
### What changes were proposed in this pull request?
This is a follow-up to address the following comment:
https://github.com/apache/spark/pull/27095#discussion_r363152180
Currently, a SQL command string is parsed to a "statement" logical plan,
converted to a logical plan with catalog/namespace, then finally
converted to a physical plan. With the new resolution framework, there
is no need to create a "statement" logical plan; a logical plan can
contain `UnresolvedNamespace` which will be resolved to a
`ResolvedNamespace`. This should simply the code base and make it a bit
easier to add a new command.
### Why are the changes needed?
Clean up codebase.
### Does this PR introduce any user-facing change?
No
### How was this patch tested?
Existing tests should cover the changes.
Closes #27125 from imback82/SPARK-30214-followup.
Authored-by: Terry Kim <yuminkim@gmail.com> Signed-off-by: Wenchen Fan
<wenchen@databricks.com>
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala (diff)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveCatalogs.scala (diff)
The file was modifiedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/DDLParserSuite.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala (diff)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statements.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala (diff)