FailedChanges

Summary

  1. [SPARK-25699][SQL] Partially push down conjunctive predicated in ORC (details)
  2. [SPARK-25016][BUILD][CORE] Remove support for Hadoop 2.6 (details)
Commit 6df2345794614c33c95fa453cabac755cf94d131 by d_tsai
[SPARK-25699][SQL] Partially push down conjunctive predicated in ORC
## What changes were proposed in this pull request?
Inspired by https://github.com/apache/spark/pull/22574 . We can
partially push down top level conjunctive predicates to Orc. This PR
improves Orc predicate push down in both SQL and Hive module.
## How was this patch tested?
New unit test.
Closes #22684 from gengliangwang/pushOrcFilters.
Authored-by: Gengliang Wang <gengliang.wang@databricks.com>
Signed-off-by: DB Tsai <d_tsai@apple.com>
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilters.scala (diff)
The file was modifiedsql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala (diff)
The file was modifiedsql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcFilterSuite.scala (diff)
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilterSuite.scala (diff)
Commit 80813e198033cd63cc6100ee6ffe7d1eb1dff27b by sean.owen
[SPARK-25016][BUILD][CORE] Remove support for Hadoop 2.6
## What changes were proposed in this pull request?
Remove Hadoop 2.6 references and make 2.7 the default. Obviously, this
is for master/3.0.0 only. After this we can also get rid of the separate
test jobs for Hadoop 2.6.
## How was this patch tested?
Existing tests
Closes #22615 from srowen/SPARK-25016.
Authored-by: Sean Owen <sean.owen@databricks.com> Signed-off-by: Sean
Owen <sean.owen@databricks.com>
The file was modifieddocs/index.md (diff)
The file was modifiedpom.xml (diff)
The file was modifieddocs/running-on-yarn.md (diff)
The file was modifiedsql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala (diff)
The file was modifieddocs/building-spark.md (diff)
The file was modifiedresource-managers/kubernetes/integration-tests/dev/dev-run-integration-tests.sh (diff)
The file was modifiedsql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala (diff)
The file was removeddev/deps/spark-deps-hadoop-2.6
The file was modifieddev/appveyor-install-dependencies.ps1 (diff)
The file was modifieddev/run-tests.py (diff)
The file was modifiedresource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala (diff)
The file was modifiedhadoop-cloud/pom.xml (diff)
The file was modifieddev/create-release/release-build.sh (diff)
The file was modifieddev/test-dependencies.sh (diff)