0%
WDescription%
Build stability: All recent builds failed.0
Build History
x
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Changes

#772 (Apr 16, 2021 6:01:38 PM)

  1. [SPARK-35082][INFRA] Use permissive and squshed merge when syncing to (commit: 963f434) — gurwls223 / githubweb
  2. [SPARK-35071][PYTHON] Rename Koalas to pandas-on-Spark in main codes (commit: 7ff9d2e) — gurwls223 / githubweb
  3. [SPARK-34789][TEST] Introduce Jetty based construct for integration (commit: 8a3815f) — dhyun / githubweb
  4. [MINOR][SQL] Refactor the comments in HiveClientImpl.withHiveState (commit: 271aa33) — dhyun / githubweb
  5. [SPARK-35086][SQL][CORE] --verbose should be passed to Spark SQL CLI too (commit: 9b2e0d6) — yumwang / githubweb
  6. [SPARK-34225][CORE][FOLLOWUP] Replace Hadoop's Path with (commit: 767ea86) — dhyun / githubweb
  7. [SPARK-35070][SQL] TRANSFORM not support alias in inputs (commit: 71133e1) — wenchen / githubweb
  8. [MINOR][CORE] Correct the number of started fetch requests in log (commit: 2cb962b) — piros.attila.zsolt / githubweb
  9. [SPARK-34995] Port/integrate Koalas remaining codes into PySpark (commit: 9689c44) — gurwls223 / githubweb
  10. Revert "[SPARK-34995] Port/integrate Koalas remaining codes into (commit: 637f593) — gurwls223 / githubweb
  11. [SPARK-34843][SQL][FOLLOWUP] Fix a test failure in (commit: ba92de0) — dhyun / githubweb
  12. [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark (commit: 4aee19e) — gurwls223 / githubweb
  13. [SPARK-35099][SQL] Convert ANSI interval literals to SQL string in ANSI (commit: 3f4c32b) — max.gekk / githubweb
  14. [SPARK-35083][CORE] Support remote scheduler pool files (commit: 345c380) — dhyun / githubweb
  15. [SPARK-35104][SQL] Fix ugly indentation of multiple JSON records in a (commit: 95db7e6) — max.gekk / githubweb
  16. [SPARK-34995] Port/integrate Koalas remaining codes into PySpark (commit: 91bd384) — gurwls223 / githubweb

#771 (Apr 14, 2021 7:45:59 PM)

  1. [SPARK-35041][SQL] Revise the overflow in UTF8String (commit: e70b0f8) — max.gekk / githubweb
  2. [SPARK-35043][SQL] Add condition lambda and rule id to the resolve (commit: 49618c9) — ltnwgl / githubweb
  3. [SPARK-35014] Fix the PhysicalAggregation pattern to not rewrite (commit: 9cd25b4) — wenchen / githubweb
  4. [SPARK-35045][SQL] Add an internal option to control input buffer in (commit: 1f56215) — max.gekk / githubweb
  5. [SPARK-34916][SQL][FOLLOWUP] Remove duplicate code in (commit: ade3a1d) — ltnwgl / githubweb
  6. [SPARK-34947][SQL] Streaming write to a V2 table should invalidate its (commit: 1a67089) — wenchen / githubweb
  7. [SPARK-33604][SQL] Group exception messages in sql/execution (commit: 27bec91) — wenchen / githubweb
  8. [SPARK-35049][CORE] Remove unused MapOutputTracker in (commit: ee7d838) — mridulatgmail.com / githubweb
  9. [SPARK-35012][PYTHON] Port Koalas DataFrame-related unit tests into (commit: 8ebc3fc) — ueshin / githubweb
  10. [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple (commit: ef05e89) — sarutak / githubweb
  11. [MINOR][PYTHON][DOCS] Fix docstring for pyspark.sql.DataFrameWriter.json (commit: faa928c) — gurwls223 / githubweb
  12. [SPARK-35050][DOCS][MESOS] Document deprecation of Apache Mesos in 3.2.0 (commit: 700aa17) — gurwls223 / githubweb
  13. [SPARK-35033][PYTHON] Port Koalas plot unit tests into PySpark (commit: cd1e8e8) — gurwls223 / githubweb
  14. [SPARK-35048][INFRA] Distribute GitHub Actions workflows to fork (commit: 2974b70) — gurwls223 / githubweb
  15. [SPARK-35035][PYTHON] Port Koalas internal implementation unit tests (commit: 47d62af) — gurwls223 / githubweb
  16. [SPARK-35039][PYTHON] Remove PySpark version dependent codes (commit: 4ae57d5) — gurwls223 / githubweb
  17. [SPARK-34577][SQL][FOLLOWUP] Add change of `DESC NAMESPACE`'s schema to (commit: 0fc97b5) — wenchen / githubweb
  18. [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL (commit: 816f6dd) — wenchen / githubweb
  19. [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its (commit: b5241c9) — wenchen / githubweb
  20. [SPARK-35002][YARN][TESTS][FOLLOW-UP] Fix java.net.BindException in (commit: a153efa) — yumwang / githubweb
  21. [SPARK-35069][SQL] TRANSFORM forbidden  `DISTICNT` and `ALL`, also make (commit: 4ca9958) — wenchen / githubweb
  22. [SPARK-35061][BUILD] Upgrade pycodestyle from 2.6.0 to 2.7.0 (commit: 3e218ad) — dhyun / githubweb
  23. [SPARK-35051][SQL] Support add/subtract of a day-time interval to/from a (commit: de9e8b6) — max.gekk / githubweb
  24. [SPARK-33882][ML] Add a vectorized BLAS implementation (commit: 9244066) — srowen / githubweb
  25. [SPARK-34834][NETWORK] Fix a potential Netty memory leak in (commit: bf9f3b8) — srowen / githubweb
  26. [SPARK-35044][SQL] `SET propertyKey` shall also lookup (commit: f32114d) — yao / githubweb
  27. [SPARK-34630][PYTHON][FOLLOWUP] Add __version__ into pyspark init (commit: 31555f7) — mszymkiewicz / githubweb
  28. [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark (commit: 58feb85) — gurwls223 / githubweb

#770 (Apr 13, 2021 2:40:37 AM)

  1. [SPARK-35016][SQL] Format ANSI intervals in Hive style (commit: 0e761c7) — max.gekk / githubweb
  2. [SPARK-34983][PYTHON] Renaming the package alias from pp to ps (commit: fd8081c) — gurwls223 / githubweb
  3. [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in (commit: 03431d4) — gurwls223 / githubweb
  4. [SPARK-35023][BUILD] Migrate from deprecated `in` to `slash` syntax in (commit: d6df84e) — gurwls223 / githubweb
  5. [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server (commit: 90820b3) — gurwls223 / githubweb
  6. [SPARK-34916][SQL] Add condition lambda and rule id to the transform (commit: 3db8ec2) — ltnwgl / githubweb
  7. [SPARK-33229][SQL] Support partial grouping analytics and concatenated (commit: 2123237) — wenchen / githubweb
  8. [SPARK-34905][SQL][TESTS] Enable ANSI intervals in (commit: 8f8bac6) — wenchen / githubweb
  9. [SPARK-35005][SQL] Improve error msg if UTF8String concatWs length (commit: 1be1012) — max.gekk / githubweb
  10. [SPARK-34562][SQL] Add test and doc for Parquet Bloom filter push down (commit: e40fce9) — max.gekk / githubweb
  11. [SPARK-34593][SQL][FOLLOWUP] Fix (commit: 8627cab) — viirya / githubweb
  12. [SPARK-35019][PYTHON][SQL] Fix type hints mismatches in pyspark.sql.* (commit: b43f7e6) — gurwls223 / githubweb
  13. [SPARK-35031][PYTHON] Port Koalas operations on different frames tests (commit: 9c1f807) — gurwls223 / githubweb
  14. [SPARK-28227][SQL] Support projection, aggregate/window functions, and (commit: 278203d) — yamamuro / githubweb
  15. [SPARK-35028][SQL] ANSI mode: disallow group by aliases (commit: 79e55b4) — ltnwgl / githubweb
  16. [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and (commit: 16e2faa) — yao / githubweb
  17. [SPARK-35029][CORE] Extract `tryOrFetchFailedException` method to (commit: aae4ab2) — gurwls223 / githubweb
  18. [SPARK-34996][PYTHON] Port Koalas Series-related unit tests into PySpark (commit: a392633) — gurwls223 / githubweb
  19. [SPARK-35037][SQL] Recognize sign before the interval string in literals (commit: 26f312e) — max.gekk / githubweb
  20. [SPARK-33411][SQL] Cardinality estimation of union, sort and range (commit: caf33be) — yamamuro / githubweb
  21. [SPARK-28379][SQL] Allow non-aggregated single row correlated scalar (commit: 6b8405b) — wenchen / githubweb
  22. [MINOR][TESTS] Enhance the test instruction of (commit: 5d12653) — ltnwgl / githubweb
  23. [SPARK-34212][SQL][FOLLOWUP] Move the added test to ParquetQuerySuite (commit: b34a84e) — wenchen / githubweb

#769 (Apr 10, 2021 7:27:48 PM)

  1. [SPARK-34973][SQL] Cleanup unused fields and methods in vectorized (commit: 5013171) — viirya / githubweb
  2. [SPARK-34674][CORE][K8S] Close SparkContext after the Main method has (commit: ab97db7) — dhyun / githubweb
  3. Revert "[SPARK-34674][CORE][K8S] Close SparkContext after the Main (commit: ed3f103) — dhyun / githubweb
  4. [SPARK-35002][INFRA] Fix the java.net.BindException when testing with (commit: 9663c40) — dhyun / githubweb
  5. [SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into (commit: 3af2c1b) — gurwls223 / githubweb
  6. [SPARK-34881][SQL][FOLLOWUP] Implement toString() and sql() methods for (commit: bfba7fa) — ltnwgl / githubweb
  7. [SPARK-35002][INFRA][FOLLOW-UP] Use localhost instead of 127.0.0.1 at (commit: a3d1e00) — yumwang / githubweb
  8. [SPARK-34989] Improve the performance of mapChildren and withNewChildren (commit: 0945baf) — herman / githubweb
  9. [SPARK-35004][TEST] Fix Incorrect assertion of `master/worker web ui (commit: c067588) — ltnwgl / githubweb
  10. [SPARK-35003][SQL] Improve performance for reading smallint in (commit: ee7bf7d) — dhyun / githubweb
  11. [SPARK-34963][SQL] Fix nested column pruning for extracting (commit: 364d1ea) — viirya / githubweb
  12. [MINOR][SS][DOC] Fix wrong Python code sample (commit: 214a46a) — max.gekk / githubweb
  13. [SPARK-34630][PYTHON] Add typehint for pyspark.__version__ (commit: 4c1ccda) — gurwls223 / githubweb
  14. [SPARK-34972][PYTHON][TEST][FOLLOWUP] Fix pyspark.pandas doctests which (commit: ff1fc5e) — gurwls223 / githubweb

#768 (Apr 8, 2021 10:34:16 AM)

  1. [SPARK-34955][SQL] ADD JAR command cannot add jar files which contains (commit: e5d972e) — dhyun / githubweb
  2. [SPARK-34988][CORE] Upgrade Jetty for CVE-2021-28165 (commit: 59c8131) — max.gekk / githubweb
  3. [SPARK-34946][SQL] Block unsupported correlated scalar subquery in (commit: ac01070) — wenchen / githubweb
  4. [SPARK-33233][SQL] CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal (commit: 90613df) — wenchen / githubweb
  5. [SPARK-34962][SQL] Explicit representation of * in UpdateAction and (commit: c1c9a31) — wenchen / githubweb
  6. [SPARK-34984][SQL] ANSI intervals formatting in hive results (commit: 96a3533) — wenchen / githubweb

#767 (Apr 7, 2021 11:36:24 AM)

  1. [SPARK-34965][BUILD] Remove .sbtopts that duplicately sets the default (commit: 2eda1c6) — dhyun / githubweb
  2. [SPARK-34968][TEST][PYTHON] Add the `-fr` argument to xargs rm (commit: 390d5bd) — dhyun / githubweb
  3. [SPARK-34922][SQL] Use a relative cost comparison function in the CBO (commit: 7c8dc5e) — yamamuro / githubweb
  4. [SPARK-34678][SQL] Add table function registry (commit: 0aa2c28) — wenchen / githubweb
  5. [SPARK-34969][SPARK-34906][SQL] Followup for Refactor TreeNode's (commit: 06c09a7) — herman / githubweb
  6. [SPARK-27658][SQL] Add FunctionCatalog API (commit: 3c7d6c3) — wenchen / githubweb
  7. [SPARK-34970][SQL][SERCURITY] Redact map-type options in the output of (commit: f208d80) — ltnwgl / githubweb
  8. [SPARK-34972][PYTHON] Make pandas-on-Spark doctests work (commit: 2635c38) — gurwls223 / githubweb
  9. [SPARK-34976][SQL] Rename GroupingSet to BaseGroupingSets (commit: 5a3f41a) — wenchen / githubweb
  10. [SPARK-34668][SQL] Support casting of day-time intervals to strings (commit: 3dfd456) — wenchen / githubweb
  11. [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents (commit: 8e15ac1) — max.gekk / githubweb

#766 (Apr 6, 2021 11:19:39 AM)

  1. [SPARK-34951][INFRA][PYTHON][TESTS] Set the system encoding as UTF-8 to (commit: 82ad2f9) — gurwls223 / githubweb
  2. [SPARK-34479][FOLLOWUP][DOC] Add zstandard codec to (commit: ba32b20) — yumwang / githubweb
  3. [SPARK-34954][SQL] Use zstd codec name in ORC file names (commit: 748f05f) — dhyun / githubweb
  4. [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents (commit: a72f0d7) — gurwls223 / githubweb
  5. [SPARK-34934] Fix race condition while adding/removing sources in (commit: aff6c0f) — srowen / githubweb
  6. [SPARK-34959][BUILD] Upgrade SBT to 1.5.0 (commit: ac4334b) — dhyun / githubweb
  7. [SPARK-34949][CORE] Prevent BlockManager reregister when Executor is (commit: a9ca197) — mridulatgmail.com / githubweb
  8. [SPARK-34932][SQL] deprecate GROUP BY ... GROUPING SETS (...) and (commit: 39d5677) — yamamuro / githubweb
  9. [SPARK-34935][SQL] CREATE TABLE LIKE should respect the reserved table (commit: 7cfface) — yamamuro / githubweb
  10. [SPARK-34890][PYTHON] Port/integrate Koalas main codes into PySpark (commit: caf04f9) — gurwls223 / githubweb
  11. [SPARK-34923][SQL] Metadata output should be empty for more plans (commit: 3b634f6) — wenchen / githubweb
  12. Revert "[SPARK-34884][SQL] Improve DPP evaluation to make filtering side (commit: 19c7d2f) — wenchen / githubweb
  13. [SPARK-34667][SQL] Support casting of year-month intervals to strings (commit: 4b5fc1d) — max.gekk / githubweb

#765 (Apr 4, 2021 12:09:36 AM)

  1. [SPARK-34933][DOC][SQL] Remove the description that || and && can be (commit: 8724f2b) — srowen / githubweb
  2. [SPARK-34779][CORE] ExecutorMetricsPoller should keep stage entry in (commit: f03c7c0) — piros.attila.zsolt / githubweb
  3. [SPARK-34862][SQL] Support nested column in ORC vectorized reader (commit: 1fc66f6) — viirya / githubweb
  4. [SPARK-34354][SQL] Fix failure when apply CostBasedJoinReorder on (commit: f897cc2) — wenchen / githubweb
  5. [SPARK-34938][SQL][TESTS] Benchmark only legacy interval in (commit: 1d08451) — gurwls223 / githubweb
  6. [SPARK-34940][SQL][TEST] Fix test of BasicWriteTaskStatsTrackerSuite (commit: 280a2f3) — gurwls223 / githubweb
  7. [SPARK-34926][SQL] PartitioningUtils.getPathFragment() should respect (commit: 65da928) — max.gekk / githubweb
  8. [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module (commit: f1d42bb) — dhyun / githubweb
  9. [SPARK-34948][K8S] Add ownerReference to executor configmap to fix (commit: a42dc93) — dhyun / githubweb
  10. [SPARK-34821][INFRA] Set up a workflow for developers to run benchmark (commit: 71effba) — gurwls223 / githubweb
  11. [SPARK-34950][TESTS] Update benchmark results to the ones created by (commit: ebf01ec) — max.gekk / githubweb
  12. [SPARK-34939][CORE] Throw fetch failure exception when unable to (commit: 571acc8) — dhyun / githubweb
  13. [MINOR][DOCS] Use ASCII characters when possible in PySpark (commit: 2ca76a5) — max.gekk / githubweb

#764 (Apr 1, 2021 2:50:15 PM)

  1. [SPARK-34860][ML] Multinomial Logistic Regression with intercept support (commit: d372e6e) — srowen / githubweb
  2. [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the (commit: 46f96e9) — yamamuro / githubweb
  3. [SPARK-34907][TESTS] Add main class that detects and runs all benchmarks (commit: 065cbf1) — gurwls223 / githubweb
  4. [SPARK-34909][SQL] Fix conversion of negative to unsigned in conv() (commit: 13b255f) — wenchen / githubweb
  5. [SPARK-34896][SQL] Return day-time interval from dates subtraction (commit: 162f056) — max.gekk / githubweb
  6. [SPARK-34568][SQL] When SparkContext's conf not enable hive, we should (commit: eecc43c) — wenchen / githubweb
  7. [SPARK-34354][SQL] Fix failure when apply CostBasedJoinReorder on (commit: f05b940) — wenchen / githubweb
  8. [SPARK-34911][SQL] Fix code not close issue in monitoring.md (commit: 1c3bdab) — srowen / githubweb
  9. [SPARK-34915][INFRA] Cache Maven, SBT and Scala in all jobs that use (commit: 48ef9bd) — ltnwgl / githubweb
  10. [SPARK-34881][SQL] New SQL Function: TRY_CAST (commit: 3951e33) — ltnwgl / githubweb
  11. [SPARK-34882][SQL] Replace if with filter clause in (commit: 90f2d4d) — yamamuro / githubweb
  12. Revert "[SPARK-34354][SQL] Fix failure when apply CostBasedJoinReorder (commit: cc451c1) — gurwls223 / githubweb
  13. [SPARK-34881][SQL][FOLLOW-UP] Use multiline string for TryCast' (commit: 8a2138d) — ltnwgl / githubweb
  14. [SPARK-34919][SQL] Change partitioning to SinglePartition if partition (commit: 89ae83d) — wenchen / githubweb
  15. [SPARK-34903][SQL] Return day-time interval from timestamps subtraction (commit: 5911faa) — max.gekk / githubweb
  16. [SPARK-34908][SQL][TESTS] Add test cases for char and varchar with (commit: 1b553da) — gurwls223 / githubweb
  17. [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters (commit: 2796812) — srowen / githubweb
  18. [SPARK-24931][INFRA] Fix the GA failure related to R linter (commit: f99a831) — dhyun / githubweb

#763 (Mar 30, 2021 3:51:46 PM)

  1. [SPARK-34622][SQL] Push down limit through Project with Join (commit: fcef237) — yamamuro / githubweb
  2. [SPARK-34894][CORE] Use 'io.connectionTimeout' as a hint instead of (commit: 5692aa0) — yao / githubweb
  3. [SPARK-34900][TEST] Make sure benchmarks can run using spark-submit cmd (commit: 7158e7f) — gurwls223 / githubweb
  4. [SPARK-34463][PYSPARK][DOCS] Document caveats of Arrow selfDestruct (commit: 1237124) — gurwls223 / githubweb
  5. [SPARK-32985][SQL][FOLLOWUP] Rename createNonBucketedReadRDD and minor (commit: 935aa8c) — gurwls223 / githubweb
  6. [SPARK-33308][SQL] Refactor current grouping analytics (commit: a98dc60) — wenchen / githubweb
  7. [SPARK-34884][SQL] Improve DPP evaluation to make filtering side must (commit: de66fa6) — wenchen / githubweb
  8. [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle (commit: 24d39a5) — wenchen / githubweb
  9. [SPARK-34828][YARN] Make shuffle service name configurable on client (commit: 9f065ff) — tgraves / githubweb
  10. [SPARK-34906] Refactor TreeNode's children handling methods into (commit: bd0990e) — herman / githubweb
  11. [SPARK-34856][FOLLOWUP][SQL] Remove dead code from (commit: c902f77) — srowen / githubweb

#762 (Mar 29, 2021 1:40:34 PM)

  1. [SPARK-34841][SQL] Push ANSI interval binary expressions into into (commit: 468b944) — max.gekk / githubweb
  2. [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0 (commit: cbffc12) — dhyun / githubweb
  3. [SPARK-34880][SQL][TESTS] Add Parquet ZSTD compression test coverage (commit: e7af448) — dhyun / githubweb
  4. [SPARK-34092][SQL] Support Stage level restful api filter task details (commit: 066c055) — srowen / githubweb
  5. [SPARK-34869][K8S][TEST] Extend "EXTRA LOGS FOR THE FAILED TEST" section (commit: c8b7a09) — dhyun / githubweb
  6. [SPARK-32855][SQL][FOLLOWUP] Fix code format in SQLConf and comment in (commit: 540f1fb) — dhyun / githubweb
  7. [SPARK-34829][SQL] Fix higher order function results (commit: 3382190) — dhyun / githubweb
  8. [SPARK-34843][SQL] Calculate more precise partition stride in (commit: 4fceef0) — srowen / githubweb
  9. [SPARK-34876][SQL] Fill defaultResult of non-nullable aggregates (commit: 4b9e94c) — gurwls223 / githubweb
  10. [SPARK-34814][SQL] LikeSimplification should handle NULL (commit: 2356cdd) — gurwls223 / githubweb
  11. [SPARK-34879][SQL] HiveInspector supports DayTimeIntervalType and (commit: 015c598) — max.gekk / githubweb
  12. [SPARK-34872][SQL] quoteIfNeeded should quote a name which contains (commit: 14c7bb8) — wenchen / githubweb
  13. [SPARK-34255][SQL] Support partitioning with static number on required (commit: 43e08b1) — wenchen / githubweb
  14. [SPARK-34845][CORE] ProcfsMetricsGetter shouldn't return partial procfs (commit: b2bfe98) — dhyun / githubweb

#761 (Mar 27, 2021 2:30:46 AM)

  1. Revert "[SPARK-34822][SQL] Update the plan stability golden files even (commit: 7838f55) — gurwls223 / githubweb
  2. [SPARK-34701][SQL] Remove analyzing temp view again in CreateViewCommand (commit: da04f1f) — wenchen / githubweb
  3. [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 (commit: 8c6748f) — wenchen / githubweb
  4. [SPARK-34850][SQL] Support multiply a day-time interval by a numeric (commit: a68d7ca) — max.gekk / githubweb
  5. [SPARK-34857][SQL] Correct AtLeastNNonNulls's explain output (commit: 1d6acd5) — gurwls223 / githubweb
  6. [SPARK-34822][SQL] Update the plan stability golden files even if only (commit: 6ba8445) — wenchen / githubweb
  7. [SPARK-33600][SQL] Group exception messages in execution/datasources/v2 (commit: 0d91f9c) — wenchen / githubweb
  8. [SPARK-34856][SQL] ANSI mode: Allow casting complex types as string type (commit: 0515f49) — ltnwgl / githubweb
  9. [SPARK-34840][SHUFFLE] Fixes cases of corruption in merged shuffle … (commit: 6d88212) — mridulatgmail.com / githubweb
  10. [SPARK-34833][SQL][FOLLOWUP] Handle outer references in all the places (commit: 658e95c) — yamamuro / githubweb
  11. [SPARK-34871][SS] Move the checkpoint location resolving into the rule (commit: 5ffc389) — gurwls223 / githubweb
  12. [SPARK-34786][SQL] Read Parquet unsigned int64 logical type that stored (commit: 820b465) — yao / githubweb
  13. [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for (commit: aaa0d2a) — wenchen / githubweb
  14. [SPARK-34868][SQL] Support divide an year-month interval by a numeric (commit: f212c61) — wenchen / githubweb
  15. Revert "[SPARK-34701][SQL] Remove analyzing temp view again in (commit: 61d038f) — wenchen / githubweb
  16. [SPARK-34874][INFRA] Recover test reports for failed GA builds (commit: c8233f1) — gurwls223 / githubweb
  17. [SPARK-34875][SQL] Support divide a day-time interval by a numeric (commit: 9ba889b) — wenchen / githubweb
  18. [SPARK-34858][SPARK-34448][ML] Binary Logistic Regression with intercept (commit: aa21e86) — srowen / githubweb
  19. [SPARK-34848][CORE] Add duration to TaskMetricDistributions (commit: 36a5104) — srowen / githubweb
  20. [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout (commit: d58587b) — srowen / githubweb
  21. [SPARK-34744][SQL] Improve error message for casting cause overflow (commit: 769cf7b) — yao / githubweb
  22. [SPARK-34848][SQL][FLLOW-UP] Fix merge conflict issue cause UT failed (commit: 15bf01e) — dhyun / githubweb

#760 (Mar 24, 2021 7:36:18 PM)

  1. [SPARK-34811][CORE] Redact fs.s3a.access.key like secret and token (commit: 3c32b54) — dhyun / githubweb
  2. [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default (commit: 3bc6fe4) — dhyun / githubweb
  3. [SPARK-34772][TESTS][FOLLOWUP] Disable a test case using Hive 1.2.1 in (commit: c5fd94f) — dhyun / githubweb
  4. [SPARK-34470][ML] VectorSlicer utilize ordering if possible (commit: 47da944) — ruifengz / githubweb
  5. [MINOR][SQL] Spelling: filters - PushedFilers (commit: f4de93e) — max.gekk / githubweb
  6. [SPARK-34225][CORE] Don't encode further when a URI form string is (commit: 0734101) — sarutak / githubweb
  7. Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT (commit: 3bef2dc) — gurwls223 / githubweb
  8. [SPARK-34748][SS] Create a rule of the analysis logic for streaming (commit: 45235ac) — wenchen / githubweb
  9. [SPARK-34818][PYTHON][DOCS] Reorder the items in User Guide at PySpark (commit: c7bf8ad) — gurwls223 / githubweb
  10. [SPARK-34708][SQL] Code-gen for left semi/anti broadcast nested loop (commit: f8838fe) — wenchen / githubweb
  11. [SPARK-34383][SS] Optimize WAL commit phase via reducing cost of (commit: 121883b) — gabor.g.somogyi / githubweb
  12. [SPARK-34815][SQL] Update CSVBenchmark (commit: ec70467) — max.gekk / githubweb
  13. [SPARK-34089][CORE] HybridRowQueue should respect the configured memory (commit: e4bb975) — wenchen / githubweb
  14. [SPARK-34700][SQL] SessionCatalog's temporary view related APIs should (commit: 7953fcd) — wenchen / githubweb
  15. [SPARK-34800][SQL] Use fine-grained lock in SessionCatalog.tableExists (commit: f44608a) — wenchen / githubweb
  16. [SPARK-34778][BUILD] Upgrade to Avro 1.10.2 (commit: 8a552bf) — yumwang / githubweb
  17. [SPARK-34803][PYSPARK] Pass the raised ImportError if pandas or pyarrow (commit: ddfc75e) — gurwls223 / githubweb
  18. [SPARK-34812][SQL] RowNumberLike and RankLike should not be nullable (commit: 51cf0ca) — wenchen / githubweb
  19. [SPARK-33925][CORE][FOLLOW-UP] Remove the unused variables 'secMgr' (commit: 85581f6) — srowen / githubweb
  20. [SPARK-34820][K8S][R] add apt-update before gnupg install (commit: 31da907) — dhyun / githubweb
  21. [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io (commit: 39542bb) — dhyun / githubweb
  22. [SPARK-34707][SQL] Code-gen broadcast nested loop join (left outer/right (commit: e768eaa) — wenchen / githubweb
  23. [MINOR][DOCS] Updating the link for Azure Data Lake Gen 2 in docs (commit: d32bb4e) — max.gekk / githubweb
  24. [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register (commit: e00afd3) — wenchen / githubweb
  25. [SPARK-33482][SPARK-34756][SQL] Fix FileScan equality check (commit: 93a5d34) — wenchen / githubweb
  26. [SPARK-34366][SQL] Add interface for DS v2 metrics (commit: 115ed89) — wenchen / githubweb
  27. [SPARK-34719][SQL] Correctly resolve the view query with duplicated (commit: 3b70829) — wenchen / githubweb
  28. [MINOR][DOCS] Update sql-ref-syntax-dml-insert-into.md (commit: 06d4069) — gurwls223 / githubweb
  29. [SPARK-34824][SQL] Support multiply an year-month interval by a numeric (commit: 760556a) — max.gekk / githubweb
  30. [SPARK-34842][SQL][TESTS] Corrects the type of `date_dim.d_quarter_name` (commit: 0494dc9) — dhyun / githubweb
  31. [SPARK-33720][K8S] Support submit to k8s only with token (commit: 985c653) — dhyun / githubweb
  32. [SPARK-34763][SQL] col(), $"<name>" and df("name") should handle quoted (commit: f7e9b6e) — wenchen / githubweb
  33. [SPARK-34832][SQL][TEST] Set EXECUTOR_ALLOW_SPARK_CONTEXT to true to (commit: 712a62c) — gurwls223 / githubweb
  34. [SPARK-34477][CORE] Register KryoSerializers for Avro GenericData (commit: 2298ceb) — ltnwgl / githubweb
  35. [SPARK-34295][CORE] Exclude filesystems from token renewal at YARN (commit: 95c61df) — viirya / githubweb
  36. [SPARK-34488][CORE] Support task Metrics Distributions and executor (commit: 8ed5808) — srowen / githubweb
  37. [SPARK-34853][SQL] Remove duplicated definition of output (commit: 35c70e4) — yamamuro / githubweb
  38. [SPARK-34630][PYTHON][SQL] Added typehint for (commit: ad211cc) — mszymkiewicz / githubweb
  39. [SPARK-34822][SQL] Update the plan stability golden files even if only (commit: 84df54b) — wenchen / githubweb
  40. [SPARK-34769][SQL] AnsiTypeCoercion: return closest convertible type (commit: abfd9b2) — wenchen / githubweb
  41. [SPARK-34797][ML] Refactor Logistic Aggregator - support virtual (commit: 88cf86f) — srowen / githubweb
  42. [SPARK-34833][SQL] Apply right-padding correctly for correlated (commit: 150769b) — yamamuro / githubweb
  43. [SPARK-34852][SQL] Close Hive session state should use withHiveState (commit: 9d561e6) — yao / githubweb

#759 (Mar 21, 2021 1:05:27 PM)

  1. [SPARK-31897][SQL] Enable codegen for GenerateExec (commit: 0a58029) — viirya / githubweb
  2. [SPARK-34761][SQL] Support add/subtract of a day-time interval to/from a (commit: a48b208) — wenchen / githubweb
  3. [SPARK-34772][SQL] RebaseDateTime loadRebaseRecords should use Spark (commit: 5850956) — yumwang / githubweb
  4. [SPARK-34558][SQL][FOLLOWUP] Use final Hadoop conf to instantiate (commit: 4b4f8e2) — wenchen / githubweb
  5. [SPARK-34798][SQL][TESTS] Fix incorrect join condition (commit: 6f89cdf) — yumwang / githubweb
  6. [SPARK-34793][SQL] Prohibit saving of day-time and year-month intervals (commit: 089c3b7) — max.gekk / githubweb
  7. [SPARK-34783][K8S] Support remote template files (commit: 2fa792a) — dhyun / githubweb
  8. [SPARK-34776][SQL] Nested column pruning should not prune Window (commit: 7a8a600) — dhyun / githubweb
  9. [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier (commit: 620cae0) — yamamuro / githubweb
  10. [SPARK-34796][SQL] Initialize counter variable for LIMIT code-gen in (commit: 2ff0032) — yamamuro / githubweb
  11. [SPARK-32384][CORE] repartitionAndSortWithinPartitions avoid shuffle (commit: f11950f) — yi.wu / githubweb
  12. [SPARK-34128][SQL] Suppress undesirable TTransportException warnings (commit: 2cdedef) — dhyun / githubweb
  13. [MINOR][DOCS][ML] Doc 'mode' as a supported Imputer strategy in Pyspark (commit: ed641fb) — srowen / githubweb
  14. [SPARK-28220][SQL] Improve PropagateEmptyRelation to support join with (commit: 908318f) — yumwang / githubweb
  15. [SPARK-34636][FOLLOWUP][SQL] Fix an incompatible behavior of (commit: 94fd6cb) — dhyun / githubweb
  16. [SPARK-34810][TEST] Update PostgreSQL test with the latest results (commit: c799d04) — yumwang / githubweb
  17. [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2 (commit: 2888d18) — yumwang / githubweb

#758 (Mar 18, 2021 7:00:07 PM)

  1. [SPARK-34504][SQL] Avoid unnecessary resolving of SQL temp views for DDL (commit: af55373) — wenchen / githubweb
  2. [SPARK-34699][SQL] 'CREATE OR REPLACE TEMP VIEW USING' should uncache (commit: 387d866) — wenchen / githubweb
  3. [SPARK-34742][SQL] ANSI mode: Abs throws exception if input is out of (commit: 1433031) — wenchen / githubweb
  4. [SPARK-34575][SQL] Push down limit through window when partitionSpec is (commit: c234c5b) — wenchen / githubweb
  5. [SPARK-21449][SQL][FOLLOWUP] Avoid log undesirable IllegalStateException (commit: 115f777) — yao / githubweb
  6. [SPARK-34770][SQL] InMemoryCatalog.tableExists should not fail if (commit: 1a4971d) — wenchen / githubweb
  7. [SPARK-34768][SQL] Respect the default input buffer size in Univocity (commit: 385f1e8) — gurwls223 / githubweb
  8. [SPARK-34766][SQL] Do not capture maven config for views (commit: 48637a9) — yao / githubweb
  9. [SPARK-34749][SQL] Simplify ResolveCreateNamedStruct (commit: bf4570b) — yamamuro / githubweb
  10. [SPARK-34758][SQL] Simplify Analyzer.resolveLiteralFunction (commit: 9f7b0a0) — yamamuro / githubweb
  11. [SPARK-33602][SQL] Group exception messages in execution/datasources (commit: 569fb13) — wenchen / githubweb
  12. [SPARK-34762][BUILD] Fix the build failure with Scala 2.13 which is (commit: c5cadfe) — gurwls223 / githubweb
  13. [SPARK-34087][SQL] Fix memory leak of ExecutionListenerBus (commit: 4d90c5d) — gurwls223 / githubweb
  14. [SPARK-34731][CORE] Avoid ConcurrentModificationException when redacting (commit: f8a8b34) — gurwls223 / githubweb
  15. [SPARK-34728][SQL] Remove all SQLConf.get if extends from SQLConfHelper (commit: 25e7d1c) — gurwls223 / githubweb
  16. [SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in (commit: 86ea520) — gurwls223 / githubweb
  17. [SPARK-34741][SQL] MergeIntoTable should avoid ambiguous reference in (commit: d99135b) — wenchen / githubweb
  18. [SPARK-34774][BUILD] Ensure change-scala-version.sh update scala.version (commit: 2e836cd) — srowen / githubweb
  19. [SPARK-34760][EXAMPLES] Replace `favorite_color` with `age` in (commit: 5570f81) — yao / githubweb
  20. [SPARK-34781][SQL] Eliminate LEFT SEMI/ANTI joins to its left child side (commit: 8207e2f) — yamamuro / githubweb
  21. [SPARK-34747][SQL][DOCS] Add virtual operators to the built-in function (commit: 07ee732) — gurwls223 / githubweb

#757 (Mar 16, 2021 11:54:22 AM)

  1. [SPARK-34737][SQL] Cast input float to double in `TIMESTAMP_SECONDS` (commit: 7aaed76) — gurwls223 / githubweb
  2. [SPARK-34722][CORE][SQL][TEST] Clean up deprecated API usage related to (commit: e757091) — dhyun / githubweb
  3. [SPARK-34729][SQL] Faster execution for broadcast nested loop join (left (commit: a0f3b72) — dhyun / githubweb
  4. [SPARK-34639][SQL] Always remove unnecessary Alias in (commit: be888b2) — wenchen / githubweb
  5. [SPARK-34743][SQL][TESTS] ExpressionEncoderSuite should use deepEquals (commit: 363a7f0) — dhyun / githubweb
  6. [SPARK-34739][SQL] Support add/subtract of a year-month interval to/from (commit: 9809a2f) — max.gekk / githubweb
  7. [MINOR][SQL] Remove unused variable in NewInstance.constructor (commit: 0a70dff) — dhyun / githubweb
  8. [SPARK-21449][SPARK-23745][SQL] add ShutdownHook to cloes HiveClient's (commit: 202529e) — yumwang / githubweb
  9. [SPARK-34729][SQL][FOLLOWUP] Broadcast nested loop join to use (commit: bb05dc9) — dhyun / githubweb
  10. [SPARK-34752][BUILD] Bump Jetty to 9.4.37 to address CVE-2020-27223 (commit: 4a6f534) — gurwls223 / githubweb
  11. Revert "[SPARK-33428][SQL] Conv UDF use BigInt to avoid  Long value (commit: cef6650) — wenchen / githubweb

#756 (Mar 14, 2021 3:45:02 AM)

  1. [SPARK-34697][SQL] Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain (commit: fa1cf5c) — gurwls223 / githubweb
  2. [SPARK-34702][SQL] Avoid unnecessary code generation in (commit: da086a8) — wenchen / githubweb
  3. [SPARK-34538][SQL] Hive Metastore support filter by not-in (commit: 744a73d) — wenchen / githubweb
  4. [SPARK-34695][SQL] Fix long overflow in conversion of minimum duration (commit: d7bb327) — wenchen / githubweb
  5. [SPARK-34688][PYTHON] Upgrade to Py4J 0.10.9.2 (commit: 60e324a) — srowen / githubweb
  6. [SPARK-34713][SQL] Fix group by CreateStruct with ExtractValue (commit: 6a42b63) — dhyun / githubweb
  7. [SPARK-34712][SQL][TESTS] Refactor UT about hive build in version, avoid (commit: badca97) — dhyun / githubweb
  8. [SPARK-34718][SQL] Assign pretty names to YearMonthIntervalType and (commit: cebe2be) — dhyun / githubweb
  9. [SPARK-25769][SPARK-34636][SPARK-34626][SQL] sql method in (commit: 03dd33c) — wenchen / githubweb
  10. [SPARK-34724][SQL] Fix Interpreted evaluation by using getMethod instead (commit: 9a79779) — gurwls223 / githubweb
  11. [SPARK-34721][SQL] Support add/subtract of a year-month interval to/from (commit: 4f1e434) — wenchen / githubweb
  12. [SPARK-34723][SQL] Correct parameter type for subexpression elimination (commit: 86baa36) — viirya / githubweb
  13. [SPARK-34732][K8S][TESTS] Fix IndexOutOfBoundsException in (commit: 124b5af) — dhyun / githubweb
  14. [SPARK-34727][SQL] Fix discrepancy in casting float to timestamp (commit: e0a1399) — gurwls223 / githubweb
  15. [SPARK-34734][BUILD] Update sbt to version 1.4.9 (commit: 1e06031) — gurwls223 / githubweb

#755 (Mar 11, 2021 3:23:43 AM)

  1. [SPARK-34676][SQL][TEST] TableCapabilityCheckSuite should not inherit (commit: 48377d5) — dhyun / githubweb
  2. [SPARK-34681][SQL] Fix bug for full outer shuffled hash join when (commit: a916690) — dhyun / githubweb
  3. [SPARK-34682][SQL] Fix regression in canonicalization error check in (commit: fd48438) — gurwls223 / githubweb
  4. [SPARK-34682][SQL] Use PrivateMethodTester instead of reflection (commit: fc182f7) — dhyun / githubweb
  5. [SPARK-34507][BUILD] Update scala.version in parent POM when changing (commit: 5e120e4) — gurwls223 / githubweb
  6. [SPARK-34546][SQL] AlterViewAs.query should be analyzed during the (commit: 2a6e68e) — wenchen / githubweb
  7. [SPARK-34457][SQL] DataSource V2: Add default null ordering to (commit: 7226379) — wenchen / githubweb
  8. [SPARK-34711][SQL][TESTS] Exercise code-gen enable/disable code paths (commit: 9aa8f06) — dhyun / githubweb
  9. [MINOR][SQL] Remove unnecessary extend from BroadcastHashJoinExec (commit: 14ad7af) — dhyun / githubweb
  10. [SPARK-34696][SQL][TESTS] Fix CodegenInterpretedPlanTest to generate (commit: 5c4d8f9) — dhyun / githubweb
  11. [SPARK-34677][SQL] Support the `+`/`-` operators over ANSI SQL intervals (commit: 9d3d25b) — wenchen / githubweb

#754 (Mar 9, 2021 7:20:27 AM)

  1. [SPARK-34642][DOCS][ML] Fix TypeError in Pyspark Linear Regression docs (commit: 2f30cde) — dhyun / githubweb
  2. [SPARK-34628][SQL] Remove GlobalLimit operator if its child max rows not (commit: 616c818) — dhyun / githubweb
  3. [SPARK-34647][CORE] Use ZSTD JNI NoFinalizer classes and bump to 1.4.8-7 (commit: 1f6089b) — dhyun / githubweb
  4. [SPARK-34650][BUILD][SS] Exclude zstd-jni transitive dependency from (commit: 631a85e) — gurwls223 / githubweb
  5. [SPARK-34634][SQL] ResolveReferences.dedupRight should handle (commit: 9ec8696) — gurwls223 / githubweb
  6. [SPARK-34545][SQL] Fix issues with valueCompare feature of pyrolite (commit: ab8a9a0) — srowen / githubweb
  7. [SPARK-34657][PYTHON][DOCS] Replace the tag of release to the hash to (commit: 2526fde) — gurwls223 / githubweb
  8. [SPARK-34597][SQL] Replaces `ParquetFileReader.readFooter` with (commit: 43f355b) — dhyun / githubweb
  9. [SPARK-34615][SQL] Support `java.time.Period` as an external type of the (commit: e10bf64) — wenchen / githubweb
  10. [SPARK-34598][SQL] RewritePredicateSubquery Rule must not update Filters (commit: 02e74b2) — wenchen / githubweb
  11. [SPARK-34541][CORE] Fixed an issue where data could not be cleaned up (commit: f340857) — srowen / githubweb
  12. [SPARK-34665][SQL][DOCS] Revise the type coercion section of ANSI (commit: ee756fd) — yamamuro / githubweb
  13. [SPARK-34627][SQL] Use FunctionIdentifier in (commit: c32cac4) — wenchen / githubweb
  14. [SPARK-34670][BUILD] Upgrade ZSTD-JNI to 1.4.9-1 (commit: ba7e525) — dhyun / githubweb
  15. [SPARK-34666][SQL][TESTS] Test DayTimeIntervalType and (commit: 4ea2778) — wenchen / githubweb
  16. [SPARK-34663][SQL][TESTS] Test year-month and day-time intervals in UDF (commit: 6a7701a) — wenchen / githubweb
  17. [SPARK-33498][SQL][TESTS][FOLLOWUP] Remove SQLConf.withExistingConf in (commit: 43b23fd) — dhyun / githubweb
  18. [SPARK-34620][SQL] Code-gen broadcast nested loop join (inner/cross) (commit: b5b1985) — wenchen / githubweb
  19. [SPARK-34649][SQL][DOCS] (commit: a9c1189) — wenchen / githubweb
  20. [SPARK-34152][SQL][FOLLOW-UP] Global temp view's identifier should be (commit: cf8bbc1) — wenchen / githubweb
  21. [SPARK-34603][SQL] Support ADD ARCHIVE and LIST ARCHIVES command (commit: 2fd8517) — gurwls223 / githubweb

#753 (Mar 6, 2021 5:09:45 AM)

  1. [SPARK-34604][PYTHON][TESTS] Use eventually in (commit: 8005900) — gurwls223 / githubweb
  2. [SPARK-33084][SQL][TEST][FOLLOWUP] Add ResetSystemProperties trait to (commit: 9d2d620) — gurwls223 / githubweb
  3. [SPARK-34610][PYTHON][TEST] Fix Python UDF used in (commit: 331d459) — gurwls223 / githubweb
  4. [SPARK-34584][SQL] Static partition should also follow (commit: 8f1eec4) — gurwls223 / githubweb
  5. [SPARK-34577][SQL] Fix drop/add columns to a dataset of `DESCRIBE (commit: db62710) — wenchen / githubweb
  6. [SPARK-34599][SQL] Fix the issue that INSERT INTO OVERWRITE doesn't (commit: 53e4dba) — wenchen / githubweb
  7. [SPARK-34614][SQL] ANSI mode: Casting String to Boolean should throw (commit: 2b1c170) — gengliang.wang / githubweb
  8. [SPARK-34567][SQL] CreateTableAsSelect should update metrics too (commit: 401e270) — wenchen / githubweb
  9. [SPARK-34482][SS] Correct the active SparkSession for (commit: e7e0161) — wenchen / githubweb
  10. [SPARK-34605][SQL] Support `java.time.Duration` as an external type of (commit: 17601e0) — wenchen / githubweb
  11. [SPARK-32924][WEBUI] Make duration column in master UI sorted in the (commit: 9ac5ee2) — dhyun / githubweb
  12. [SPARK-34607][SQL] Add `Utils.isMemberClass` to fix a malformed class (commit: dbce74d) — yamamuro / githubweb
  13. [SPARK-34376][SQL] Support regexp as a SQL function (commit: 814d81c) — gurwls223 / githubweb
  14. [SPARK-34613][SQL] Fix view does not capture disable hint config (commit: 43aacd5) — wenchen / githubweb
  15. [SPARK-34608][SQL] Remove unused output of AddJarCommand (commit: 979b9bc) — dhyun / githubweb
  16. [SPARK-34609][SQL] Unify resolveExpressionBottomUp and (commit: dc78f33) — wenchen / githubweb
  17. [MINOR][SQL][DOCS] Fix some spelling issues in SQL migration guide (commit: 75db6e7) — dhyun / githubweb
  18. [SPARK-34635][UI] Add trailing slashes in URLs to reduce unnecessary (commit: 358697b) — dhyun / githubweb
  19. [SPARK-22748][SQL] Analyze __grouping__id as a literal function (commit: ca326c4) — wenchen / githubweb
  20. [SPARK-34621][SQL] Unify output of ShowCreateTableAsSerdeCommand  and (commit: 654f19d) — wenchen / githubweb
  21. [SPARK-34592][WEBUI] Mark indeterminate RDD in Web UI (commit: c91a756) — viirya / githubweb
  22. [SPARK-34624][CORE] Exclude non-jar dependencies of ivy/maven packages (commit: 1fd7368) — dhyun / githubweb
  23. [SPARK-34643][R][DOCS] Use CRAN URL in canonical form (commit: f72b906) — dhyun / githubweb
  24. [SPARK-34595][SQL] DPP support RLIKE (commit: 1a97224) — yamamuro / githubweb

#752 (Mar 3, 2021 11:52:58 AM)

  1. [SPARK-34561][SQL] Fix drop/add columns from/to a dataset of v2 (commit: 984ff39) — wenchen / githubweb
  2. [SPARK-34539][BUILD][INFRA] Remove stand-alone version Zinc server (commit: 85b50d4) — srowen / githubweb
  3. [SPARK-34560][SQL] Generate unique output attributes in the `SHOW (commit: 70f6267) — wenchen / githubweb
  4. [SPARK-34503][DOCS][FOLLOWUP] Document available codecs for event log (commit: 499cc79) — dhyun / githubweb
  5. [SPARK-34573][SQL] Avoid global locking in SQLConf object for (commit: b13a4b8) — yamamuro / githubweb
  6. [SPARK-33678][SQL] Product aggregation function (commit: 7d0743b) — gurwls223 / githubweb
  7. [SPARK-32703][SQL] Replace deprecated API calls from (commit: ce13dcc) — gurwls223 / githubweb
  8. [SPARK-34578][SQL][TESTS][TEST-MAVEN] Refactor ORC encryption tests and (commit: 4818847) — gurwls223 / githubweb
  9. [SPARK-34585][SQL] Remove no longer needed BatchWriteHelper (commit: 08a1257) — gurwls223 / githubweb
  10. [SPARK-34417][SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap (commit: 4bda3c0) — wenchen / githubweb
  11. [SPARK-34547][SQL] Only use metadata columns for resolution as last (commit: 2e54d68) — wenchen / githubweb
  12. [SPARK-34498][SQL][TESTS] fix the remaining problems in #31560 (commit: 9e8547c) — wenchen / githubweb
  13. [SPARK-34558][SQL] warehouse path should be qualified ahead of (commit: 6093a78) — wenchen / githubweb
  14. [SPARK-34361][K8S] In case of downscaling avoid killing of executors (commit: 6c5322d) — hkarau / githubweb
  15. [SPARK-34548][SQL] Remove unnecessary children from Union under Distince (commit: bab9531) — viirya / githubweb
  16. [SPARK-34548][SQL][FOLLOW-UP] Call toSeq to recover Scala 2.13 build in (commit: 1077666) — gurwls223 / githubweb
  17. [SPARK-34596][SQL] Use Utils.getSimpleName to avoid hitting Malformed (commit: ecf4811) — gurwls223 / githubweb
  18. [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch (commit: 4e43819) — wenchen / githubweb
  19. [SPARK-34593][SQL] Preserve broadcast nested loop join partitioning and (commit: 5362f08) — wenchen / githubweb
  20. [SPARK-27793][SQL] Add ANSI SQL day-time and year-month interval types (commit: cd649e7) — wenchen / githubweb
  21. [SPARK-34576][SQL] Fix drop/add columns to a dataset of `DESCRIBE (commit: 17f0e70) — wenchen / githubweb
  22. [SPARK-34222][SQL] Enhance boolean simplification rule (commit: 229d2e0) — wenchen / githubweb
  23. [MINOR][SQL][DOCS] Fix some wrong default values in SQL tuning guide's (commit: 499f620) — gurwls223 / githubweb
  24. [SPARK-33474][SQL] Support TypeConstructed partition spec value (commit: 56edb81) — yamamuro / githubweb
  25. [SPARK-34555][SQL] Resolve metadata output from DataFrame (commit: b01dd12) — wenchen / githubweb
  26. [SPARK-34222][SQL][FOLLOWUP] Non-recursive implementation of (commit: 5aaab19) — gengliang.wang / githubweb
  27. [SPARK-34590][TESTS] Allow JDWP debug for tests (commit: 33d1c16) — dhyun / githubweb

#751 (Feb 28, 2021 10:43:51 PM)

  1. [SPARK-34474][SQL] Remove unnecessary Union under Distinct/Deduplicate (commit: f7ac2d6) — viirya / githubweb
  2. [SPARK-34152][SQL][FOLLOWUP] Do not uncache the temp view if it doesn't (commit: dffb01f) — dhyun / githubweb
  3. [SPARK-34505][BUILD] Upgrade Scala to 2.13.5 (commit: 1967760) — dhyun / githubweb
  4. [SPARK-34535][SQL] Cleanup unused symbol in Orc related code (commit: 0d3a9cd) — gurwls223 / githubweb
  5. Revert "[SPARK-32617][K8S][TESTS] Configure kubernetes client based on (commit: 4d428a8) — dhyun / githubweb
  6. [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while (commit: 5c7d019) — wenchen / githubweb
  7. [SPARK-34551][INFRA] Fix credit related scripts to recover, drop Python (commit: 5b92531) — gurwls223 / githubweb
  8. [SPARK-34553][INFRA] Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in (commit: ac774ec) — gurwls223 / githubweb
  9. [SPARK-34524][SQL] Simplify v2 partition commands resolution (commit: 73857cd) — wenchen / githubweb
  10. [SPARK-34533][SQL] Eliminate LEFT ANTI join to empty relation in AQE (commit: 7d5021f) — wenchen / githubweb
  11. [SPARK-34550][SQL] Skip InSet null value during push filter to Hive (commit: 82267ac) — gurwls223 / githubweb
  12. [SPARK-34549][BUILD] Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844 (commit: a9e8e05) — gurwls223 / githubweb
  13. [SPARK-34554][SQL] Implement the copy() method in ColumnarMap (commit: c1beb16) — gurwls223 / githubweb
  14. [SPARK-33971][SQL] Eliminate distinct from more aggregates (commit: 67ec4f7) — yamamuro / githubweb
  15. [MINOR] Add more known translations of contributors (commit: 8d68f3f) — gurwls223 / githubweb
  16. [SPARK-34392][SQL] Support ZoneOffset +h:mm in DateTimeUtils. getZoneId (commit: 56e664c) — srowen / githubweb
  17. [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 (commit: 05069ff) — yamamuro / githubweb
  18. [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency (commit: d758210) — dongjoon / githubweb
  19. [SPARK-34559][BUILD] Upgrade to ZSTD JNI 1.4.8-6 (commit: 1aeafb4) — dongjoon / githubweb
  20. [SPARK-34415][ML] Randomization in hyperparameter optimization (commit: 397b843) — srowen / githubweb
  21. [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list (commit: 54c053a) — dongjoon / githubweb
  22. [SPARK-34415][ML] Python example (commit: 5a48eb8) — srowen / githubweb
  23. [SPARK-33687][SQL] Support analyze all tables in a specific database (commit: d07fc30) — yamamuro / githubweb
  24. [SPARK-34506][CORE] ADD JAR with ivy coordinates should be compatible (commit: 0216051) — yamamuro / githubweb
  25. [SPARK-34579][SQL][TEST] Fix wrong UT in SQLQuerySuite (commit: d574308) — dongjoon / githubweb
  26. [SPARK-34570][SQL] Remove dead code from constructors of (commit: 1afe284) — yamamuro / githubweb
  27. [SPARK-33212][FOLLOWUP] Add hadoop-yarn-server-web-proxy for Hadoop 3.x (commit: f494c5c) — dongjoon / githubweb
  28. [SPARK-34520][CORE][FOLLOW-UP] Remove SecurityManager in GangliaSink (commit: 3d0ee96) — gurwls223 / githubweb
  29. [SPARK-34556][SQL] Checking duplicate static partition columns should (commit: 62737e1) — gurwls223 / githubweb
  30. [SPARK-34574][DOCS] Jekyll fails to generate Scala API docs for Scala (commit: a6cc5e6) — gurwls223 / githubweb

#750 (Feb 25, 2021 12:40:07 PM)

  1. [MINOR][DOCS] Replace http to https when possible in PySpark (commit: b5470ae) — gurwls223 / githubweb
  2. [SPARK-34500][DOCS][EXAMPLES] Replace symbol literals with $"" in (commit: 612d523) — gurwls223 / githubweb
  3. [SPARK-34490][SQL] Analysis should fail if the view refers a dropped (commit: be675a0) — wenchen / githubweb
  4. [SPARK-34475][SQL] Rename logical nodes of v2 `ALTER` commands (commit: 8f994cb) — wenchen / githubweb
  5. Revert "[SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET (commit: 429f8af) — wenchen / githubweb
  6. [SPARK-34502][SQL] Remove unused parameters in join methods (commit: 443139b) — viirya / githubweb
  7. [SPARK-34508][SQL][TEST] Skip HiveExternalCatalogVersionsSuite if (commit: 0d5d248) — dhyun / githubweb
  8. [SPARK-34168][SQL][FOLLOWUP] Improve DynamicPartitionPruningSuiteBase (commit: 95e45c6) — dhyun / githubweb
  9. [SPARK-31891][SQL] Support `MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} (commit: 7f27d33) — dhyun / githubweb
  10. [SPARK-34503][CORE] Use zstd for spark.eventLog.compression.codec by (commit: 2e31e2c) — dhyun / githubweb
  11. [SPARK-26138][SQL] Pushdown limit through InnerLike when condition is (commit: b5afff5) — yumwang / githubweb
  12. [MINOR][DOCS][K8S] Use hadoop-aws 3.2.2 in K8s example (commit: a6dcd55) — gurwls223 / githubweb
  13. Revert "[SPARK-32703][SQL] Replace deprecated API calls from (commit: 80bad08) — gurwls223 / githubweb
  14. [SPARK-34245][CORE] Ensure Master removes executors that failed to send (commit: f542ecd) — wenchen / githubweb
  15. [SPARK-34290][SQL] Support v2 `TRUNCATE TABLE` (commit: f64fc22) — wenchen / githubweb
  16. [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode (commit: 5d9cfd7) — gengliang.wang / githubweb
  17. [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's (commit: 714ff73) — wenchen / githubweb
  18. [SPARK-33599][SQL][FOLLOWUP] Group exception messages in (commit: 14934f4) — wenchen / githubweb
  19. [SPARK-34514][SQL] Push down limit for LEFT SEMI and LEFT ANTI join (commit: 6ef57d3) — wenchen / githubweb
  20. [SPARK-31891][SQL][DOCS][FOLLOWUP] Fix typo in the description of `MSCK (commit: 87409c4) — gurwls223 / githubweb
  21. [SPARK-34515][SQL] Fix NPE if InSet contains null value during (commit: 999d3b8) — wenchen / githubweb
  22. [SPARK-32617][K8S][TESTS] Configure kubernetes client based on (commit: b17754a) — hkarau / githubweb
  23. [SPARK-34497][SQL] Fix built-in JDBC connection providers to restore JVM (commit: 44eadb9) — gurwls223 / githubweb
  24. [SPARK-34531][CORE] Remove Experimental API tag in PrometheusServlet (commit: 22383e3) — dhyun / githubweb
  25. [SPARK-34520][CORE] Remove unused SecurityManager references (commit: 8a1e172) — dhyun / githubweb
  26. [SPARK-34518][SQL] Rename `AlterTableRecoverPartitionsCommand` to (commit: c56af69) — wenchen / githubweb
  27. [SPARK-34436][SQL] DPP support LIKE ANY/ALL expression (commit: 4a3200b) — wenchen / githubweb

#749 (Feb 22, 2021 12:17:09 PM)

  1. [SPARK-34466][SQL][DOCS] Improve docs for `ALTER TABLE .. RENAME TO` (commit: 4a9a1d4) — wenchen / githubweb
  2. [SPARK-34314][SQL] Fix partitions schema inference (commit: b26e7b5) — wenchen / githubweb
  3. [SPARK-34421][SQL] Resolve temporary functions and views in views with (commit: 27abb6a) — wenchen / githubweb
  4. [SPARK-28123][SQL] String Functions: support btrim (commit: 06df121) — wenchen / githubweb
  5. [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single (commit: 96bcb4b) — wenchen / githubweb
  6. [SPARK-34469][K8S] Ignore RegisterExecutor when SparkContext is stopped (commit: 484a83e) — dhyun / githubweb
  7. [SPARK-24818][CORE] Support delay scheduling for barrier execution (commit: 4dc16f2) — mridulatgmail.com / githubweb
  8. [SPARK-34471][SS][DOCS] Document Streaming Table APIs in Structured (commit: 489d32a) — kabhwan.opensource / githubweb
  9. [SPARK-7768][CORE][SQL] Open UserDefinedType as a Developer API (commit: f78466d) — srowen / githubweb
  10. [SPARK-34379][SQL] Map JDBC RowID to StringType rather than LongType (commit: 82b33a3) — sarutak / githubweb
  11. [SPARK-34481][SQL] Refactor dataframe reader/writer optionsWithPath (commit: 7de49a8) — dhyun / githubweb
  12. [SPARK-20977][CORE] Use a non-final field for the state of (commit: fadd0f5) — srowen / githubweb
  13. [SPARK-34373][SQL] HiveThriftServer2 startWithContext may hang with a (commit: 1fac706) — gurwls223 / githubweb
  14. [SPARK-34360][SQL] Support truncation of v2 tables (commit: 04c3125) — gurwls223 / githubweb
  15. [SPARK-34384][CORE] Add missing docs for ResourceProfile APIs (commit: 546d2eb) — gurwls223 / githubweb
  16. [SPARK-34486][K8S] Upgrade kubernetes-client to 4.13.2 (commit: 020e84e) — gurwls223 / githubweb
  17. [SPARK-34487][K8S][TESTS] Use the runtime Hadoop version in K8s IT (commit: 9942548) — dhyun / githubweb
  18. [SPARK-34129][SQL] Add table name to LogicalRelation.simpleString (commit: 94f9617) — srowen / githubweb
  19. [SPARK-34029][SQL][TESTS] Add OrcEncryptionSuite and FakeKeyProvider (commit: 03f4cf5) — dhyun / githubweb
  20. [SPARK-34401][SQL][DOCS] Update docs about altering cached tables/views (commit: 6ea4b5f) — wenchen / githubweb
  21. [SPARK-34468][SQL] Rename v2 table in place if new name has single part (commit: a22d20a) — wenchen / githubweb
  22. [SPARK-34167][SQL] Reading parquet with IntDecimal written as a (commit: 38fbe56) — wenchen / githubweb
  23. [SPARK-34495][TESTS] Add `DedicatedJVMTest` test tag (commit: 2fb5f21) — gurwls223 / githubweb
  24. [SPARK-34450][SQL][TESTS] Unify v1 and v2 ALTER TABLE .. RENAME tests (commit: 23a5996) — wenchen / githubweb
  25. [SPARK-34432][SQL][TESTS] Add JavaSimpleWritableDataSource (commit: 9767041) — wenchen / githubweb
  26. [MINOR][DOCS] Add table_identifier in sql-migration-guide for SHOW (commit: a6a82c8) — yumwang / githubweb
  27. [SPARK-34473][SQL] Avoid NPE in DataFrameReader.schema(StructType) (commit: 02c784c) — wenchen / githubweb
  28. [SPARK-34496][BUILD] Upgrade ZSTD-JNI to 1.4.8-5 for better API (commit: 0bccf16) — gurwls223 / githubweb
  29. [MINOR][SQL] Fix the comment for CalendarIntervalType about (commit: 7df4fed) — wenchen / githubweb

#748 (Feb 18, 2021 8:11:13 PM)

  1. [SPARK-34434][SQL] Mention DS rebase options in `SparkUpgradeException` (commit: aca6db1) — dhyun / githubweb
  2. [SPARK-34431][CORE] Only load `hive-site.xml` once (commit: 4fd3247) — dhyun / githubweb
  3. [SPARK-34424][SQL][TESTS] Fix failures of HiveOrcHadoopFsRelationSuite (commit: 0316105) — gurwls223 / githubweb
  4. [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs (commit: 1a11fe5) — gurwls223 / githubweb
  5. [SPARK-34426][K8S][TESTS] Add driver and executors POD logs to (commit: 5f91245) — kabhwan.opensource / githubweb
  6. [SPARK-34333][SQL] Fix PostgresDialect to handle money types properly (commit: dd6383f) — sarutak / githubweb
  7. [SPARK-34451][SQL] Add alternatives for datetime rebasing SQL configs (commit: 5957bc1) — wenchen / githubweb
  8. [SPARK-33763] Add metrics for better tracking of dynamic allocation (commit: 76e5d75) — hkarau / githubweb
  9. [SPARK-34446][SS][DOCS] Update doc for stream-stream join (full outer + (commit: a575e80) — kabhwan.opensource / githubweb
  10. [SPARK-34456][SQL] Remove unused write options from BatchWriteHelper (commit: 44a9aed) — dhyun / githubweb
  11. [SPARK-33736][SQL] Handle MERGE in ReplaceNullWithFalseInPredicate (commit: 1ad3432) — dhyun / githubweb
  12. [SPARK-34433][DOCS] Lock Jekyll version by Gemfile and Bundler (commit: bdcad33) — gurwls223 / githubweb
  13. [SPARK-34455][SQL] Deprecate (commit: 7b549c3) — dhyun / githubweb
  14. [SPARK-34437][SQL][DOCS] Update Spark SQL guide about the rebasing DS (commit: b58f097) — gurwls223 / githubweb
  15. [SPARK-34449][BUILD] Upgrade Jetty to fix CVE-2020-27218 (commit: 5167228) — gurwls223 / githubweb
  16. [SPARK-34393][SQL] Unify output of SHOW VIEWS and pass output attributes (commit: c925e4d) — wenchen / githubweb
  17. [SPARK-34394][SQL] Unify output of SHOW FUNCTIONS and pass output (commit: edccf96) — wenchen / githubweb
  18. [SPARK-33739][SQL] Jobs committed through the S3A Magic committer don't (commit: ff5115c) — tgraves / githubweb
  19. [SPARK-32703][SQL] Replace deprecated API calls from (commit: 2787328) — srowen / githubweb
  20. [SPARK-34454][SQL] Mark legacy SQL configs as internal (commit: 8f7ec4b) — dhyun / githubweb
  21. [SPARK-34467][BUILD] Upgrade Zstd-jni to 1.4.8-4 (commit: 331c6fd) — dhyun / githubweb
  22. [SPARK-34465][SQL] Rename v2 alter table exec nodes (commit: cad469d) — dhyun / githubweb
  23. [MINOR][SQL][DOCS] Fix the comments in the example at window function (commit: 26548ed) — gurwls223 / githubweb

#747 (Feb 14, 2021 4:54:36 PM)

  1. [SPARK-32953][PYTHON][SQL] Add Arrow self_destruct support to toPandas (commit: 9b875ce) — cutlerb / githubweb
  2. [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory (commit: cd38287) — viirya / githubweb
  3. [SPARK-34408][PYTHON] Refactor spark.udf.register to share the same path (commit: 92a8346) — gurwls223 / githubweb
  4. [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not (commit: e005385) — viirya / githubweb
  5. [SPARK-34418][SQL][TESTS] Check partitions existence after v1 TRUNCATE (commit: 91be583) — dhyun / githubweb
  6. [SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET (commit: 9a566f8) — dhyun / githubweb
  7. [SPARK-34428][BUILD] Update sbt version to 1.4.7 (commit: f2e1468) — dhyun / githubweb
  8. [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs (commit: e3b6e4a) — srowen / githubweb
  9. [SPARK-34416][SQL] Adding support for user provided schema url in Avro (commit: 3d39dfa) — dhyun / githubweb

#746 (Feb 10, 2021 2:33:38 AM)

  1. [PYTHON][MINOR] Fix docstring of DataFrame.join (commit: 747ad18) — srowen / githubweb
  2. [SPARK-34291][ML] LSH hashDistance optimization (commit: a9969fa) — srowen / githubweb
  3. [SPARK-34141][SQL] Remove side effect from ExtractGenerator (commit: c73f70b) — srowen / githubweb
  4. [SPARK-34356][ML] OVR transform fix potential column conflict (commit: 178dc50) — srowen / githubweb
  5. [SPARK-34387][CORE][TESTS] Add ZStandardBenchmark (commit: 466c045) — dhyun / githubweb
  6. [SPARK-34385][SQL] Unwrap `SparkUpgradeException` in v2 Parquet (commit: 6845d26) — dhyun / githubweb
  7. [SPARK-34370][SQL] Support Avro schema evolution for partitioned Hive (commit: cc508d1) — dhyun / githubweb
  8. [SPARK-34342][SQL] Format DateLiteral and TimestampLiteral toString (commit: 6e05e99) — dhyun / githubweb
  9. [SPARK-34390][CORE] Enable Zstandard buffer pool by default (commit: eb5558e) — dhyun / githubweb
  10. [SPARK-34398][DOCS] Fix PySpark migration link (commit: 34a1a65) — gurwls223 / githubweb
  11. [SPARK-34158] Incorrect url of the only developer Matei in pom.xml (commit: 30ef3d6) — gurwls223 / githubweb
  12. [SPARK-34346][CORE][TESTS][FOLLOWUP] Fix UT by removing core-site.xml (commit: dcaf62a) — gurwls223 / githubweb
  13. [SPARK-34391][BUILD] Upgrade commons-io to 2.8.0 (commit: 329f945) — dhyun / githubweb
  14. [SPARK-34375][CORE][K8S][TEST] Replaces 'Mockito.initMocks' with (commit: b344e91) — gurwls223 / githubweb
  15. [SPARK-34355][SQL] Add log and time cost for commit job (commit: 9270238) — kabhwan.opensource / githubweb
  16. [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output (commit: 2c243c9) — wenchen / githubweb
  17. [SPARK-34239][SQL][FOLLOW_UP] SHOW COLUMNS Keep consistence with other (commit: 70a79e9) — wenchen / githubweb
  18. [SPARK-33354][DOC] Remove an unnecessary quote in doc (commit: 88ced28) — gurwls223 / githubweb
  19. [MINOR] Add a note about pip installation test in RC for release vote (commit: 556ecd6) — gurwls223 / githubweb
  20. [SPARK-34157][BUILD][FOLLOW-UP] Fix Scala 2.13 compilation error via (commit: 70ef196) — gurwls223 / githubweb
  21. [SPARK-34377][SQL] Add new parquet datasource options to control (commit: a854906) — wenchen / githubweb
  22. [SPARK-33438][SQL] Eagerly init objects with defined SQL Confs for (commit: 037bfb2) — gurwls223 / githubweb
  23. [MINOR][SQL][FOLLOW-UP] Add assertion to (commit: d1131bc) — srowen / githubweb
  24. [SPARK-34388][SQL] Propagate the registered UDF name to ScalaUDF, (commit: c92e408) — wenchen / githubweb
  25. [SPARK-34168][SQL] Support DPP in AQE when the join is Broadcast hash (commit: 3b26bc2) — wenchen / githubweb
  26. [SPARK-34374][SQL][DSTREAM] Use standard methods to extract keys or (commit: 777d51e) — srowen / githubweb
  27. [SPARK-34352][SQL] Improve SQLQueryTestSuite so as could run on windows (commit: e65b28c) — gurwls223 / githubweb
  28. [SPARK-34395][SQL] Clean up unused code for code simplifications (commit: 37fe8c6) — srowen / githubweb
  29. [SPARK-34405][CORE] Fix mean value of timersLabels in the (commit: a1e75ed) — dhyun / githubweb
  30. [SPARK-34407][K8S] KubernetesClusterSchedulerBackend.stop should clean (commit: ea339c3) — dhyun / githubweb
  31. [SPARK-34355][CORE][SQL][FOLLOWUP] Log commit time in all File Writer (commit: 7ea3a33) — kabhwan.opensource / githubweb
  32. [MINOR][ML][TESTS] Increase tolerance to make NaiveBayesSuite more (commit: 18b3010) — gurwls223 / githubweb
  33. [SPARK-34334][K8S] Correctly identify timed out pending pod requests as (commit: b2dc38b) — hkarau / githubweb
  34. [SPARK-34209][SQL] Delegate table name validation to the session catalog (commit: cf7a13c) — hkarau / githubweb
  35. [SPARK-34363][CORE] Add an option for limiting storage for migrated (commit: 2b51843) — hkarau / githubweb
  36. [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & (commit: 50641d2) — hkarau / githubweb
  37. Revert "[SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning (commit: c8628c9) — gurwls223 / githubweb
  38. [SPARK-34080][ML][PYTHON][FOLLOW-UP] Update score function in (commit: 1fbd576) — gurwls223 / githubweb
  39. [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & (commit: 5248ecb) — hkarau / githubweb
  40. [SPARK-34238][SQL][FOLLOW_UP] SHOW PARTITIONS Keep consistence with (commit: 3e12e9d) — wenchen / githubweb
  41. [SPARK-34311][SQL] PostgresDialect can't treat arrays of some types (commit: f79305a) — yamamuro / githubweb
  42. [SPARK-34240][SQL] Unify output of `SHOW TBLPROPERTIES` clause's output (commit: 123365e) — wenchen / githubweb
  43. [SPARK-34137][SQL] Update suquery's stats when build LogicalPlan's stats (commit: 2f387b4) — wenchen / githubweb
  44. [SPARK-33995][SQL] Expose make_interval as a Scala function (commit: e6753c9) — wenchen / githubweb
  45. [SPARK-31816][SQL][DOCS] Added high level description about JDBC (commit: 0a37a95) — yamamuro / githubweb
  46. [SPARK-34347][SQL] CatalogImpl.uncacheTable should invalidate in cascade (commit: 0986f16) — viirya / githubweb
  47. [SPARK-34404][SQL] Add new Avro datasource options to control datetime (commit: c082c53) — wenchen / githubweb
  48. [SPARK-34234][SQL] Remove TreeNodeException that didn't work (commit: 32a523b) — wenchen / githubweb

#745 (Feb 6, 2021 3:14:56 AM)

  1. [SPARK-34306][SQL][PYTHON][R] Use Snake naming rule across the function (commit: 30468a9) — gurwls223 / githubweb
  2. [SPARK-34300][PYSPARK][DOCS][MINOR] Fix some typos and syntax issues in (commit: d99d0d2) — gurwls223 / githubweb
  3. [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap (commit: f66e38c) — dhyun / githubweb
  4. [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null (commit: 521397f) — gurwls223 / githubweb
  5. [SPARK-34319][SQL] Resolve duplicate attributes for (commit: e9362c2) — gurwls223 / githubweb
  6. [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI (commit: bb9bf66) — wenchen / githubweb
  7. [SPARK-34317][SQL] Introduce relationTypeMismatchHint to UnresolvedTable (commit: f024d30) — wenchen / githubweb
  8. [SPARK-34312][SQL] Support partition(s) truncation by (commit: 6d3674b) — wenchen / githubweb
  9. [SPARK-34323][BUILD] Upgrade zstd-jni to 1.4.8-3 (commit: 5acc5b8) — dhyun / githubweb
  10. [SPARK-34318][SQL] Dataset.colRegex should work with column names and (commit: 66f3480) — yamamuro / githubweb
  11. [SPARK-33599][SQL] Restore the assert-like in catalyst/analysis (commit: 5b2ad59) — wenchen / githubweb
  12. [SPARK-33591][SQL][FOLLOW-UP] Revise the version and doc of (commit: ff1b6ec) — wenchen / githubweb
  13. [SPARK-34282][SQL][TESTS] Unify v1 and v2 TRUNCATE TABLE tests (commit: 79515b8) — wenchen / githubweb
  14. [SPARK-34263][SQL] Simplify the code for treating unicode/octal/escaped (commit: d308794) — sarutak / githubweb
  15. [SPARK-34324][SQL] FileTable should not list TRUNCATE in capabilities by (commit: cadca8d) — viirya / githubweb
  16. [SPARK-34326][CORE][SQL] Fix UTs added in SPARK-31793 depending on the (commit: 6386602) — kabhwan.opensource / githubweb
  17. [SPARK-34212][SQL][FOLLOWUP] Parquet vectorized reader can read decimal (commit: 00120ea) — gurwls223 / githubweb
  18. [SPARK-34325][CORE] Remove unused shuffleBlockResolver variable (commit: 60c71c6) — gurwls223 / githubweb
  19. [SPARK-34308][SQL] Escape meta-characters in printSchema (commit: 603a7fd) — gurwls223 / githubweb
  20. Revert "[SPARK-34326][CORE][SQL] Fix UTs added in SPARK-31793 depending (commit: e927bf9) — gurwls223 / githubweb
  21. [SPARK-34307][SQL] TakeOrderedAndProjectExec avoid shuffle if input rdd (commit: fc80a5b) — wenchen / githubweb
  22. [SPARK-34313][SQL] Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands (commit: a1d4bb3) — wenchen / githubweb
  23. [SPARK-34327][BUILD] Strip passwords from inlining into build (commit: 89bf2af) — gurwls223 / githubweb
  24. [SPARK-34182][AVRO] Improve error messages when matching (commit: 791de00) — wenchen / githubweb
  25. [SPARK-34335][SQL] Support referencing subquery with column aliases by (commit: 76a7fca) — wenchen / githubweb
  26. [SPARK-34304][SQL] Remove view checks in v1 alter table commands (commit: 7bfb4a4) — wenchen / githubweb
  27. [SPARK-34317][SQL][FOLLOW-UP] Use relationTypeMismatchHint when (commit: 3d7e139) — wenchen / githubweb
  28. [SPARK-34340][CORE] Support ZSTD JNI BufferPool (commit: 8e28218) — dhyun / githubweb
  29. [SPARK-34326][CORE][SQL] Fix UTs added in SPARK-31793 depending on the (commit: 44dcf00) — kabhwan.opensource / githubweb
  30. [SPARK-34341][BUILD] Skip zinc related operations on aarch64 (commit: 42c32e8) — gurwls223 / githubweb
  31. [SPARK-33212][FOLLOW-UP][BUILD] Uses provided properties for Hadoop (commit: 6a194f1) — gurwls223 / githubweb
  32. [SPARK-34357][SQL] Map JDBC SQL TIME type to TimestampType with time (commit: 7675582) — wenchen / githubweb
  33. [SPARK-34339][CORE][SQL] Expose the number of total paths in (commit: fbe726f) — gurwls223 / githubweb
  34. [SPARK-34346][CORE][SQL] io.file.buffer.size set by spark.buffer.size (commit: 961c851) — gurwls223 / githubweb
  35. [MINOR][ML] Param Validation should throw IllegalArgumentException (commit: 5f1af69) — ruifengz / githubweb
  36. [SPARK-34359][SQL] Add a legacy config to restore the output schema of (commit: 361d702) — wenchen / githubweb
  37. [SPARK-34343][SQL][TESTS] Add missing test for some non-array types in (commit: 55399eb) — yamamuro / githubweb
  38. [SPARK-34371][SQL][TESTS] Run the datetime rebasing tests for Parquet (commit: ee11a8f) — wenchen / githubweb
  39. [SPARK-34331][SQL] Speed up DS v2 metadata col resolution (commit: 989eb68) — wenchen / githubweb
  40. [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for (commit: 76baaf7) — wenchen / githubweb
  41. [SPARK-34350][SQL][TESTS] replace withTimeZone defined in (commit: 1f4135c) — yamamuro / githubweb
  42. [SPARK-26836][SQL] Supporting Avro schema evolution for partitioned Hive (commit: e614f34) — dhyun / githubweb

#744 (Feb 1, 2021 6:55:22 AM)

  1. [SPARK-34165][SQL] Add count_distinct as an option to Dataset#summary (commit: 9ed0e3c) — srowen / githubweb
  2. [SPARK-34253][SQL] Object hash aggregate should not fallback if no more (commit: 3a361cd) — wenchen / githubweb
  3. [SPARK-34278][CORE] Make BlockManagerMaster driver heartbeat timeout (commit: 23d4f6b) — dhyun / githubweb
  4. [SPARK-32866][K8S] Fix docker cross-build (commit: 497f599) — hkarau / githubweb
  5. [SPARK-34281][K8S] Promote spark.kubernetes.executor.podNamePrefix to (commit: 78244ba) — dhyun / githubweb
  6. [SPARK-34273][CORE] Do not reregister BlockManager when SparkContext is (commit: bc41c5a) — dhyun / githubweb
  7. [SPARK-26346][BUILD][SQL] Upgrade Parquet to 1.11.1 (commit: a7683af) — yumwang / githubweb
  8. [SPARK-34261][SQL] Avoid side effect if create exists temporary function (commit: 72b7f8a) — yamamuro / githubweb
  9. [SPARK-34237][SQL] Add more metrics (fallback, spill) to object hash (commit: d871b54) — wenchen / githubweb
  10. [SPARK-34269][SQL] Simplify SQL view resolution (commit: b891862) — wenchen / githubweb
  11. [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should (commit: 3f350db) — gurwls223 / githubweb
  12. [SPARK-34144][SQL] Exception thrown when trying to write LocalDate and (commit: 520e5d2) — gurwls223 / githubweb
  13. [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io (commit: 2e192b6) — gurwls223 / githubweb
  14. [SPARK-33601][SQL] Group exception messages in catalyst/parser (commit: 0f7a497) — wenchen / githubweb
  15. [SPARK-33163][SQL][TESTS][FOLLOWUP] Fix the test for the parquet (commit: 588ddcd) — gurwls223 / githubweb
  16. [SPARK-34154][YARN][FOLLOWUP] Fix flaky LocalityPlacementStrategySuite (commit: d3f049c) — gurwls223 / githubweb
  17. [SPARK-34289][SQL] Parquet vectorized reader support column index (commit: f2b22d1) — dhyun / githubweb
  18. [SPARK-34288][WEBUI] Add a tip info for the `resources` column in the (commit: bd9eeeb) — gengliang.wang / githubweb
  19. [SPARK-34270][SS] Combine StateStoreMetrics should not override (commit: 50d14c9) — dhyun / githubweb
  20. [SPARK-34269][SQL][TESTS][FOLLOWUP] Add test cases for cache lookup and (commit: 463d4ec) — viirya / githubweb
  21. [SPARK-34269][SQL][TESTS][FOLLOWUP] Test a subquery with view in (commit: bec88a6) — dhyun / githubweb
  22. [SPARK-34299][SQL] Clean up ResolveSessionCatalog's isTempView and (commit: a8eb443) — gurwls223 / githubweb
  23. [SPARK-34256][ML] VectorSlicer refine numFeatures checking and toString (commit: e0251ac) — ruifengz / githubweb
  24. [SPARK-33245][SQL][FOLLOW-UP] Remove bitwiseGet in Scala functions API (commit: 4e7e7ee) — gurwls223 / githubweb
  25. [SPARK-34266][SQL][DOCS] Update comments for (commit: 9530275) — wenchen / githubweb
  26. [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution (commit: 0837c1a) — wenchen / githubweb
  27. [SPARK-34301][SQL] Use logical plan of alter table in (commit: 2b76e6d) — wenchen / githubweb
  28. [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes (commit: 74116b6) — wenchen / githubweb
  29. [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap (commit: 9db566a) — srowen / githubweb

#743 (Jan 28, 2021 12:49:47 AM)

  1. [SPARK-34187][SS] Use available offset range obtained during polling (commit: ab6c0e5) — dhyun / githubweb
  2. [SPARK-34027][SPARK-34213][SQL][FOLLOWUP][DOCS] Update the SQL migration (commit: 652bdf0) — dhyun / githubweb
  3. [SPARK-34217][INFRA] Fix Scala 2.12 release profile (commit: b8fc6f8) — dhyun / githubweb
  4. [SPARK-33489][PYSPARK] Add NullType support for Arrow executions (commit: 43fdd12) — gurwls223 / githubweb
  5. [SPARK-34185][DOCS] Review and fix issues in API docs (commit: 59cbaca) — gurwls223 / githubweb
  6. [SPARK-34147][SQL][TEST] Keep table partitioning in TPCDSQueryBenchmak (commit: 98ec6c2) — gurwls223 / githubweb
  7. [SPARK-34186][SQL][TESTS] Fix DockerJDBCIntegrationSuites to reflect the (commit: 144ee9e) — dhyun / githubweb
  8. [SPARK-34133][AVRO] Respect case sensitivity when performing (commit: 9371ea8) — wenchen / githubweb
  9. [SPARK-33726][SQL] Fix for Duplicate field names during Aggregation (commit: 512cacf) — wenchen / githubweb
  10. [SPARK-34197][SQL] `SessionCatalog.refreshTable()` should not invalidate (commit: 6fe5a8a) — wenchen / githubweb
  11. [SPARK-34607][SQL][FOLLOWUP] Change Option[LogicalRelation] to (commit: 096b15f) — wenchen / githubweb
  12. [SPARK-34203][SQL] Convert `null` partition values to (commit: bfc0235) — wenchen / githubweb
  13. [SPARK-34218][INFRA] Add Scala 2.13 packaging and publishing (commit: bdf71be) — dhyun / githubweb
  14. [SPARK-34192][SQL] Move char padding to write side and remove length (commit: d1177b5) — wenchen / githubweb
  15. [SPARK-31768][ML][FOLLOWUP] add getMetrics in Evaluators: cleanup (commit: cb37c96) — weichen.xu / githubweb
  16. [SPARK-34223][SQL] FIX NPE for static partition with null in (commit: b3915dd) — wenchen / githubweb
  17. [SPARK-32852][SQL][FOLLOW_UP] Add notice about keep hive version (commit: 7bd4165) — gurwls223 / githubweb
  18. [SPARK-34229][SQL] Avro should read decimal values with the file schema (commit: 7d09eac) — gurwls223 / githubweb
  19. [SPARK-34218][INFRA][FOLLOWUP] Fix Scala 2.13 profile typo in (commit: 785d582) — gurwls223 / githubweb
  20. [SPARK-34232][CORE] Redact SparkListenerEnvironmentUpdate event in log (commit: 68b765e) — gurwls223 / githubweb
  21. [SPARK-34235][SS] Make spark.sql.hive as a private package (commit: 0a1a029) — gurwls223 / githubweb
  22. [SPARK-34227][SQL] WindowFunctionFrame should clear its states during (commit: 8dee8a9) — wenchen / githubweb
  23. [SPARK-34224][CORE][SQL][SS][DSTREAM][YARN][TEST][EXAMPLES] Ensure all (commit: 8999e88) — gurwls223 / githubweb
  24. [SPARK-34026][SQL] Inject repartition and sort nodes to satisfy required (commit: 0867964) — wenchen / githubweb
  25. [SPARK-34241][SQL] For DDL command plan, we should define (commit: dd88eff) — wenchen / githubweb
  26. [SPARK-34215][SQL] Keep tables cached after truncation (commit: ac8307d) — wenchen / githubweb
  27. [SPARK-34244][SQL] Remove the Scala function version of (commit: 99b6af2) — dhyun / githubweb
  28. [SPARK-34052][FOLLOWUP][DOC] Add document in SQL migration guide (commit: c2320a4) — dhyun / githubweb
  29. [SPARK-34212][SQL] Fix incorrect decimal reading from Parquet files (commit: dbf051c) — dhyun / githubweb
  30. [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check (commit: abf7e81) — dhyun / githubweb
  31. [SPARK-33518][ML][FOLLOWUP] MatrixFactorizationModel use GEMV (commit: 56e9426) — ruifengz / githubweb
  32. [SPARK-34220][ML] BucketedRandomProjectionLSH transform optimization (commit: 3c68670) — ruifengz / githubweb
  33. [SPARK-34189][ML] w2v findSynonyms optimization (commit: 2c4e4f8) — ruifengz / githubweb
  34. [SPARK-34236][SQL] Fix v2 Overwrite w/ null static partition raise (commit: 91ca21d) — wenchen / githubweb
  35. [SPARK-34233][SQL] FIX NPE for char padding in binary comparison (commit: 764582c) — wenchen / githubweb
  36. [SPARK-34251][SQL] Fix table stats calculation by `TRUNCATE TABLE` (commit: 0d08e22) — wenchen / githubweb
  37. [SPARK-34231][AVRO][TEST] Make proper use of resource file within (commit: b2c104b) — gurwls223 / githubweb
  38. Revert "[SPARK-31168][SPARK-33913][BUILD] Upgrade Scala to 2.12.13 and (commit: 1217c8b) — gurwls223 / githubweb
  39. [SPARK-34083][SQL] Using TPCDS original definitions for char/varchar (commit: 5718d64) — wenchen / githubweb
  40. [SPARK-34212][SQL][FOLLOWUP] Refine the behavior of reading parquet (commit: 2dbb7d5) — dhyun / githubweb
  41. [SPARK-34267][SQL] Remove `refreshTable()` from `SessionState` (commit: 1318be7) — dhyun / githubweb
  42. [SPARK-34221][WEBUI] Ensure if a stage fails in the UI page, the (commit: f1bc37e) — dhyun / githubweb
  43. [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race (commit: 9d83d62) — gurwls223 / githubweb
  44. [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a (commit: 0dedf24) — gurwls223 / githubweb
  45. [SPARK-33867][SQL] Instant and LocalDate values aren't handled when (commit: 829f118) — yamamuro / githubweb
  46. [SPARK-34260][SQL] Fix UnresolvedException when creating temp view twice (commit: cf1400c) — dhyun / githubweb
  47. [SPARK-34271][SQL] Use majorMinorPatchVersion for Hive version parsing (commit: 6ec3cf6) — gurwls223 / githubweb
  48. [SPARK-34268][SQL][DOCS] Correct the documentation of the concat_ws (commit: 01d11da) — gurwls223 / githubweb
  49. [SPARK-34238][SQL] Unify output of SHOW PARTITIONS and pass output (commit: 850990f) — wenchen / githubweb
  50. [SPARK-33542][SQL][FOLLOWUP] Group exception messages in (commit: b12e9a4) — wenchen / githubweb
  51. [SPARK-34262][SQL] Refresh cached data of v1 table in `ALTER TABLE .. (commit: d242166) — gurwls223 / githubweb
  52. [SPARK-34275][CORE][SQL][MLLIB] Replaces filter and size with count (commit: 15445a8) — gurwls223 / githubweb

#742 (Jan 23, 2021 8:22:08 PM)

  1. [MINOR][ML] Increase the timeout for StreamingLinearRegressionSuite to (commit: f7ff7ff) — weichen.xu / githubweb
  2. [SPARK-34115][CORE] Check SPARK_TESTING as lazy val to avoid slowdown (commit: c3d8352) — gurwls223 / githubweb
  3. [SPARK-34121][SQL] Intersect operator missing rowCount when CBO enabled (commit: f6338a3) — gurwls223 / githubweb
  4. [SPARK-34056][SQL][TESTS] Unify v1 and v2 ALTER TABLE .. RECOVER (commit: 00b444d) — wenchen / githubweb
  5. [SPARK-34052][SQL] store SQL text for a temp view created using "CACHE (commit: 902a08b) — wenchen / githubweb
  6. [SPARK-33940][BUILD] Upgrade univocity to 2.9.1 (commit: 7f3e952) — gurwls223 / githubweb
  7. [SPARK-34162][DOCS][PYSPARK] Add PyArrow compatibility note for Python (commit: 7e1651e) — dhyun / githubweb
  8. [SPARK-34166][CORE][TESTS] Fix flaky test in DecommissionWorkerSuite (commit: 2145f07) — dhyun / githubweb
  9. [SPARK-34178][SQL] Copy tags for the new node created by (commit: f498977) — wenchen / githubweb
  10. [SPARK-34176][BUILD] Restore the independent mvn test ability of (commit: d68612a) — dhyun / githubweb
  11. [SPARK-27733][CORE] Upgrade Avro to version 1.10.1 (commit: e9e81f7) — dhyun / githubweb
  12. [MINOR][TESTS] Increase tolerance to 0.2 for NaiveBayesSuite (commit: c8c70d5) — dhyun / githubweb
  13. [SPARK-34047][ML] tree models saving: compute numParts according to (commit: 7c9b756) — ruifengz / githubweb
  14. [SPARK-34181][DOC] Update Prerequisites for build doc of ruby 3.0 issue (commit: faa4f0c) — gurwls223 / githubweb
  15. [SPARK-34164][SQL] Improve write side varchar check to visit only last (commit: d640631) — wenchen / githubweb
  16. [SPARK-34096][SQL] Improve performance for nth_value ignore nulls over (commit: 140538e) — wenchen / githubweb
  17. [SPARK-34099][SQL][TESTS] Check re-caching of v2 table dependents after (commit: 31d8283) — wenchen / githubweb
  18. [SPARK-33901][SQL][FOLLOWUP] Add drop table in charvarchar test (commit: da4b50f) — wenchen / githubweb
  19. [SPARK-34138][SQL] Keep dependants cached while refreshing v1 tables (commit: e79c1cd) — wenchen / githubweb
  20. [SPARK-34190][DOCS] Supplement the description for Python Package (commit: 28131a7) — gurwls223 / githubweb
  21. [SPARK-34094][SQL] Extends StringTranslate to support unicode characters (commit: 116f4ca) — srowen / githubweb
  22. [SPARK-34180][SQL] Fix the regression brought by SPARK-33888 for (commit: 8429021) — gurwls223 / githubweb
  23. [SPARK-33813][SQL] Fix the issue that JDBC source can't treat MS SQL (commit: 45f0763) — wenchen / githubweb
  24. [SPARK-33541][SQL] Group exception messages in catalyst/expressions (commit: cde697a) — wenchen / githubweb
  25. [SPARK-33245][SQL] Add built-in UDF - GETBIT (commit: fec82c9) — wenchen / githubweb
  26. [SPARK-33933][SQL] Materialize BroadcastQueryStage first to try to avoid (commit: 2db0a95) — wenchen / githubweb
  27. [SPARK-34200][SQL] Ambiguous column reference should consider attribute (commit: b8a6906) — gurwls223 / githubweb
  28. [SPARK-34191][PYTHON][SQL] Add typing for udf overload (commit: 121eb01) — gurwls223 / githubweb
  29. [SPARK-34208][BUILD] Upgrade ORC to 1.6.7 (commit: d5d1c84) — dhyun / githubweb
  30. [SPARK-34206][K8S] Make Guava Cache as ExecutorPodsLifecycleManager (commit: 134a7d7) — dhyun / githubweb
  31. [SPARK-34202][SQL][TEST] Add ability to fetch spark release package from (commit: e48a8ad) — dhyun / githubweb
  32. [SPARK-34207][SQL] Rename `isTemporaryTable` to `isTempView` in (commit: 0592503) — dhyun / githubweb
  33. [SPARK-34213][SQL] Refresh cached data of v1 table in `LOAD DATA` (commit: f8bf72e) — dhyun / githubweb
  34. [SPARK-34155][SQL][TEST] Add partition columns for TPCDS tables (commit: 4fce05d) — gurwls223 / githubweb

#741 (Jan 19, 2021 12:02:10 PM)

  1. Revert "[SPARK-34064][SQL] Cancel the running broadcast sub-jobs when (commit: 6cd0092) — wenchen / githubweb
  2. [SPARK-33346][CORE][SQL][MLLIB][DSTREAM][K8S] Change the never changed (commit: 9e33d49) — srowen / githubweb
  3. [SPARK-32598][SCHEDULER] Fix missing driver logs under UI App-Executors (commit: c75c29d) — srowen / githubweb
  4. [SPARK-34037][SQL] Remove unnecessary upcasting for Avg & Sum which (commit: a235c3b) — viirya / githubweb
  5. [SPARK-33212][BUILD] Upgrade to Hadoop 3.2.2 and move to shaded clients (commit: b6f46ca) — dhyun / githubweb
  6. [SPARK-34060][SQL][FOLLOWUP] Preserve serializability of canonicalized (commit: c3d81fb) — dhyun / githubweb
  7. [SPARK-34132][DOCS][R] Update Roxygen version references to 7.1.1 (commit: 66cc129) — dhyun / githubweb
  8. [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector (commit: f354883) — weichen.xu / githubweb
  9. [SPARK-34110][BUILD] Upgrade Zookeeper to 3.6.2 (commit: d6906b3) — dhyun / githubweb
  10. [MINOR][DOCS] Update Parquet website link (commit: 1cf09b7) — dhyun / githubweb
  11. [SPARK-34140][SQL] Move QueryCompilationErrors.scala and (commit: 0540392) — dhyun / githubweb
  12. [MINOR][INFRA] Update a broken link in .asf.yml (commit: 441fffa) — dhyun / githubweb
  13. [SPARK-34123][WEB UI] optimize spark history summary page loading (commit: ebd8bc9) — srowen / githubweb
  14. [SPARK-33730][PYTHON] Standardize warning types (commit: 098f226) — gurwls223 / githubweb
  15. [SPARK-34142][CORE] Support Fallback Storage Cleanup during stopping (commit: 415506c) — dhyun / githubweb
  16. [MINOR][DOCS] Fix broken python doc links (commit: 8847b7f) — gurwls223 / githubweb
  17. [MINOR][DOCS] Fix typos in sql-ref-datatypes.md (commit: 536a725) — gurwls223 / githubweb
  18. [SPARK-34080][ML][PYTHON][FOLLOWUP] Add UnivariateFeatureSelector - make (commit: ac322a1) — gurwls223 / githubweb
  19. [SPARK-30682][R][SQL][FOLLOW-UP] Keep the name similar with Scala side (commit: b5bdbf2) — gurwls223 / githubweb
  20. [SPARK-33696][BUILD][SQL] Upgrade built-in Hive to 2.3.8 (commit: c87b008) — dhyun / githubweb
  21. [SPARK-34139][SQL] UnresolvedRelation should retain SQL text position (commit: 78893b8) — wenchen / githubweb
  22. [SPARK-34151][SQL] Replaces `java.io.File.toURL` with (commit: 163afa6) — gurwls223 / githubweb
  23. [SPARK-34027][SQL] Refresh cache in `ALTER TABLE .. RECOVER PARTITIONS` (commit: dee596e) — wenchen / githubweb
  24. [SPARK-34093][ML] param maxDepth should check upper bound (commit: d8cbef1) — srowen / githubweb
  25. [SPARK-34148][TEST][SS] Move general StateStore tests to (commit: bba830f) — dhyun / githubweb
  26. [SPARK-31168][SPARK-33913][BUILD] Upgrade Scala to 2.12.13 and Kafka to (commit: a65e86a) — dhyun / githubweb
  27. [SPARK-34074][SQL][TESTS][FOLLOWUP] Fix table size parsing from (commit: 514172a) — gurwls223 / githubweb
  28. [SPARK-34153][SQL] Remove unused `getRawTable()` from (commit: bea10a6) — gurwls223 / githubweb
  29. [SPARK-34150][SQL] Strip Null literal.sql in resolve alias (commit: 055124a) — wenchen / githubweb
  30. [SPARK-34143][SQL][TESTS] Fix adding partitions to fully partitioned v2 (commit: a98e77c) — wenchen / githubweb
  31. [SPARK-34119][SQL] Keep necessary stats after partition pruning (commit: 030639f) — wenchen / githubweb
  32. [SPARK-33730][PYTHON][FOLLOW-UP] Consider the case when the current (commit: 0130a38) — gurwls223 / githubweb
  33. [SPARK-34130][SQL] Impove preformace for char varchar padding and length (commit: 6fa2fb9) — wenchen / githubweb
  34. [SPARK-33939][SQL] Make Column.named UnresolvedExtractValue use (commit: addbbe8) — wenchen / githubweb
  35. [SPARK-34149][SQL] Refresh cache in v2 `ALTER TABLE .. ADD PARTITION` (commit: 32dad1d) — wenchen / githubweb

#740 (Jan 15, 2021 2:47:03 AM)

  1. [MINOR] Improve flaky NaiveBayes test (commit: 11fac23) — ruifengz / githubweb
  2. [SPARK-34057][SQL] UnresolvedTableOrView should retain SQL text position (commit: 8391a4a) — wenchen / githubweb
  3. [SPARK-33970][SQL][TEST] Add test default partition in (commit: f77eeb0) — gurwls223 / githubweb
  4. [SPARK-34055][SQL][TESTS][FOLLOWUP] Check partition adding to cached (commit: 664ef18) — wenchen / githubweb
  5. [SPARK-34060][SQL] Fix Hive table caching while updating stats by `ALTER (commit: d97e991) — wenchen / githubweb
  6. [SPARK-31952][SQL] Fix incorrect memory spill metric when doing (commit: 4afca0f) — wenchen / githubweb
  7. [SPARK-34065][INFRA] Cancel the duplicated jobs only in PRs at GitHub (commit: ff49317) — gurwls223 / githubweb
  8. [SPARK-33084][CORE][SQL] Rename Unit test file and use fake ivy link (commit: 5ef6907) — gurwls223 / githubweb
  9. [SPARK-33991][CORE][WEBUI] Repair enumeration conversion error for (commit: 1495ad8) — srowen / githubweb
  10. [SPARK-34002][SQL] Fix the usage of encoder in ScalaUDF (commit: 0bcbafb) — dhyun / githubweb
  11. [MINOR][SS] Add some description about auto reset and data loss note to (commit: ad9fad7) — dhyun / githubweb
  12. [SPARK-33970][SQL][TEST][FOLLOWUP] Use String comparision (commit: 3556929) — dhyun / githubweb
  13. [SPARK-33711][K8S] Avoid race condition between POD lifecycle manager (commit: 6bd7a62) — hkarau / githubweb
  14. [SPARK-34045][ML] OneVsRestModel.transform should not call setter of (commit: 7ff9ff1) — ruifengz / githubweb
  15. [SPARK-34074][SQL] Update stats only when table size changes (commit: f7cbeec) — wenchen / githubweb
  16. [SPARK-28646][SQL][FOLLOWUP] Add legacy config for allowing (commit: 02a17e9) — gurwls223 / githubweb
  17. [SPARK-34003][SQL][FOLLOWUP] Avoid pushing modified Char/Varchar sort (commit: 99f8489) — wenchen / githubweb
  18. [SPARK-34053][INFRA][FOLLOW-UP] Disables canceling push/schedule (commit: a4b7075) — gurwls223 / githubweb
  19. [SPARK-34084][SQL] Fix auto updating of table stats in `ALTER TABLE .. (commit: 6c04795) — wenchen / githubweb
  20. [SPARK-34091][SQL] Shuffle batch fetch should be able to disable after (commit: 0099715) — wenchen / githubweb
  21. [SPARK-34069][CORE] Kill barrier tasks should respect (commit: 65222b7) — mridulatgmail.com / githubweb
  22. [SPARK-32338][SQL][PYSPARK][FOLLOW-UP][TEST] Add more tests for slice (commit: ad8e40e) — gurwls223 / githubweb
  23. [SPARK-34090][SS] Cache HadoopDelegationTokenManager.isServiceEnabled (commit: b0759dc) — gurwls223 / githubweb
  24. [SPARK-34071][SQL][TESTS] Check stats of cached v1 tables after altering (commit: 861f8bb) — wenchen / githubweb
  25. [SPARK-34086][SQL] RaiseError generates too much code and may fails (commit: 04f031a) — wenchen / githubweb
  26. [SPARK-32850][TEST][FOLLOWUP] Fix flaky test due to timeout (commit: f64297d) — gurwls223 / githubweb
  27. [SPARK-34064][SQL] Cancel the running broadcast sub-jobs when SQL (commit: f1b21ba) — wenchen / githubweb
  28. [SPARK-34076][SQL] SQLContext.dropTempTable fails if cache is non-empty (commit: 62d82b5) — wenchen / githubweb
  29. [SPARK-33741][CORE] Add min threshold time speculation config (commit: bd5039f) — tgraves / githubweb
  30. [SPARK-34070][CORE][SQL] Replaces find and emptiness check with exists (commit: 8c5fecd) — srowen / githubweb
  31. [SPARK-34068][CORE][SQL][MLLIB][GRAPHX] Remove redundant collection (commit: 8b1ba23) — srowen / githubweb
  32. [SPARK-34051][SQL] Support 32-bit unicode escape in string literals (commit: 62d8466) — srowen / githubweb
  33. [SPARK-33690][SQL][FOLLOWUP] Escape further meta-characters in (commit: b7da108) — srowen / githubweb
  34. [SPARK-34103][INFRA] Fix MiMaExcludes by moving SPARK-23429 from 2.4 to (commit: 9e93fdb) — gurwls223 / githubweb
  35. [SPARK-34075][SQL][CORE] Hidden directories are being listed for (commit: 467d758) — gurwls223 / githubweb
  36. [SPARK-34081][SQL] Only pushdown LeftSemi/LeftAnti over Aggregate if (commit: d3ea308) — wenchen / githubweb
  37. [SPARK-34067][SQL] PartitionPruning push down pruningHasBenefit function (commit: 1288ad8) — yumwang / githubweb
  38. [SPARK-33989][SQL] Strip auto-generated cast when using Cast.sql (commit: 92e5cfd) — wenchen / githubweb
  39. [SPARK-33354][FOLLOWUP][DOC] Shorten the table width of ANSI compliance (commit: feedd1b) — dhyun / githubweb
  40. [SPARK-34116][SS][TEST] Separate state store numKeys metric test and (commit: 0e64a22) — dhyun / githubweb
  41. [SPARK-34118][CORE][SQL] Replaces filter and check for emptiness with (commit: 8ed23ed) — gurwls223 / githubweb
  42. [SPARK-34099][SQL] Keep dependents of v2 tables cached during cache (commit: adba2ec) — wenchen / githubweb
  43. [SPARK-34101][SQL] Make spark-sql CLI configurable for the behavior of (commit: bec80d7) — gurwls223 / githubweb
  44. [SPARK-34114][SQL] should not trim right for read-side char length check (commit: acd6c12) — wenchen / githubweb
  45. [SPARK-32864][SQL] Support ORC forced positional evolution (commit: 00d43b1) — dhyun / githubweb

#739 (Jan 10, 2021 4:28:53 PM)

  1. [SPARK-34036][DOCS] Update ORC data source documentation (commit: 9b5df2a) — dhyun / githubweb
  2. [SPARK-34021][R] Fix hyper links in SparkR documentation for CRAN (commit: 0ba3ab4) — gurwls223 / githubweb
  3. [SPARK-34028][SQL] Cleanup "unreachable code" compilation warning (commit: 26b6039) — gurwls223 / githubweb
  4. [SPARK-33861][SQL][FOLLOWUP] Simplify conditional in predicate should (commit: 3aa4e11) — gurwls223 / githubweb
  5. [SPARK-34031][SQL] Union operator missing rowCount when CBO enabled (commit: aa509c1) — gurwls223 / githubweb
  6. Revert "[SPARK-34029][SQL][TESTS] Add OrcEncryptionSuite and (commit: 194edc8) — dhyun / githubweb
  7. [SPARK-33933][SQL] Materialize BroadcastQueryStage first to avoid (commit: d36cdd5) — wenchen / githubweb
  8. [SPARK-33100][SQL][FOLLOWUP] Find correct bound of bracketed comment in (commit: 7b06acc) — yamamuro / githubweb
  9. [SPARK-34041][PYTHON][DOCS] Miscellaneous cleanup for new PySpark (commit: aa388cf) — gurwls223 / githubweb
  10. [SPARK-34044][DOCS] Add spark.sql.hive.metastore.jars.path to (commit: 5b16d70) — gurwls223 / githubweb
  11. [SPARK-34018][K8S] NPE in ExecutorPodsSnapshot (commit: 8e11ce5) — dhyun / githubweb
  12. [SPARK-33818][SQL][DOC] Add descriptions about (commit: 9b54da4) — dhyun / githubweb
  13. [SPARK-34039][SQL] ReplaceTable should invalidate cache (commit: 0de7f2f) — dhyun / githubweb
  14. [SPARK-34005][CORE] Update peak memory metrics for each Executor on task (commit: cc20154) — dhyun / githubweb
  15. [SPARK-34046][SQL][TESTS] Use join hint for constructing joins in (commit: b95a847) — wenchen / githubweb
  16. [SPARK-34003][SQL] Fix Rule conflicts between (commit: 0f8e5dd) — wenchen / githubweb
  17. [SPARK-34032][SS] Add truststore and keystore type config possibility (commit: 71d261a) — kabhwan.opensource / githubweb
  18. [SPARK-33591][SQL] Recognize `null` in partition spec values (commit: 157b72a) — wenchen / githubweb
  19. [SPARK-33796][DOCS][FOLLOWUP] Tweak the width of left-menu of Spark SQL (commit: 023eba2) — srowen / githubweb
  20. [MINOR][SQL][TESTS] Fix the incorrect unicode escape test in (commit: 0781ed4) — srowen / githubweb
  21. [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle (commit: d00f069) — mridulatgmail.com / githubweb
  22. [SPARK-34049][SS] DataSource V2: Use Write abstraction in (commit: 6b34745) — dhyun / githubweb
  23. [SPARK-34048][SQL][TESTS] Check the amount of calls to Hive external (commit: 0af3874) — dhyun / githubweb
  24. [SPARK-34030][SQL] Fold RepartitionByExpression num partition should at (commit: 48cd11c) — gurwls223 / githubweb
  25. Revert "[SPARK-33933][SQL] Materialize BroadcastQueryStage first to (commit: 105ba6e) — gurwls223 / githubweb
  26. [SPARK-34055][SQL] Refresh cache in `ALTER TABLE .. ADD PARTITION` (commit: e0e06c1) — gurwls223 / githubweb
  27. [SPARK-32668][SQL] HiveGenericUDTF initialize UDTF should use (commit: 48b9611) — yumwang / githubweb
  28. [SPARK-34055][SQL][TESTS][FOLLOWUP] Increase the expected number of (commit: 9a8d275) — gurwls223 / githubweb
  29. [SPARK-34059][SQL][CORE] Use for/foreach rather than map to make sure (commit: 8302492) — viirya / githubweb
  30. [SPARK-34053][INFRA] Cancel the previous build (commit: 3e5e086) — dhyun / githubweb

#738 (Jan 6, 2021 7:18:24 PM)

  1. [SPARK-33957][BUILD] Update commons-lang3 to 3.11 (commit: bd346f4) — dhyun / githubweb
  2. [SPARK-33956][SQL] Add rowCount for Range operator (commit: 4cd6805) — dhyun / githubweb
  3. [SPARK-33961][BUILD] Upgrade SBT to 1.4.6 (commit: 1c25bea) — dhyun / githubweb
  4. [SPARK-33959][SQL] Improve the statistics estimation of the Tail (commit: 6c5ba81) — gurwls223 / githubweb
  5. [SPARK-33963][SQL] Canonicalize `HiveTableRelation` w/o table stats (commit: fc7d016) — gurwls223 / githubweb
  6. [SPARK-33962][SS] Fix incorrect min partition condition (commit: cfd4a08) — dhyun / githubweb
  7. [SPARK-33955][SS] Add latest offsets to source progress (commit: 963c60f) — dhyun / githubweb
  8. [SPARK-33398] Fix loading tree models prior to Spark 3.0 (commit: 6b7527e) — srowen / githubweb
  9. [SPARK-33950][SQL] Refresh cache in v1 `ALTER TABLE .. DROP PARTITION` (commit: 67195d0) — wenchen / githubweb
  10. [SPARK-33951][SQL] Distinguish the error between filter and distinct (commit: b037930) — wenchen / githubweb
  11. [SPARK-33954][SQL] Some operator missing rowCount when enable CBO (commit: 2a68ed7) — wenchen / githubweb
  12. [SPARK-33934][SQL] Add SparkFile's root dir to env property PATH (commit: adac633) — gurwls223 / githubweb
  13. [SPARK-33888][SQL] JDBC SQL TIME type represents incorrectly as (commit: 0b647fe) — wenchen / githubweb
  14. [SPARK-33965][SQL][TESTS] Recognize `spark_catalog` by `CACHE TABLE` in (commit: 8b3fb43) — wenchen / githubweb
  15. [SPARK-33978][SQL] Support ZSTD compression in ORC data source (commit: 271c4f6) — dhyun / githubweb
  16. [SPARK-33844][SQL] InsertIntoHiveDir command should check col name too (commit: 8583a46) — wenchen / githubweb
  17. [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables (commit: ddc0d51) — wenchen / githubweb
  18. [SPARK-33984][PYTHON] Upgrade to Py4J 0.10.9.1 (commit: 6b86aa0) — dhyun / githubweb
  19. [SPARK-33990][SQL][TESTS] Remove partition data by v2 `ALTER TABLE .. (commit: fc3f226) — dhyun / githubweb
  20. [SPARK-33988][SQL][TEST] Add an option to enable CBO in (commit: 414d323) — dhyun / githubweb
  21. [SPARK-33983][PYTHON] Update cloudpickle to v1.6.0 (commit: d6322bf) — dhyun / githubweb
  22. [SPARK-33980][SS] Invalidate char/varchar in spark.readStream.schema (commit: ac4651a) — dhyun / githubweb
  23. [SPARK-33996][BUILD] Upgrade checkstyle plugins (commit: 90f4ecf) — dhyun / githubweb
  24. [SPARK-33987][SQL] Refresh cache in v2 `ALTER TABLE .. DROP PARTITION` (commit: 84c1f43) — dhyun / githubweb
  25. [SPARK-33894][SQL] Change visibility of private case classes in mllib to (commit: 9b4173f) — dhyun / githubweb
  26. [SPARK-33908][CORE][FOLLOWUP] Correct Scaladoc of (commit: 559f411) — dhyun / githubweb
  27. [SPARK-33964][SQL] Combine distinct unions in more cases (commit: bb6d6b5) — gurwls223 / githubweb
  28. [SPARK-33794][SQL] NextDay expression throw runtime (commit: 976e97a) — wenchen / githubweb
  29. [SPARK-33998][SQL] Provide an API to create an InternalRow in (commit: 6b00fdc) — wenchen / githubweb
  30. [SPARK-34001][SQL][TESTS] Remove unused runShowTablesSql() in (commit: 15a863f) — dhyun / githubweb
  31. [SPARK-33992][SQL] override transformUpWithNewOutput to add (commit: f0ffe0c) — wenchen / githubweb
  32. [SPARK-34000][CORE] Fix stageAttemptToNumSpeculativeTasks (commit: a7d3fcd) — dhyun / githubweb
  33. [SPARK-33100][SQL] Ignore a semicolon inside a bracketed comment in (commit: a071826) — yamamuro / githubweb
  34. [SPARK-33935][SQL] Fix CBO cost function (commit: f252a93) — yamamuro / githubweb
  35. [SPARK-33919][SQL][TESTS] Unify v1 and v2 SHOW NAMESPACES tests (commit: 122f8f0) — wenchen / githubweb
  36. [SPARK-34007][BUILD] Downgrade scala-maven-plugin to 4.3.0 (commit: 356fdc9) — gurwls223 / githubweb
  37. [SPARK-32017][PYTHON][FOLLOW-UP] Rename HADOOP_VERSION to (commit: 329850c) — gurwls223 / githubweb
  38. [SPARK-33999][BUILD] Make sbt unidoc success with JDK11 (commit: acf0a4f) — gurwls223 / githubweb
  39. [SPARK-34010][SQL][DODCS] Use python3 instead of python in SQL (commit: 8d09f96) — gurwls223 / githubweb
  40. [SPARK-34009][BUILD] To activate profile 'aarch64' based on OS settings (commit: 14c2eda) — gurwls223 / githubweb
  41. [SPARK-33542][SQL] Group exception messages in catalyst/catalog (commit: cc1d9d2) — wenchen / githubweb
  42. [SPARK-33874][K8S][FOLLOWUP] Handle long lived sidecars - clean up (commit: 171db85) — dhyun / githubweb
  43. [SPARK-34012][SQL] Keep behavior consistent when conf (commit: e279ed3) — yamamuro / githubweb
  44. [SPARK-34011][SQL] Refresh cache in `ALTER TABLE .. RENAME TO PARTITION` (commit: b77d11d) — gurwls223 / githubweb
  45. [SPARK-34015][R] Fixing input timing in gapply (commit: 3d8ee49) — gurwls223 / githubweb
  46. [SPARK-33029][CORE][WEBUI] Fix the UI executor page incorrectly marking (commit: 2951082) — dhyun / githubweb
  47. [SPARK-34004][SQL] Change FrameLessOffsetWindowFunction as sealed (commit: 2ab77d6) — dhyun / githubweb
  48. [SPARK-34008][BUILD] Upgrade derby to 10.14.2.0 (commit: b1c4fc7) — dhyun / githubweb
  49. [SPARK-33635][SS] Adjust the order of check in (commit: fa93090) — dhyun / githubweb
  50. [SPARK-33934][SQL][FOLLOW-UP] Use SubProcessor's exit code as assert (commit: c0d0dba) — dhyun / githubweb
  51. [SPARK-33948][SQL] Fix CodeGen error of MapObjects.doGenCode method in (commit: 45a4ff8) — dhyun / githubweb
  52. [SPARK-33938][SQL] Optimize Like Any/All by LikeSimplification (commit: 26d8df3) — wenchen / githubweb
  53. [SPARK-32221][K8S] Avoid possible errors due to incorrect file size or (commit: f64dfa8) — prashsh1 / githubweb
  54. [SPARK-30681][PYTHON][FOLLOW-UP] Keep the name similar with Scala side (commit: ff284fb) — gurwls223 / githubweb
  55. [SPARK-34022][DOCS] Support latest mkdocs in SQL built-in function docs (commit: 0d86a02) — gurwls223 / githubweb
  56. [SPARK-33977][SQL][DOCS] Add doc for "'like any' and 'like all' (commit: 6788304) — yamamuro / githubweb
  57. [SPARK-32685][SQL][FOLLOW-UP] Update migration guide about change (commit: 3cdc4ef) — wenchen / githubweb
  58. [SPARK-34022][DOCS][FOLLOW-UP] Fix typo in SQL built-in function docs (commit: a0269bb) — dhyun / githubweb
  59. [SPARK-34029][SQL][TESTS] Add OrcEncryptionSuite and FakeKeyProvider (commit: 8bb70bf) — dhyun / githubweb
  60. [SPARK-33806][SQL][FOLLOWUP] Fold RepartitionExpression num partition (commit: f9daf03) — dhyun / githubweb

#719 (Jan 1, 2021 4:30:22 AM)

  1. [SPARK-33932][SS] Clean up KafkaOffsetReader API document (commit: 951afc3) — gurwls223 / githubweb
  2. [SPARK-33874][K8S] Handle long lived sidecars (commit: 448494e) — gurwls223 / githubweb
  3. [SPARK-32684][SQL][TESTS] Add a test case to check if null value is same (commit: 49aa6eb) — wenchen / githubweb
  4. [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright (commit: 687f465) — wenchen / githubweb
  5. [MINOR][SS] Call fetchEarliestOffsets when it is necessary (commit: 4a669f5) — gurwls223 / githubweb
  6. [SPARK-33927][BUILD] Fix Dockerfile for Spark release to work (commit: 403bf55) — gurwls223 / githubweb
  7. [SPARK-33926][SQL] Improve the error message from resolving of v1 (commit: 0eb4961) — wenchen / githubweb
  8. [SPARK-33904][SQL] Recognize `spark_catalog` in `saveAsTable()` and (commit: 2afd1fb) — wenchen / githubweb
  9. [SPARK-30789][SQL] Support (IGNORE | RESPECT) NULLS for (commit: ba974ea) — wenchen / githubweb
  10. [SPARK-33907][SQL] Only prune columns of from_json if parsing options is (commit: f38265d) — viirya / githubweb
  11. [SPARK-33804][CORE] Fix compilation warnings about 'view bounds are (commit: 85de644) — srowen / githubweb
  12. [SPARK-33942][DOCS] Remove `hiveClientCalls.count` in `CodeGenerator` (commit: 13e8c28) — dhyun / githubweb
  13. [SPARK-31946][CORE] Make worker/executor decommission signal (commit: 3fe5614) — dhyun / githubweb
  14. [SPARK-33084][SQL][TESTS][FOLLOW-UP] Fix Scala 2.13 UT failure (commit: 771c538) — dhyun / githubweb
  15. [SPARK-33944][SQL] Incorrect logging for warehouse keys in SharedState (commit: ed9f728) — dhyun / githubweb
  16. [SPARK-33906][WEBUI] Fix the bug of UI Executor page stuck due to (commit: 45df6db) — dhyun / githubweb

#718 (Dec 29, 2020 2:06:10 PM)

  1. [SPARK-33824][PYTHON][DOCS][FOLLOW-UP] Clarify about (commit: 678294d) — gurwls223 / githubweb
  2. [SPARK-33532][SQL] Add comments to a unreachable branch in (commit: e6f0198) — gurwls223 / githubweb
  3. [SPARK-33918][SQL] UnresolvedView should retain SQL text position for (commit: fe33262) — wenchen / githubweb
  4. [SPAKR-33801][CORE][SQL] Fix compilation warnings about 'Unicode escapes (commit: 1be9e7e) — gurwls223 / githubweb
  5. [SPARK-33901][SQL] Fix Char and Varchar display error after DDLs (commit: 3fdbc48) — wenchen / githubweb
  6. [SPARK-33908][CORE] Refactor SparkSubmitUtils.resolveMavenCoordinates() (commit: 0a3f3d6) — gurwls223 / githubweb
  7. [SPARK-33914][SQL][DOCS] Describe the structure of unified DS v1 and v2 (commit: 4a61fc1) — wenchen / githubweb
  8. [SPARK-33827][SS] Unload inactive state store as soon as possible (commit: c75f779) — kabhwan.opensource / githubweb
  9. [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled (commit: 00fa49a) — dhyun / githubweb
  10. [SPARK-32685][SQL] When specify serde, default filed.delim is '\t' (commit: fc508d1) — wenchen / githubweb
  11. [SPARK-33899][SQL] Fix assert failure in v1 SHOW TABLES/VIEWS on (commit: 0617dfc) — wenchen / githubweb
  12. [SPARK-33916][CORE] Fix fallback storage offset and improve compression (commit: 6497ccb) — dhyun / githubweb
  13. [SPARK-33845][SQL][FOLLOWUP] fix SimplifyConditionals (commit: c2eac1d) — dhyun / githubweb
  14. [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile (commit: b33fa53) — dhyun / githubweb
  15. [SPARK-33924][SQL][TESTS] Preserve partition metadata by INSERT INTO in (commit: 379afcd) — wenchen / githubweb
  16. [SPARK-33884][SQL] Simplify CaseWhenclauses with (true and false) and (commit: f7bdea3) — wenchen / githubweb
  17. [SPARK-33928][SPARK-23365][TEST][CORE] Fix flaky (commit: 1ef7ddd) — wenchen / githubweb
  18. [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job (commit: 2627825) — gurwls223 / githubweb
  19. [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs (commit: f9fe742) — gurwls223 / githubweb
  20. [SPARK-33775][FOLLOWUP][TEST-MAVEN][BUILD] Suppress maven compilation (commit: 9d6dbe0) — gurwls223 / githubweb
  21. [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION (commit: e0d2ffe) — wenchen / githubweb
  22. [SPARK-33909][SQL] Check rand functions seed is legal at analyer side (commit: 3b1b209) — wenchen / githubweb
  23. [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / (commit: 872107f) — wenchen / githubweb
  24. [SPARK-33930][SQL] Script Transform default FIELD DELIMIT should be (commit: aadda4b) — gurwls223 / githubweb
  25. [SPARK-33859][SQL][FOLLOWUP] Add version to (commit: 16c594d) — wenchen / githubweb
  26. [SPARK-33847][SQL][FOLLOWUP] Remove the CaseWhen should consider (commit: c425024) — wenchen / githubweb
  27. [SPARK-33936][SQL] Add the version when connector's methods and (commit: 2b6836c) — dhyun / githubweb

#717 (Dec 27, 2020 9:01:29 AM)

  1. [SPARK-33897][SQL] Can't set option 'cross' in join method (commit: 2553d53) — gurwls223 / githubweb
  2. [SPARK-33560][TEST-MAVEN][BUILD] Add "unused-import" check to Maven (commit: 37ae0a6) — srowen / githubweb
  3. [SPARK-33911][SQL][DOCS] Update the SQL migration guide about changes in (commit: b2dfeae) — gurwls223 / githubweb

#716 (Dec 25, 2020 3:50:38 AM)

  1. [SPARK-33870][CORE] Enable spark.storage.replication.proactive by (commit: 90d6f86) — dhyun / githubweb
  2. [SPARK-33526][SQL][FOLLOWUP] Fix flaky test due to timeout and fix docs (commit: e853f06) — dhyun / githubweb
  3. [SPARK-33879][SQL] Char Varchar values fails w/ match error as partition (commit: 2287f56) — gurwls223 / githubweb
  4. [SPARK-31960][YARN][DOCS][FOLLOW-UP] Document the behaviour change of (commit: d98c216) — gurwls223 / githubweb
  5. [SPARK-33787][SQL] Allow partition purge for v2 tables (commit: 34bfb3a) — wenchen / githubweb
  6. [SPARK-33497][SQL] Override maxRows in some LogicalPlan (commit: f421c17) — wenchen / githubweb
  7. [SPARK-33858][SQL][TESTS] Unify v1 and v2 ALTER TABLE .. RENAME (commit: cc23581) — wenchen / githubweb
  8. [SPARK-33889][SQL] Fix NPE from `SHOW PARTITIONS` on V2 tables (commit: 303df64) — wenchen / githubweb
  9. [SPARK-33847][SQL] Simplify CaseWhen if elseValue is None (commit: 7ffcfcf) — wenchen / githubweb
  10. [SPARK-33891][DOCS][CORE] Update dynamic allocation related documents (commit: 47d1aa4) — gurwls223 / githubweb
  11. [SPARK-32916][SHUFFLE][TEST-MAVEN][TEST-HADOOP2.7] Ensure the number of (commit: 0677c39) — mridulatgmail.com / githubweb
  12. [SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop consuming (commit: 5c9b421) — dhyun / githubweb
  13. [SPARK-33893][CORE] Exclude fallback block manager from executorList (commit: d467d81) — dhyun / githubweb
  14. [SPARK-33877][SQL][FOLLOWUP] SQL reference documents for INSERT w/ a (commit: 368a2c3) — dhyun / githubweb
  15. [SPARK-33835][CORE] Refector AbstractCommandBuilder.buildJavaCommand: (commit: 61881bb) — srowen / githubweb
  16. [SPARK-33659][SS] Document the current behavior for (commit: 86c1cfc) — gurwls223 / githubweb
  17. [SPARK-33886][SQL] UnresolvedTable should retain SQL text position for (commit: f1d3797) — wenchen / githubweb
  18. [SPARK-33895][SQL] Char and Varchar fail in MetaOperation of (commit: d7dc42d) — wenchen / githubweb
  19. [SPARK-33861][SQL] Simplify conditional in predicate (commit: 32d4a2b) — wenchen / githubweb
  20. [SPARK-33443][SQL] LEAD/LAG should support [ IGNORE NULLS | RESPECT (commit: 3e9821e) — wenchen / githubweb
  21. [SPARK-33881][SQL][TESTS] Check null and empty string as partition (commit: 54a6784) — wenchen / githubweb
  22. [SPARK-33892][SQL] Display char/varchar in DESC and SHOW CREATE TABLE (commit: 29cca68) — wenchen / githubweb
  23. [SPARK-33900][WEBUI] Show shuffle read size / records correctly when (commit: 700f5ab) — sarutak / githubweb
  24. [SPARK-33857][SQL] Unify the default seed of random functions (commit: 9c30116) — dhyun / githubweb
  25. [SPARK-30027][SQL] Support codegen for aggregate filters in (commit: 65a9ac2) — dhyun / githubweb
  26. [SPARK-33084][CORE][SQL] Add jar support ivy path (commit: 10b6466) — yamamuro / githubweb

#715 (Dec 22, 2020 9:34:55 PM)

  1. [SPARK-33850][SQL][FOLLOWUP] Improve and cleanup the test code (commit: 3c8be39) — yamamuro / githubweb
  2. [SPARK-26341][WEBUI][FOLLOWUP] Update stage memory metrics on stage end (commit: 8e26339) — dongjoon / githubweb
  3. [SPARK-33856][SQL] Migrate ALTER TABLE ... RENAME TO PARTITION to use (commit: 1c7b79c) — wenchen / githubweb
  4. [SPARK-33849][SQL][TESTS] Unify v1 and v2 DROP TABLE tests (commit: b313a1e) — wenchen / githubweb
  5. [SPARK-33836][SS][PYTHON] Expose DataStreamReader.table and (commit: 8d4d433) — gurwls223 / githubweb
  6. [SPARK-33853][SQL] EXPLAIN CODEGEN and BenchmarkQueryTest don't show (commit: f4e1069) — dhyun / githubweb
  7. [SPARK-33862][SQL] Throw `PartitionAlreadyExistsException` if the target (commit: cdd1752) — dhyun / githubweb
  8. [SPARK-28863][SQL][FOLLOWUP] Make sure optimized plan will not be (commit: b4bea1a) — gurwls223 / githubweb
  9. [SPARK-33845][SQL] Remove unnecessary if when trueValue and falseValue (commit: 4b19f49) — dhyun / githubweb
  10. [SPARK-33124][SQL] Fills missing group tags and re-categorizes all the (commit: 69aa727) — dhyun / githubweb
  11. [SPARK-33838][SQL][DOCS] Comment the `PURGE` option in the DropTable and (commit: 661ac10) — wenchen / githubweb
  12. [SPARK-33848][SQL] Push the UnaryExpression into (if / case) branches (commit: 1c77605) — dhyun / githubweb
  13. [SPARK-33869][PYTHON][SQL][TESTS] Have a separate metastore directory (commit: 38bbcca) — dhyun / githubweb
  14. [SPARK-33836][SS][PYTHON][FOLLOW-UP] Use test utils and clean up (commit: 4106731) — kabhwan.opensource / githubweb
  15. [MINOR] update dstream.py with more accurate exceptions (commit: 0bf3828) — dhyun / githubweb
  16. [SPARK-33873][CORE][TESTS] Test all compression codecs with encrypted (commit: f62e957) — dhyun / githubweb
  17. [SPARK-32106][SQL] Implement script transform in sql/core (commit: 7466031) — yamamuro / githubweb
  18. [SPARK-33834][SQL] Verify ALTER TABLE CHANGE COLUMN with Char and (commit: f5fd10b) — wenchen / githubweb
  19. [MINOR][CORE] Remove unused variable (commit: 16ae3a5) — dhyun / githubweb
  20. [SPARK-33700][SQL] Avoid file meta reading when enableFilterPushDown is (commit: b887455) — dhyun / githubweb
  21. [SPARK-33860][SQL] Make CatalystTypeConverters.convertToCatalyst match (commit: 1dd63dc) — gurwls223 / githubweb
  22. [SPARK-33808][SQL] DataSource V2: Build logical writes in the optimizer (commit: 2562183) — wenchen / githubweb
  23. [SPARK-33784][SQL] Rename dataSourceRewriteRules batch (commit: 7bbcbb8) — wenchen / githubweb
  24. [SPARK-33846][SQL] Include Comments for a nested schema in (commit: 43a5620) — gurwls223 / githubweb
  25. [SPARK-33878][SQL][TESTS] Fix resolving of `spark_catalog` in v1 Hive (commit: 84bf07b) — wenchen / githubweb
  26. [SPARK-33876][SQL] Add length-check for reading char/varchar from tables (commit: 6da5cdf) — wenchen / githubweb
  27. [BUILD][MINOR] Do not publish snapshots from forks (commit: 1d45025) — gurwls223 / githubweb
  28. [SPARK-23862][SQL] Support Java enums from Scala Dataset API (commit: 303b8c8) — dhyun / githubweb
  29. [SPARK-33364][SQL][FOLLOWUP] Refine the catalog v2 API to purge a table (commit: ec1560a) — gurwls223 / githubweb
  30. [SPARK-33877][SQL] SQL reference documents for INSERT w/ a column list (commit: a3dd8da) — dhyun / githubweb
  31. [SPARK-32106][SQL][FOLLOWUP] Fix flaky tests in transform.sql (commit: ea37717) — gurwls223 / githubweb

#714 (Dec 20, 2020 2:34:37 PM)

  1. [SPARK-33599][SQL][FOLLOWUP] FIX Github Action with unidoc (commit: c17c76d) — dongjoon / githubweb
  2. [SPARK-33841][CORE] Fix issue with jobs disappearing intermittently from (commit: 554600c) — dongjoon / githubweb
  3. [SPARK-33812][SQL] Split the histogram column stats when saving to hive (commit: de234ee) — gurwls223 / githubweb
  4. [SPARK-33518][ML] Improve performance of ML ALS recommendForAll by GEMV (commit: 44563a0) — srowen / githubweb
  5. [SPARK-33843][BUILD] Upgrade to Zstd 1.4.8 (commit: 00642ee) — dongjoon / githubweb
  6. [SPARK-32976][SQL][FOLLOWUP] SET and RESTORE (commit: dd44ba5) — dongjoon / githubweb
  7. [SPARK-33829][SQL] Renaming v2 tables should recreate the cache (commit: 06075d8) — dongjoon / githubweb
  8. [MINOR][DOCS] Fix typos in ScalaDocs for DataStreamWriter#foreachBatch (commit: 37c4cd8) — srowen / githubweb
  9. [SPARK-33850][SQL] EXPLAIN FORMATTED doesn't show the plan for (commit: 70da86a) — dongjoon / githubweb
  10. [SPARK-33854][BUILD] Use ListBuffer instead of Stack in SparkBuild.scala (commit: 2b6ef56) — dongjoon / githubweb
  11. [SPARK-33852][SQL][TESTS] Use assertAnalysisError in HiveDDLSuite.scala (commit: df2314b) — dongjoon / githubweb
  12. [SPARK-33756][SQL] Make BytesToBytesMap's MapIterator idempotent (commit: 1339168) — srowen / githubweb

#713 (Dec 18, 2020 6:36:06 AM)

  1. [SPARK-33765][SQL] Migrate UNCACHE TABLE to use UnresolvedRelation to (commit: 62be248) — wenchen / githubweb
  2. [SPARK-33786][SQL] The storage level for a cache should be respected (commit: ef7f690) — wenchen / githubweb
  3. [MINOR][DOCS] Fix Jenkins job badge image and link in README.md (commit: 12f3715) — dongjoon / githubweb
  4. [SPARK-33802][INFRA] Override name and email address explicitly when (commit: 888a274) — gurwls223 / githubweb
  5. [SPARK-33803][SQL] Sort table properties by key in DESCRIBE TABLE (commit: 7845865) — wenchen / githubweb
  6. [SPARK-33789][SQL][TESTS] Refactor unified V1 and V2 datasource tests (commit: 9d9d4a8) — wenchen / githubweb
  7. [SPARK-32991][SQL] [FOLLOWUP] Reset command relies on session initials (commit: 205d8e4) — wenchen / githubweb
  8. [SPARK-33802][INFRA][FOLLOW-UP] Separate arguments properly for -c (commit: ddda32b) — gurwls223 / githubweb
  9. [SPARK-33800][SQL] Remove command name in AnalysisException message when (commit: 8666d1c) — wenchen / githubweb
  10. [SPARK-33810][TESTS] Reenable test cases disabled in SPARK-31732 (commit: 3d03234) — dongjoon / githubweb
  11. [SPARK-33806][SQL] limit partition num to 1 when distributing by (commit: 728a129) — dongjoon / githubweb
  12. [SPARK-33514][SQL][FOLLOW-UP] Remove unused TruncateTableStatement case (commit: e7e29fd) — dongjoon / githubweb
  13. [SPARK-33775][BUILD] Suppress sbt compilation warnings in Scala 2.13 (commit: 477046c) — dongjoon / githubweb
  14. [SPARK-33790][CORE] Reduce the rpc call of getFileStatus in (commit: 0c12900) — kabhwan.opensource / githubweb
  15. [SPARK-33815][SQL] Migrate ALTER TABLE ... SET [SERDE|SERDEPROPERTIES] (commit: 0c19497) — wenchen / githubweb
  16. [SPARK-33697][SQL] RemoveRedundantProjects should require column (commit: 1e85707) — wenchen / githubweb
  17. [SPARK-33821][BUILD] Upgrade SBT to 1.4.5 (commit: b1950cc) — gurwls223 / githubweb
  18. [SPARK-33819][CORE] (commit: ed09673) — gurwls223 / githubweb
  19. [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in (commit: 12b69cc) — gurwls223 / githubweb
  20. [SPARK-33774][UI][CORE] Back to Master" returns 500 error in Standalone (commit: 34e4d87) — srowen / githubweb
  21. [SPARK-22769] Do not log rpc post message error when sparkEnv is already (commit: 8c81cf7) — srowen / githubweb
  22. [SPARK-33173][CORE][TESTS][FOLLOWUP] Use `local[2]` and AtomicInteger (commit: 15616f4) — dongjoon / githubweb
  23. [SPARK-33822][SQL] Use the `CastSupport.cast` method in HashJoin (commit: 51ef443) — dongjoon / githubweb
  24. [SPARK-33824][PYTHON][DOCS] Restructure and improve Python package (commit: 6315118) — gurwls223 / githubweb
  25. [SPARK-33797][SS][DOCS] Update SS doc about State Store and task (commit: 42e1831) — kabhwan.opensource / githubweb
  26. [SPARK-33831][UI] Update to jetty 9.4.34 (commit: 131a23d) — dongjoon / githubweb
  27. [SPARK-33817][SQL] CACHE TABLE uses a logical plan when caching a query (commit: 0f1a183) — wenchen / githubweb
  28. [SPARK-26341][WEBUI] Expose executor memory metrics at the stage level, (commit: 25c6cc2) — sarutak / githubweb
  29. [MINOR][INFRA] Add -Pspark-ganglia-lgpl to the build definition with (commit: b0da2bc) — gurwls223 / githubweb
  30. [SPARK-33593][SQL] Vector reader got incorrect data with binary (commit: 0603913) — dongjoon / githubweb
  31. [SPARK-33840][DOCS] Add spark.sql.files.minPartitionNum to performence (commit: bc46d27) — gurwls223 / githubweb
  32. [SPARK-33798][SQL] Add new rule to push down the foldable expressions (commit: 06b1bbb) — wenchen / githubweb
  33. [SPARK-33597][SQL] Support REGEXP_LIKE for consistent with mainstream (commit: f239128) — wenchen / githubweb
  34. [SPARK-33599][SQL] Group exception messages in catalyst/analysis (commit: 6dca2e5) — wenchen / githubweb

#712 (Dec 15, 2020 9:12:46 PM)

  1. [SPARK-33762][BUILD] Upgrade commons-codec to 1.15 (commit: 99848e5) — dongjoon / githubweb
  2. [SPARK-33766][BUILD] Upgrade Jackson to 2.11.4 (commit: 01b73ae) — dongjoon / githubweb
  3. [SPARK-33589][SQL][FOLLOWUP] Replace Throwable with NonFatal (commit: 94bc2d6) — dongjoon / githubweb
  4. [SPARK-33764][SS] Make state store maintenance interval as SQL config (commit: 45af3c9) — dongjoon / githubweb
  5. [SPARK-33690][SQL] Escape meta-characters in showString (commit: 8197ee3) — dongjoon / githubweb
  6. [SPARK-33723][SQL] ANSI mode: Casting String to Date should throw (commit: 6e86279) — gurwls223 / githubweb
  7. [SPARK-33757][INFRA][R][FOLLOWUP] Provide more simple solution (commit: b135db3) — dongjoon / githubweb
  8. [SPARK-33705][SQL][TEST] Fix HiveThriftHttpServerSuite flakiness (commit: 4d47ac4) — wenchen / githubweb
  9. [SPARK-33770][SQL][TESTS] Fix the `ALTER TABLE .. DROP PARTITION` tests (commit: 9160d59) — gurwls223 / githubweb
  10. [SPARK-33768][SQL] Remove `retainData` from `AlterTableDropPartition` (commit: 817f58d) — wenchen / githubweb
  11. [SPARK-33546][SQL] Enable row format file format validation in CREATE (commit: e7fe92f) — wenchen / githubweb
  12. [SPARK-33142][SPARK-33647][SQL][FOLLOW-UP] Add docs and test cases (commit: b7c8210) — wenchen / githubweb
  13. [SPARK-33751][SQL] Migrate ALTER VIEW ... AS command to use (commit: a84c8d8) — wenchen / githubweb
  14. [SPARK-33673][SQL] Avoid push down partition filters to ParquetScan for (commit: cd0356d) — yumwang / githubweb
  15. [SPARK-33716][K8S] Fix potential race condition during pod termination (commit: bf2c88c) — dongjoon / githubweb
  16. [SPARK-33428][SQL] Conv UDF use BigInt to avoid  Long value overflow (commit: 5f9a7fe) — wenchen / githubweb
  17. [SPARK-33733][SQL] PullOutNondeterministic should check and collect (commit: 839d689) — wenchen / githubweb
  18. [SPARK-33779][SQL] DataSource V2: API to request distribution and (commit: 82aca7e) — blue / githubweb
  19. [SPARK-33779][SQL][FOLLOW-UP] Fix Java Linter error (commit: bb60fb1) — dongjoon / githubweb
  20. [SPARK-33261][K8S] Add a developer API for custom feature steps (commit: 5885cc1) — hkarau / githubweb
  21. [SPARK-33771][SQL][TESTS] Fix Invalid value for HourOfAmPm when testing (commit: 412d86e) — dongjoon / githubweb
  22. [SPARK-33777][SQL] Sort output of V2 SHOW PARTITIONS (commit: f156718) — dongjoon / githubweb
  23. [SPARK-33653][SQL] DSv2: REFRESH TABLE should recache the table itself (commit: 49d3256) — dongjoon / githubweb
  24. [SPARK-33748][K8S] Respect environment variables and configurations for (commit: a99a47c) — gurwls223 / githubweb
  25. [SPARK-33785][SQL] Migrate ALTER TABLE ... RECOVER PARTITIONS to use (commit: 366beda) — wenchen / githubweb
  26. [SPARK-33767][SQL][TESTS] Unify v1 and v2 ALTER TABLE .. DROP PARTITION (commit: 141e26d) — wenchen / githubweb
  27. [SPARK-33273][SQL] Fix a race condition in subquery execution (commit: 0304252) — gurwls223 / githubweb
  28. [SPARK-33769][SQL] Improve the next-day function of the sql component to (commit: 20f6d63) — gurwls223 / githubweb
  29. [SPARK-33752][SQL] Avoid the getSimpleMessage of AnalysisException adds (commit: 58cb2ba) — gurwls223 / githubweb
  30. [SPARK-33758][SQL] Prune unrequired partitionings from (commit: 23083aa) — wenchen / githubweb
  31. [SPARK-33617][SQL][FOLLOWUP] refine the default parallelism SQL config (commit: 40c37d6) — wenchen / githubweb
  32. [SPARK-33735][SQL] Handle UPDATE in ReplaceNullWithFalseInPredicate (commit: 4d56d43) — dongjoon / githubweb
  33. [SPARK-22256][MESOS] Introduce spark.mesos.driver.memoryOverhead (commit: 87c5836) — dongjoon / githubweb
  34. [SPARK-33788][SQL] Throw NoSuchPartitionsException from (commit: 3dfdcf4) — gurwls223 / githubweb
  35. [SPARK-33796][DOCS] Show hidden text from the left menu of Spark Doc (commit: dd042f5) — gurwls223 / githubweb
  36. [SPARK-33793][TESTS] Introduce withExecutor to ensure proper cleanup in (commit: ddff94f) — gurwls223 / githubweb

#711 (Dec 13, 2020 12:58:10 PM)

  1. [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to (commit: 8f5db71) — wenchen / githubweb
  2. [SPARK-33706][SQL] Require fully specified partition identifier in (commit: 8b97b19) — wenchen / githubweb
  3. [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task (commit: 5bab27e) — gurwls223 / githubweb
  4. [MINOR][INFRA] Add kubernetes-integration-tests to GitHub Actions for (commit: 29cc5b3) — gurwls223 / githubweb
  5. [SPARK-33757][INFRA][R] Fix the R dependencies build error on GitHub (commit: fb2e3af) — gurwls223 / githubweb
  6. [SPARK-33729][SQL] When refreshing cache, Spark should not use cached (commit: be09d37) — dongjoon / githubweb
  7. [SPARK-32447][CORE][PYTHON][FOLLOW-UP] Fix other occurrences of 'python' (commit: e2cdfce) — gurwls223 / githubweb
  8. [MINOR][UI] Correct JobPage's skipped/pending tableHeaderId (commit: 0277fdd) — sarutak / githubweb

#710 (Dec 11, 2020 3:06:45 AM)

  1. [SPARK-33740][SQL] hadoop configs in hive-site.xml can overrides (commit: 31e0bac) — dongjoon / githubweb
  2. [SPARK-33742][SQL] Throw PartitionsAlreadyExistException from (commit: fab2995) — dongjoon / githubweb
  3. [SPARK-33295][BUILD] Upgrade ORC to 1.6.6 (commit: 1ba1732) — dongjoon / githubweb
  4. [SPARK-33749][BUILD][PYTHON] Exclude target directory in pycodestyle and (commit: cd7a306) — gurwls223 / githubweb
  5. [SPARK-32910][SS] Remove UninterruptibleThread usage from (commit: 7895ea1) — kabhwan.opensource / githubweb
  6. [SPARK-33527][SQL] Extend the function of decode so as consistent with (commit: 24d7e45) — wenchen / githubweb
  7. [SPARK-33750][SQL][TESTS] Use `hadoop-3.2` distribution in (commit: 8ac86a4) — dongjoon / githubweb
  8. [MINOR][SQL] Spelling: enabled - legacy_setops_precedence_enbled (commit: c05f6f9) — wenchen / githubweb
  9. [SPARK-33754][K8S][DOCS] Update kubernetes/integration-tests/README.md (commit: d662b95) — dongjoon / githubweb
  10. [SPARK-33527][SQL][FOLLOWUP] Fix the scala 2.13 build failure (commit: 8377aca) — dongjoon / githubweb

#708 (Dec 10, 2020 3:04:44 PM)

  1. [SPARK-33641][SQL][DOC][FOLLOW-UP] Add migration guide for CHAR VARCHAR (commit: c88edda) — wenchen / githubweb
  2. [SPARK-33669] Wrong error message from YARN application state monitor (commit: 48f93af) — mridulatgmail.com / githubweb
  3. [SPARK-33655][SQL] Improve performance of processing FETCH_PRIOR (commit: a713a7e) — gurwls223 / githubweb
  4. [SPARK-33719][DOC] Add make_date/make_timestamp/make_interval into the (commit: 9959d49) — gurwls223 / githubweb
  5. [SPARK-33071][SPARK-33536][SQL][FOLLOW-UP] Rename deniedMetadataKeys to (commit: b5399d4) — gurwls223 / githubweb
  6. [SPARK-33722][SQL] Handle DELETE in ReplaceNullWithFalseInPredicate (commit: fa9ce1d) — dongjoon / githubweb
  7. [SPARK-33725][BUILD] Upgrade snappy-java to 1.1.8.2 (commit: 667f64f) — dongjoon / githubweb
  8. [SPARK-33727][K8S] Fall back from gnupg.net to openpgp.org (commit: 991b797) — gurwls223 / githubweb
  9. [SPARK-33724][K8S] Add decom script as a configuration param (commit: 1c7f5f1) — dongjoon / githubweb
  10. [SPARK-33558][SQL][TESTS] Unify v1 and v2 ALTER TABLE .. ADD PARTITION (commit: af37c7f) — wenchen / githubweb
  11. [SPARK-33714][SQL] Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES (commit: b112e2b) — wenchen / githubweb
  12. [SPARK-33732][K8S][TESTS] Kubernetes integration tests doesn't work with (commit: 795db05) — dongjoon / githubweb
  13. [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst (commit: cef28c2) — wenchen / githubweb
  14. [SPARK-33692][SQL] View should use captured catalog and namespace to (commit: 1554977) — wenchen / githubweb

#707 (Dec 8, 2020 10:00:33 PM)

  1. [MINOR][ML] Increase Bounded MLOR (without regularization) test error (commit: f021f6d) — weichen.xu / githubweb
  2. [SPARK-33703][SQL] Migrate MSCK REPAIR TABLE to use UnresolvedTable to (commit: 29fed23) — wenchen / githubweb

#706 (Dec 8, 2020 2:15:13 PM)

  1. [SPARK-33684][BUILD] Upgrade httpclient from 4.5.6 to 4.5.13 (commit: d48ef34) — dongjoon / githubweb
  2. [SPARK-33671][SQL] Remove VIEW checks from V1 table commands (commit: 87c0560) — dongjoon / githubweb
  3. [SPARK-33676][SQL] Require exact matching of partition spec to the (commit: 26c0493) — wenchen / githubweb
  4. [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL (commit: 1e0c006) — gurwls223 / githubweb
  5. [SPARK-32680][SQL] Don't Preprocess V2 CTAS with Unresolved Query (commit: d730b6b) — wenchen / githubweb
  6. [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that (commit: da72b87) — wenchen / githubweb
  7. [MINOR] Spelling sql not core (commit: c62b84a) — srowen / githubweb
  8. [SPARK-33693][SQL] deprecate spark.sql.hive.convertCTAS (commit: 6aff215) — dongjoon / githubweb
  9. [SPARK-33480][SQL][FOLLOWUP] do not expose user data in error message (commit: c0874ba) — dongjoon / githubweb
  10. [SPARK-33621][SQL] Add a way to inject data source rewrite rules (commit: 02508b6) — dongjoon / githubweb
  11. [SPARK-32320][PYSPARK] Remove mutable default arguments (commit: e4d1c10) — ruifengz / githubweb
  12. [SPARK-33680][SQL][TESTS][FOLLOWUP] Fix more test suites to have (commit: b2a7930) — dongjoon / githubweb
  13. [SPARK-33609][ML] word2vec reduce broadcast size (commit: ebd8b93) — ruifengz / githubweb
  14. [SPARK-33698][BUILD][TESTS] Fix the build error of (commit: 8bcebfa) — dongjoon / githubweb
  15. [SPARK-33664][SQL] Migrate ALTER TABLE ... RENAME TO to use (commit: 5aefc49) — wenchen / githubweb
  16. [MINOR][INFRA] Add -Pdocker-integration-tests to GitHub Action Scala (commit: 3a6546d) — sarutak / githubweb
  17. [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default (commit: 031c5ef) — dongjoon / githubweb
  18. [SPARK-33677][SQL] Skip LikeSimplification rule if pattern contains any (commit: 99613cd) — yamamuro / githubweb
  19. [SPARK-33688][SQL] Migrate SHOW TABLE EXTENDED to new resolution (commit: 2b30dde) — wenchen / githubweb
  20. [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to (commit: c05ee06) — wenchen / githubweb
  21. [MINOR] Spelling sql/core (commit: a093d6f) — srowen / githubweb
  22. [SPARK-33675][INFRA][FOLLOWUP] Schedule branch-3.1 snapshot at master (commit: c001dd4) — dongjoon / githubweb
  23. [SPARK-32110][SQL] normalize special floating numbers in HyperLogLog++ (commit: 6fd2345) — dongjoon / githubweb
  24. [SPARK-33695][BUILD] Upgrade to jackson to 2.10.5 and jackson-databind (commit: 3ac70f1) — dongjoon / githubweb

#705 (Dec 6, 2020 7:52:00 PM)

  1. [MINOR] Fix string interpolation in CommandUtils.scala and (commit: 154f604) — gurwls223 / githubweb
  2. [SPARK-33668][K8S][TEST] Fix flaky test "Verify logging configuration is (commit: 6317ba2) — dongjoon / githubweb
  3. [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache (commit: e857e06) — dongjoon / githubweb
  4. [SPARK-33256][PYTHON][DOCS] Clarify PySpark follows NumPy documentation (commit: 5250841) — dongjoon / githubweb
  5. [SPARK-33667][SQL] Respect the `spark.sql.caseSensitive` config while (commit: 4829781) — dongjoon / githubweb
  6. [SPARK-33674][TEST] Show Slowpoke notifications in SBT tests (commit: b94ecf0) — yumwang / githubweb
  7. [SPARK-33663][SQL] Uncaching should not be called on non-existing temp (commit: 119539f) — gurwls223 / githubweb
  8. [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot (commit: e32de29) — gurwls223 / githubweb
  9. [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW (commit: 29096a8) — gurwls223 / githubweb
  10. [SPARK-33683][INFRA] Remove -Djava.version=11 from Scala 2.13 build in (commit: e88f0d4) — dongjoon / githubweb
  11. [SPARK-33680][SQL][TESTS] Fix (commit: 73412ff) — dongjoon / githubweb

#704 (Dec 4, 2020 6:29:42 PM)

  1. [MINOR][INFRA] Use the latest image for GitHub Action jobs (commit: f94cb53) — gurwls223 / githubweb
  2. [SPARK-31953][SS] Add Spark Structured Streaming History Server Support (commit: 4f96670) — zsxwing / githubweb
  3. [SPARK-33610][ML] Imputer transform skip duplicate head() job (commit: 90d4d7d) — ruifengz / githubweb
  4. [SPARK-32896][SS][FOLLOW-UP] Rename the API to `toTable` (commit: 878cc0e) — zsxwing / githubweb
  5. [SPARK-22798][PYTHON][ML][FOLLOWUP] Add labelsArray to PySpark (commit: 0880989) — gurwls223 / githubweb
  6. [SPARK-33636][PYTHON][ML][FOLLOWUP] Update since tag of labelsArray in (commit: 3b2ff16) — gurwls223 / githubweb
  7. [SPARK-20044][SQL] Add new function DATE_FROM_UNIX_DATE and UNIX_DATE (commit: ff13f57) — wenchen / githubweb
  8. [SPARK-26218][SQL][FOLLOW UP] Fix the corner case of codegen when (commit: 512fb32) — wenchen / githubweb
  9. [SPARK-30098][SQL] Add a configuration to use default datasource as (commit: 0706e64) — wenchen / githubweb
  10. [SPARK-33629][PYTHON] Make spark.buffer.size configuration visible on (commit: bd71186) — gurwls223 / githubweb
  11. [SPARK-33623][SQL] Add canDeleteWhere to SupportsDelete (commit: aa13e20) — dongjoon / githubweb
  12. [SPARK-33634][SQL][TESTS] Use Analyzer in PlanResolutionSuite (commit: 63f9d47) — dongjoon / githubweb
  13. [SPARK-33520][ML][PYSPARK] make (commit: 7e759b2) — weichen.xu / githubweb
  14. [SPARK-33650][SQL] Fix the error from ALTER TABLE .. ADD/DROP PARTITION (commit: 8594958) — dongjoon / githubweb
  15. [SPARK-33649][SQL][DOC] Improve the doc of spark.sql.ansi.enabled (commit: 29e415d) — gengliang.wang / githubweb
  16. [SPARK-32405][SQL][FOLLOWUP] Remove USING _ in CREATE TABLE in (commit: e22ddb6) — wenchen / githubweb
  17. [SPARK-33142][SPARK-33647][SQL] Store SQL text for SQL temp view (commit: e02324f) — wenchen / githubweb
  18. [SPARK-33430][SQL] Support namespaces in JDBC v2 Table Catalog (commit: 15579ba) — wenchen / githubweb
  19. [SPARK-33658][SQL] Suggest using Datetime conversion functions for (commit: e838066) — gurwls223 / githubweb
  20. [SPARK-33571][SQL][DOCS] Add a ref to INT96 config from the doc for (commit: 94c144b) — gurwls223 / githubweb
  21. [SPARK-33577][SS] Add support for V1Table in stream writer table API and (commit: 325abf7) — kabhwan.opensource / githubweb
  22. [SPARK-33656][TESTS] Add option to keep container after tests finish for (commit: 91baab7) — dongjoon / githubweb
  23. [SPARK-33640][TESTS] Extend connection timeout to DB server for (commit: 976e897) — dongjoon / githubweb
  24. [SPARK-27237][SS] Introduce State schema validation among query restart (commit: 233a849) — gurwls223 / githubweb
  25. [SPARK-33615][K8S] Make 'spark.archives' working in Kubernates (commit: 990bee9) — gurwls223 / githubweb
  26. [SPARK-33141][SQL][FOLLOW-UP] Store the max nested view depth in (commit: acc211d) — wenchen / githubweb
  27. [SPARK-33660][DOCS][SS] Fix Kafka Headers Documentation (commit: d671e05) — kabhwan.opensource / githubweb
  28. [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT (commit: de9818f) — dongjoon / githubweb
  29. [SPARK-33141][SQL][FOLLOW-UP] Fix Scala 2.13 compilation (commit: b6b45bc) — dongjoon / githubweb
  30. [SPARK-33472][SQL][FOLLOW-UP] Update RemoveRedundantSorts comment (commit: 960d6af) — dongjoon / githubweb
  31. [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data (commit: 1b4e35d) — dongjoon / githubweb

#703 (Dec 2, 2020 4:18:21 PM)

  1. [SPARK-33517][SQL][DOCS] Fix the correct menu items and page links in (commit: 3d54774) — gurwls223 / githubweb
  2. [SPARK-33589][SQL] Close opened session if the initialization fails (commit: f93d439) — gurwls223 / githubweb
  3. [SPARK-33582][SQL] Hive Metastore support filter by not-equals (commit: a5e13ac) — gurwls223 / githubweb
  4. [SPARK-33567][SQL] DSv2: Use callback instead of passing Spark session (commit: feda729) — wenchen / githubweb
  5. [MINOR] Spelling bin core docs external mllib repl (commit: 4851453) — yamamuro / githubweb
  6. [SPARK-32976][SQL] Support column list in INSERT statement (commit: 2da7259) — wenchen / githubweb
  7. [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables (commit: 0fd9f57) — wenchen / githubweb
  8. [SPARK-33498][SQL][FOLLOW-UP] Deduplicate the unittest by using (commit: 225c2e2) — gurwls223 / githubweb
  9. [SPARK-28646][SQL] Fix bug of Count so as consistent with mainstream (commit: b665d58) — gurwls223 / githubweb
  10. [SPARK-33480][SQL] Support char/varchar type (commit: 5cfbddd) — wenchen / githubweb
  11. [SPARK-33579][UI] Fix executor blank page behind proxy (commit: 6e5446e) — sarutak / githubweb
  12. [SPARK-33452][SQL] Support v2 SHOW PARTITIONS (commit: 0a612b6) — wenchen / githubweb
  13. [SPARK-33569][SQL] Remove getting partitions by an identifier prefix (commit: 6fd148f) — wenchen / githubweb
  14. [SPARK-33569][SPARK-33452][SQL][FOLLOWUP] Fix a build error in (commit: 030b313) — wenchen / githubweb
  15. [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to (commit: f3c2583) — mridulatgmail.com / githubweb
  16. [SPARK-33545][CORE] Support Fallback Storage during Worker decommission (commit: c699435) — dongjoon / githubweb
  17. [SPARK-33440][CORE] Use current timestamp with warning log in (commit: f5d2165) — kabhwan.opensource / githubweb
  18. [SPARK-33556][ML] Add array_to_vector function for dataframe column (commit: 596fbc1) — gurwls223 / githubweb
  19. [SPARK-33613][PYTHON][TESTS] Replace deprecated APIs in pyspark tests (commit: aeb3649) — gurwls223 / githubweb
  20. [SPARK-33592] Fix: Pyspark ML Validator params in estimatorParamMaps may (commit: 8016123) — ruifengz / githubweb
  21. [SPARK-33607][SS][WEBUI] Input Rate timeline/histogram aren't rendered (commit: c50fcac) — kabhwan.opensource / githubweb
  22. [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log (commit: 2af2da5) — kabhwan.opensource / githubweb
  23. [SPARK-33530][CORE] Support --archives and spark.archives option (commit: 1a042cc) — gurwls223 / githubweb
  24. [SPARK-27188][SS] FileStreamSink: provide a new option to have retention (commit: 52e5cc4) — kabhwan.opensource / githubweb
  25. [SPARK-33572][SQL] Datetime building should fail if the year, month, (commit: 1034815) — wenchen / githubweb
  26. [SPARK-32032][SS] Avoid infinite wait in driver because of (commit: e5bb293) — kabhwan.opensource / githubweb
  27. [SPARK-32405][SQL][FOLLOWUP] Throw Exception if provider is specified in (commit: d38883c) — wenchen / githubweb
  28. [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix (commit: 9273d42) — wenchen / githubweb
  29. [SPARK-33503][SQL] Refactor SortOrder class to allow multiple childrens (commit: cf4ad21) — yamamuro / githubweb
  30. [SPARK-33608][SQL] Handle DELETE/UPDATE/MERGE in (commit: 478fb7f) — wenchen / githubweb
  31. [SPARK-33612][SQL] Add dataSourceRewriteRules batch to Optimizer (commit: c24f2b2) — dongjoon / githubweb
  32. [SPARK-33611][UI] Avoid encoding twice on the query parameter of (commit: 5d0045e) — gengliang.wang / githubweb
  33. [SPARK-33622][R][ML] Add array_to_vector to SparkR (commit: 5a1c5ac) — dongjoon / githubweb
  34. [SPARK-33544][SQL] Optimize size of CreateArray/CreateMap to be the size (commit: f71f345) — gurwls223 / githubweb
  35. [SPARK-32863][SS] Full outer stream-stream join (commit: 51ebcd9) — kabhwan.opensource / githubweb
  36. [MINOR][SS] Rename auxiliary protected methods in StreamingJoinSuite (commit: a4788ee) — kabhwan.opensource / githubweb
  37. [SPARK-33618][CORE] Use hadoop-client instead of hadoop-client-api to (commit: 290aa02) — gurwls223 / githubweb
  38. [SPARK-33557][CORE][MESOS][TEST] Ensure the relationship between (commit: 084d38b) — gurwls223 / githubweb
  39. [SPARK-33504][CORE] The application log in the Spark history server (commit: 28dad1b) — tgraves / githubweb
  40. [SPARK-33544][SQL][FOLLOW-UP] Rename NoSideEffect to NoThrow and clarify (commit: df8d3f1) — wenchen / githubweb
  41. [SPARK-33619][SQL] Fix GetMapValueUtil code generation error (commit: 58583f7) — wenchen / githubweb
  42. [SPARK-33626][K8S][TEST] Allow k8s integration tests to assert both (commit: 91182d6) — dongjoon / githubweb
  43. [SPARK-33071][SPARK-33536][SQL] Avoid changing dataset_id of LogicalPlan (commit: a082f46) — wenchen / githubweb
  44. [SPARK-33627][SQL] Add new function UNIX_SECONDS, UNIX_MILLIS and (commit: b76c6b7) — dongjoon / githubweb
  45. [SPARK-33631][DOCS][TEST] Clean up (commit: 92bfbcb) — dongjoon / githubweb

#701 (Nov 29, 2020 2:18:06 PM)

  1. Spelling r common dev mlib external project streaming resource managers (commit: 13fd272) — srowen / githubweb
  2. [SPARK-33570][SQL][TESTS] Set the proper version of gssapi plugin (commit: cf98a76) — yamamuro / githubweb
  3. [SPARK-33580][CORE] resolveDependencyPaths should use classifier (commit: 3650a6b) — dongjoon / githubweb
  4. [MINOR][SQL] Remove `getTables()` from `r.SQLUtils` (commit: bfe9380) — dongjoon / githubweb
  5. [SPARK-33581][SQL][TEST] Refactor HivePartitionFilteringSuite (commit: ba178f8) — yumwang / githubweb
  6. [SPARK-33590][DOCS][SQL] Add missing sub-bullets in Spark SQL Guide (commit: b94ff1e) — dongjoon / githubweb
  7. [SPARK-33587][CORE] Kill the executor on nested fatal errors (commit: c8286ec) — dongjoon / githubweb
  8. [SPARK-33588][SQL] Respect the `spark.sql.caseSensitive` config while (commit: 0054fc9) — dongjoon / githubweb
  9. [SPARK-33585][SQL][DOCS] Fix the comment for `SQLContext.tables()` and (commit: a088a80) — dongjoon / githubweb

#700 (Nov 27, 2020 5:33:24 AM)

  1. [SPARK-33563][PYTHON][R][SQL] Expose inverse hyperbolic trig functions (commit: d082ad0) — gurwls223 / githubweb
  2. [SPARK-33566][CORE][SQL][SS][PYTHON] Make unescapedQuoteHandling option (commit: 433ae90) — gurwls223 / githubweb
  3. [SPARK-33575][SQL] Fix misleading exception for "ANALYZE TABLE ... FOR (commit: 8792280) — wenchen / githubweb
  4. [SPARK-33522][SQL] Improve exception messages while handling (commit: 2c41d9d) — wenchen / githubweb
  5. [SPARK-28645][SQL] ParseException is thrown when the window is redefined (commit: e432550) — wenchen / githubweb
  6. [SPARK-33498][SQL] Datetime parsing should fail if the input string (commit: b9f2f78) — wenchen / githubweb
  7. [SPARK-33141][SQL] Capture SQL configs when creating permanent views (commit: 35ded12) — wenchen / githubweb

#699 (Nov 26, 2020 1:07:21 PM)

  1. [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2 (commit: 1de3fc4) — dongjoon / githubweb
  2. [SPARK-33565][BUILD][PYTHON] remove python3.8 and fix breakage (commit: c529426) — incomplete / githubweb
  3. [SPARK-33523][SQL][TEST][FOLLOWUP] Fix benchmark case name in (commit: fb7b870) — dongjoon / githubweb
  4. [SPARK-33562][UI] Improve the style of the checkbox in executor page (commit: 919ea45) — gurwls223 / githubweb
  5. [SPARK-33565][INFRA][FOLLOW-UP] Keep the test coverage with Python 3.8 (commit: ed9e6fc) — gurwls223 / githubweb
  6. [SPARK-33551][SQL] Do not use custom shuffle reader for repartition (commit: dfa3978) — gatorsmile / githubweb

#698 (Nov 25, 2020 10:23:05 AM)

  1. [SPARK-33509][SQL] List partition by names from a V2 table which (commit: 2c5cc36) — wenchen / githubweb
  2. [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic (commit: 7c59aee) — wenchen / githubweb
  3. [SPARK-31257][SPARK-33561][SQL] Unify create table syntax (commit: 6f68ccf) — wenchen / githubweb
  4. [SPARK-33496][SQL] Improve error message of ANSI explicit cast (commit: d691d85) — gengliang.wang / githubweb
  5. [SPARK-33540][SQL] Subexpression elimination for interpreted predicate (commit: 9643eab) — dongjoon / githubweb
  6. [SPARK-31257][SPARK-33561][SQL][FOLLOWUP] Fix Scala 2.13 compilation (commit: 7cf6a6f) — dongjoon / githubweb

#697 (Nov 25, 2020 1:02:26 AM)

  1. [SPARK-33477][SQL] Hive Metastore support filter by date type (commit: 781e19c) — gurwls223 / githubweb
  2. [SPARK-33549][SQL] Remove configuration (commit: 19f3b89) — wenchen / githubweb

#696 (Nov 24, 2020 10:01:46 PM)

  1. [SPARK-33224][SS][WEBUI] Add watermark gap information into SS UI page (commit: edab094) — kabhwan.opensource / githubweb
  2. [SPARK-33533][SQL] Fix the regression bug that ConnectionProviders don't (commit: c3ce970) — dongjoon / githubweb

#695 (Nov 24, 2020 8:07:53 PM)

  1. [SPARK-33494][SQL][AQE] Do not use local shuffle reader for repartition (commit: d1b4f06) — wenchen / githubweb
  2. [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use (commit: b7f034d) — wenchen / githubweb

#693 (Nov 24, 2020 5:29:07 PM)

  1. [SPARK-33535][INFRA][TESTS] Export LANG to en_US.UTF-8 in (commit: 048a982) — dongjoon / githubweb
  2. [SPARK-33287][SS][UI] Expose state custom metrics information on SS UI (commit: 95b6dab) — kabhwan.opensource / githubweb
  3. [SPARK-33457][PYTHON] Adjust mypy configuration (commit: 665817b) — gurwls223 / githubweb
  4. [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in (commit: 01321bc) — gurwls223 / githubweb

#692 (Nov 24, 2020 8:47:11 AM)

  1. [SPARK-33278][SQL][FOLLOWUP] Improve OptimizeWindowFunctions to avoid (commit: f83fcb1) — wenchen / githubweb
  2. [SPARK-32918][SHUFFLE] RPC implementation to support control plane (commit: 1bd897c) — mridulatgmail.com / githubweb
  3. [SPARK-33479][DOC][FOLLOWUP] DocSearch: Support filtering search results (commit: 0592181) — yamamuro / githubweb
  4. [SPARK-33513][BUILD] Upgrade to Scala 2.13.4 to improve exhaustivity (commit: 3ce4ab5) — dongjoon / githubweb
  5. [SPARK-33524][SQL][TESTS] Change `InMemoryTable` not to use (commit: 8380e00) — dongjoon / githubweb
  6. [SPARK-33523][SQL][TEST] Add predicate related benchmark to (commit: f35e28f) — gurwls223 / githubweb
  7. [SPARK-33521][SQL] Universal type conversion in resolving V2 partition (commit: a6555ee) — wenchen / githubweb
  8. [SPARK-33514][SQL] Migrate TRUNCATE TABLE command to use UnresolvedTable (commit: fdd6c73) — wenchen / githubweb

#691 (Nov 23, 2020 3:53:03 AM)

  1. [SPARK-33143][PYTHON] Add configurable timeout to python server and (commit: 0bb911d) — gurwls223 / githubweb
  2. [SPARK-33510][BUILD] Update SBT to 1.4.4 (commit: 84e7036) — dongjoon / githubweb
  3. Revert "[SPARK-32481][CORE][SQL] Support truncate table to move data to (commit: c891e02) — gurwls223 / githubweb
  4. [SPARK-33515][SQL] Improve exception messages while handling (commit: 60f3a73) — wenchen / githubweb
  5. [SPARK-33511][SQL] Respect case sensitivity while resolving V2 partition (commit: 23e9920) — wenchen / githubweb

#690 (Nov 22, 2020 9:27:18 PM)

  1. [SPARK-28704][SQL][TEST] Add back Skiped (commit: d7f4b2a) — dongjoon / githubweb
  2. [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when (commit: d338af3) — kabhwan.opensource / githubweb
  3. [SPARK-33469][SQL] Add current_timezone function (commit: 6d625cc) — dongjoon / githubweb
  4. [SPARK-33512][BUILD] Upgrade test libraries (commit: df4a1c2) — dongjoon / githubweb
  5. [MINOR][INFRA] Suppress warning in check-license (commit: a459238) — gurwls223 / githubweb
  6. [SPARK-33427][SQL][FOLLOWUP] Put key and value into IdentityHashMap (commit: aa78c05) — gurwls223 / githubweb

#686 (Nov 21, 2020 3:45:04 PM)

  1. [SPARK-33463][SQL] Keep Job Id during incremental collect in Spark (commit: 517b810) — dongjoon / githubweb

#685 (Nov 21, 2020 2:42:00 AM)

  1. Revert "[SPARK-28704][SQL][TEST] Add back Skiped (commit: cf74901) — dongjoon / githubweb

#684 (Nov 20, 2020 6:55:03 PM)

  1. [SPARK-28704][SQL][TEST] Add back Skiped (commit: 47326ac) — dongjoon / githubweb
  2. [SPARK-33466][ML][PYTHON] Imputer support mode(most_frequent) strategy (commit: 116b7b7) — srowen / githubweb
  3. [MINOR][TESTS][DOCS] Use fully-qualified class name in docker (commit: a1a3d5c) — dongjoon / githubweb
  4. [SPARK-33492][SQL] DSv2: Append/Overwrite/ReplaceTable should invalidate (commit: 2479778) — dongjoon / githubweb
  5. [SPARK-32670][SQL] Group exception messages in Catalyst Analyzer in one (commit: de0f50a) — gurwls223 / githubweb
  6. [SPARK-33223][SS][FOLLOWUP] Clarify the meaning of "number of rows (commit: 67c6ed9) — kabhwan.opensource / githubweb
  7. [SPARK-33505][SQL][TESTS] Fix adding new partitions by INSERT INTO (commit: 530c0a8) — dongjoon / githubweb
  8. [SPARK-32381][CORE][FOLLOWUP][TEST-HADOOP2.7] Don't remove (commit: b623c03) — dongjoon / githubweb

#683 (Nov 20, 2020 8:23:26 AM)

  1. [SPARK-32919][SHUFFLE][TEST-MAVEN][TEST-HADOOP2.7] Driver side changes (commit: 8218b48) — mridulatgmail.com / githubweb
  2. [SPARK-33441][BUILD][FOLLOWUP] Make unused-imports check for SBT (commit: 2289389) — gurwls223 / githubweb
  3. [SPARK-32512][SQL][TESTS][FOLLOWUP] Remove duplicate tests for ALTER (commit: 870d409) — wenchen / githubweb
  4. [SPARK-33422][DOC] Fix the correct display of left menu item (commit: cbc8be2) — gurwls223 / githubweb
  5. [SPARK-33468][SQL] ParseUrl  in ANSI mode should fail if input string is (commit: 3384bda) — wenchen / githubweb

#682 (Nov 20, 2020 3:49:21 AM)

  1. [SPARK-33045][SQL][FOLLOWUP] Fix build failure with Scala 2.13 (commit: 6da8ade) — dongjoon / githubweb
  2. [MINOR] Structured Streaming statistics page indent fix (commit: 883a213) — dongjoon / githubweb
  3. [MINOR][DOCS] Document 'without' value for HADOOP_VERSION in pip (commit: 02d410a) — gurwls223 / githubweb

#681 (Nov 19, 2020 9:45:22 AM)

  1. [SPARK-33354][SQL] New explicit cast syntax rules in ANSI mode (commit: 9a4c790) — yamamuro / githubweb
  2. [SPARK-33304][R][SQL] Add from_avro and to_avro functions to SparkR (commit: 56a8510) — gurwls223 / githubweb
  3. [SPARK-33479][DOC] Make the API Key of DocSearch configurable (commit: 4267ca9) — yamamuro / githubweb
  4. [SPARK-33427][SQL][FOLLOWUP] Prevent test flakyness in (commit: 97d2cee) — viirya / githubweb
  5. [SPARK-33473][SQL] Extend interpreted subexpression elimination to other (commit: e518008) — dongjoon / githubweb
  6. [SPARK-31255][SQL][FOLLOWUP] Add missing license headers (commit: 66a7637) — dongjoon / githubweb
  7. [SPARK-33441][BUILD] Add unused-imports compilation check and remove all (commit: e3058ba) — gurwls223 / githubweb
  8. [SPARK-27421][SQL] Fix filter for int column and value class (commit: 014e1fb) — yumwang / githubweb
  9. [SPARK-33400][SQL] Normalize sameOrderExpressions in SortOrder to avoid (commit: 0b0fb70) — wenchen / githubweb
  10. [SPARK-33483][INFRA][TESTS] Fix rat exclusion patterns and add a LICENSE (commit: d5e7bd0) — dongjoon / githubweb
  11. [SPARK-33183][SQL][FOLLOW-UP] Update rule RemoveRedundantSorts config (commit: ef2638c) — dongjoon / githubweb
  12. [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order (commit: a03c540) — wenchen / githubweb
  13. [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row (commit: 21b1350) — wenchen / githubweb
  14. [SPARK-33045][SQL] Support build-in function like_all and fix (commit: 3695e99) — wenchen / githubweb

#680 (Nov 18, 2020 3:33:00 PM)

  1. [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils (commit: 27cd945) — hkarau / githubweb
  2. [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2 (commit: 1df69f7) — brkyvz / githubweb
  3. [SPARK-33464][INFRA] Add/remove (un)necessary cache and restructure (commit: fbfc0bf) — dongjoon / githubweb

#679 (Nov 18, 2020 11:04:41 AM)

  1. [MINOR][SQL][DOCS] Update schema_of_csv and schema_of_json doc (commit: 7f3d99a) — gurwls223 / githubweb
  2. [SPARK-31069][CORE] Avoid repeat compute `chunksBeingTransferred` cause (commit: dd32f45) — mridulatgmail.com / githubweb
  3. [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow (commit: 8e2a0bd) — gurwls223 / githubweb
  4. [SPARK-33475][BUILD] Bump ANTLR runtime version to 4.8-1 (commit: 74bd046) — gurwls223 / githubweb
  5. [SPARK-32852][SQL][DOC][FOLLOWUP] Revise the documentation of (commit: a180e02) — gengliang.wang / githubweb
  6. [SPARK-32907][ML][PYTHON] Adaptively blockify instances - AFT,LiR,LoR (commit: 689c294) — weichen.xu / githubweb
  7. [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file (commit: 594c7c6) — dongjoon / githubweb
  8. [SPARK-27936][K8S] Support python deps (commit: dcac78e) — dongjoon / githubweb

#677 (Nov 17, 2020 1:46:23 PM)

  1. [SPARK-33471][K8S][BUILD] Upgrade kubernetes-client to 4.12.0 (commit: 5e85499) — dongjoon / githubweb

#675 (Nov 17, 2020 8:48:07 AM)

  1. [SPARK-33416][SQL] Avoid Hive metastore stack overflow when InSet (commit: 09bb9be) — wenchen / githubweb
  2. [SPARK-33427][SQL] Add subexpression elimination for interpreted (commit: 9283484) — wenchen / githubweb
  3. [SPARK-32222][K8S][TESTS] Add K8s IT for conf propagation (commit: 2a8e253) — dongjoon / githubweb

#674 (Nov 17, 2020 3:27:16 AM)

  1. [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (commit: e2c7bfc) — gurwls223 / githubweb

#673 (Nov 16, 2020 7:50:08 PM)

  1. [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler (commit: 9ab0f82) — dongjoon / githubweb
  2. [SPARK-33399][SQL] Normalize output partitioning and sortorder with (commit: f5e3302) — yamamuro / githubweb
  3. [SPARK-33209][SS] Refactor unit test of stream-stream join in (commit: 5af5aa1) — kabhwan.opensource / githubweb

#672 (Nov 16, 2020 10:04:47 AM)

  1. [SPARK-33358][SQL] Return code when command process failed (commit: 1ae6d64) — dongjoon / githubweb
  2. [SPARK-33254][PYTHON][DOCS] Migration to NumPy documentation style in (commit: 52073ef) — gurwls223 / githubweb
  3. [SPARK-33451][DOCS] Change to (commit: 0933f1c) — gurwls223 / githubweb
  4. [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in (commit: 236c6c9) — gurwls223 / githubweb
  5. [SPARK-33288][YARN][FOLLOW-UP][TEST-HADOOP2.7] Fix type mismatch error (commit: f660946) — yumwang / githubweb
  6. [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2 (commit: 10105b5) — gurwls223 / githubweb
  7. [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression (commit: d4cf148) — gurwls223 / githubweb
  8. [SPARK-33394][SQL][TESTS] Throw `NoSuchNamespaceException` for not (commit: 4e5d2e0) — wenchen / githubweb
  9. [SPARK-33458][SQL] Hive partition pruning support Contains, StartsWith (commit: cdcbdae) — wenchen / githubweb
  10. [SPARK-30985][K8S] Support propagating SPARK_CONF_DIR files to driver (commit: 8615f35) — dongjoon / githubweb
  11. [SPARK-33456][SQL][TEST][FOLLOWUP] Fix SUBEXPRESSION_ELIMINATION_ENABLED (commit: 10b011f) — gurwls223 / githubweb
  12. [MINOR][SQL][DOCS] Fix a reference to (commit: 71a29b2) — gurwls223 / githubweb
  13. [SPARK-33140][SQL][FOLLOW-UP] Revert code that not use passed-in (commit: aa508fc) — wenchen / githubweb
  14. [SPARK-33389][SQL] Make internal classes of SparkSession always using (commit: dfa6fb4) — wenchen / githubweb
  15. [SPARK-33453][SQL][TESTS] Unify v1 and v2 SHOW PARTITIONS tests (commit: 6883f29) — wenchen / githubweb
  16. [SPARK-33460][SQL] Accessing map values should fail if key is not found (commit: b5eca18) — wenchen / githubweb

#670 (Nov 15, 2020 2:27:25 PM)

  1. [SPARK-33396][SQL] Spark SQL CLI prints appliction id when process file (commit: 34a9a77) — yumwang / githubweb
  2. [SPARK-33432][SQL] SQL parser should use active SQLConf (commit: 156704b) — dongjoon / githubweb
  3. [SPARK-33455][SQL][TEST] Add SubExprEliminationBenchmark for (commit: eea846b) — dongjoon / githubweb

#669 (Nov 14, 2020 3:47:08 AM)

  1. [SPARK-33426][SQL][TESTS] Unify Hive SHOW TABLES tests (commit: 539c2de) — wenchen / githubweb
  2. [SPARK-33439][INFRA] Use SERIAL_SBT_TESTS=1 for SQL modules (commit: a70a2b0) — dongjoon / githubweb
  3. [SPARK-33433][SQL] Change Aggregate max rows to 1 if grouping is empty (commit: 82a21d2) — yamamuro / githubweb
  4. [SPARK-33419][SQL] Unexpected behavior when using SET commands before a (commit: cdd8e51) — wenchen / githubweb
  5. [SPARK-33166][DOC] Provide Search Function in Spark docs site (commit: f80fe21) — gengliang.wang / githubweb
  6. Revert "[SPARK-33139][SQL] protect setActionSession and (commit: 234711a) — wenchen / githubweb
  7. [SPARK-33288][SPARK-32661][K8S] Stage level scheduling support for (commit: acfd846) — tgraves / githubweb
  8. [SPARK-32916][SHUFFLE][TEST-MAVEN][TEST-HADOOP2.7] Remove the newly (commit: 423ba5a) — tgraves / githubweb
  9. [SPARK-33337][SQL][FOLLOWUP] Prevent possible flakyness in (commit: 0046222) — dongjoon / githubweb

#668 (Nov 12, 2020 3:44:09 PM)

  1. [SPARK-33435][SQL] DSv2: REFRESH TABLE should invalidate caches (commit: cf3b655) — dongjoon / githubweb
  2. [SPARK-33259][SS] Disable streaming query with possible correctness (commit: 2c64b73) — dongjoon / githubweb

#667 (Nov 12, 2020 8:15:35 AM)

  1. [SPARK-33386][SQL] Accessing array elements in (commit: 6d31dae) — wenchen / githubweb
  2. [MINOR][DOC] spark.executor.memoryOverhead is not cluster-mode only (commit: 4335af0) — yamamuro / githubweb
  3. [SPARK-32907][ML][PYTHON] adaptively blockify instances - LinearSVC (commit: a288716) — weichen.xu / githubweb
  4. [SPARK-33421][SQL] Support Greatest and Least in Expression Canonicalize (commit: a3d2954) — gurwls223 / githubweb
  5. [SPARK-33278][SQL] Improve the performance for FIRST_VALUE (commit: 2f07c56) — wenchen / githubweb
  6. [SPARK-33140][SQL][FOLLOW-UP] change val to def in object rule (commit: 1baf0d5) — gurwls223 / githubweb

#666 (Nov 11, 2020 11:03:18 PM)

  1. [SPARK-33415][PYTHON][SQL] Don't encode JVM response in Column.__repr__ (commit: 4b76a74) — gurwls223 / githubweb
  2. [SPARK-33404][SQL][FOLLOWUP] Update benchmark results for `date_trunc` (commit: 7e86729) — dongjoon / githubweb
  3. [SPARK-33402][CORE] Jobs launched in same second have duplicate (commit: 318a173) — dongjoon / githubweb
  4. [MINOR][GRAPHX] Correct typos in the sub-modules: graphx, external, and (commit: 9d58a2f) — yamamuro / githubweb
  5. [WIP] Test (#30327) (commit: 61ee5d8) — noreply / githubweb
  6. Revert "[WIP] Test (#30327)" (commit: 6244407) — gurwls223 / githubweb
  7. [SPARK-30294][SS][FOLLOW-UP] Directly override RDD methods (commit: 9f983a6) — gurwls223 / githubweb
  8. [SPARK-33408][SPARK-32354][K8S][R] Use R 3.6.3 in K8s R image and (commit: 22baf05) — gurwls223 / githubweb

#665 (Nov 11, 2020 3:28:57 AM)

  1. [SPARK-33414][SQL] Migrate SHOW CREATE TABLE command to use (commit: 6d5d030) — wenchen / githubweb
  2. [SPARK-33417][SQL][TEST] Correct the behaviour of query filters in (commit: 4b36797) — yamamuro / githubweb
  3. [SPARK-33412][SQL] OverwriteByExpression should resolve its delete (commit: 8760032) — gurwls223 / githubweb
  4. [SPARK-32512][SQL] add alter table add/drop partition command for (commit: 1eb236b) — wenchen / githubweb

#664 (Nov 10, 2020 9:44:47 PM)

  1. [SPARK-32691][BUILD] Update commons-crypto to v1.1.0 (commit: 83a8079) — dongjoon / githubweb
  2. [SPARK-33251][PYTHON][DOCS] Migration to NumPy documentation style in ML (commit: 090962c) — gurwls223 / githubweb
  3. [SPARK-33397][YARN][DOC] Fix generating md to html for (commit: 036c11b) — yamamuro / githubweb
  4. [SPARK-33405][BUILD] Upgrade commons-compress to 1.20 (commit: 35ac314) — gurwls223 / githubweb
  5. [SPARK-33363] Add prompt information related to the current task when (commit: 4360c6f) — gurwls223 / githubweb
  6. [SPARK-33223][SS][UI] Structured Streaming Web UI state information (commit: 4ac8133) — kabhwan.opensource / githubweb
  7. [SPARK-33213][BUILD] Upgrade Apache Arrow to 2.0.0 (commit: c2caf25) — dhyun / githubweb
  8. [SPARK-33369][SQL] DSV2: Skip schema inference in write if table (commit: a1f84d8) — wenchen / githubweb
  9. [SPARK-33366][SQL] Migrate LOAD DATA command to use UnresolvedTable to (commit: 90f6f39) — wenchen / githubweb
  10. [SPARK-33244][SQL] Unify the code paths for spark.table and (commit: ad02ced) — wenchen / githubweb
  11. [SPARK-33391][SQL] element_at with CreateArray not respect one based (commit: e3a768d) — wenchen / githubweb
  12. [SPARK-33339][PYTHON] Pyspark application will hang due to non Exception (commit: 27bb40b) — gurwls223 / githubweb
  13. [SPARK-33305][SQL] DSv2: DROP TABLE command should also invalidate cache (commit: 4934da5) — wenchen / githubweb
  14. [SPARK-33302][SQL] Push down filters through Expand (commit: 34f5e7c) — wenchen / githubweb
  15. [SPARK-33376][SQL] Remove the option of "sharesHadoopClasses" in Hive (commit: 3165ca7) — wenchen / githubweb
  16. [SPARK-33251][FOLLOWUP][PYTHON][DOCS][MINOR] Adjusts returns (commit: 122c899) — huaxing / githubweb
  17. [SPARK-33337][SQL] Support subexpression elimination in branches of (commit: 6fa80ed) — viirya / githubweb
  18. [SPARK-33404][SQL] Fix incorrect results in `date_trunc` expression (commit: 4634694) — yamamuro / githubweb
  19. [SPARK-33390][SQL] Make Literal support char array (commit: 5197c5d) — gurwls223 / githubweb
  20. [SPARK-33382][SQL][TESTS] Unify datasource v1 and v2 SHOW TABLES tests (commit: 1e2eeda) — wenchen / githubweb

#663 (Nov 9, 2020 1:53:22 PM)

  1. [SPARK-32860][DOCS][SQL] Updating documentation about map support in (commit: 1090b1b) — gurwls223 / githubweb
  2. [SPARK-33352][CORE][SQL][SS][MLLIB][AVRO][K8S] Fix procedure-like (commit: 02fd52c) — srowen / githubweb
  3. [SPARK-33384][SS] Delete temporary file when cancelling writing to final (commit: c269b53) — dhyun / githubweb
  4. [SPARK-33387][CORE] Support ordered shuffle block migration (commit: aa0849b) — dhyun / githubweb
  5. [SPARK-32405][SQL] Apply table options while creating tables in JDBC (commit: bfb257f) — wenchen / githubweb
  6. [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to (commit: 98730b7) — wenchen / githubweb
  7. [SPARK-33372][SQL] Fix InSet bucket pruning (commit: 69799c5) — wenchen / githubweb
  8. [SPARK-33385][SQL] Support bucket pruning for IsNaN (commit: 7a5647a) — wenchen / githubweb
  9. [SPARK-33140][SQL][FOLLOW-UP] Use sparkSession in AQE context when (commit: 4e1c894) — wenchen / githubweb
  10. [SPARK-33303][SQL] Deduplicate deterministic PythonUDF calls (commit: 84dc374) — gurwls223 / githubweb
  11. [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages (commit: 8113c88) — mridulatgmail.com / githubweb

#662 (Nov 8, 2020 1:58:05 AM)

  1. [SPARK-33371][PYTHON] Update setup.py and tests for Python 3.9 (commit: e11a24c) — dhyun / githubweb

#661 (Nov 6, 2020 2:38:29 PM)

  1. [SPARK-33362][SQL] skipSchemaResolution should still require query to be (commit: 26ea417) — dhyun / githubweb
  2. [SPARK-33353][BUILD] Cache dependencies for Coursier with new sbt in (commit: 208b94e) — dhyun / githubweb
  3. [SPARK-33290][SQL][DOCS][FOLLOW-UP] Update SQL migration guide (commit: 1a70479) — dhyun / githubweb
  4. [SPARK-33185][YARN] Set up yarn.Client to print direct links to driver (commit: 324275a) — mridulatgmail.com / githubweb
  5. [SPARK-33360][SQL] Simplify DS v2 write resolution (commit: cd4e3d3) — dhyun / githubweb
  6. [SPARK-33365][BUILD] Update SBT to 1.4.2 (commit: 4941b7a) — dhyun / githubweb
  7. [MINOR][SQL] Fix incorrect JIRA ID comments in Analyzer (commit: 90f35c6) — gurwls223 / githubweb
  8. [SPARK-32934][SQL][FOLLOW-UP] Refine class naming and code comments (commit: d163110) — wenchen / githubweb
  9. [SPARK-33342][WEBUI] fix the wrong url and display name of blocking (commit: f6c0007) — gengliang.wang / githubweb
  10. [SPARK-33130][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: add, (commit: 733a468) — wenchen / githubweb
  11. [SPARK-33364][SQL] Introduce the "purge" option in (commit: 68c032c) — dhyun / githubweb
  12. [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page (commit: 93ad26b) — kabhwan.opensource / githubweb
  13. [SPARK-33291][SQL] Improve DataFrame.show for nulls in arrays and (commit: 09fa7ec) — viirya / githubweb
  14. [SPARK-33347][CORE] Cleanup useless variables of MutableApplicationInfo (commit: fb9c873) — kabhwan.opensource / githubweb

#660 (Nov 5, 2020 2:52:18 AM)

  1. Revert "[SPARK-33248][SQL] Add a configuration to control the legacy (commit: 034070a) — wenchen / githubweb
  2. [SPARK-33323][SQL] Add query resolved check before convert hive relation (commit: 1740b29) — wenchen / githubweb
  3. [SPARK-33321][SQL] Migrate ANALYZE TABLE commands to use (commit: 0ad35ba) — wenchen / githubweb
  4. [SPARK-33214][TEST][HIVE] Stop HiveExternalCatalogVersionsSuite from (commit: ff724d2) — wenchen / githubweb
  5. [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] (commit: 0b557b3) — gurwls223 / githubweb
  6. [SPARK-33338][SQL] GROUP BY using literal map should not fail (commit: 42c0b17) — dhyun / githubweb
  7. [SPARK-31711][CORE] Register the executor source with the metrics system (commit: b7fff03) — tgraves / githubweb
  8. [SPARK-33343][BUILD] Fix the build with sbt to copy (commit: d24dbe8) — dhyun / githubweb
  9. [SPARK-33314][SQL] Avoid dropping rows in Avro reader (commit: 7e8eb04) — gurwls223 / githubweb
  10. [SPARK-33316][SQL] Support user provided nullable Avro schema for (commit: 551b504) — gengliang.wang / githubweb
  11. [SPARK-33282] Migrate from deprecated probot autolabeler to GitHub (commit: 0535b34) — gurwls223 / githubweb
  12. Revert "[SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop (commit: d530ed0) — gurwls223 / githubweb
  13. [MINOR][SS][DOCS] Update join type in stream static joins code examples (commit: e66201b) — kabhwan.opensource / githubweb
  14. [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize (commit: 21413b7) — kabhwan.opensource / githubweb

#659 (Nov 3, 2020 3:12:14 PM)

  1. [SPARK-33293][SQL][FOLLOW-UP] Rename TableWriteExec to (commit: d900c6f) — dhyun / githubweb

#658 (Nov 3, 2020 10:04:24 AM)

  1. [SPARK-33319][SQL][TEST] Add all built-in SerDes to (commit: 789d19c) — dhyun / githubweb
  2. [SPARK-33306][SQL][FOLLOWUP] Group DateType and TimestampType together (commit: eecebd0) — dhyun / githubweb
  3. [SPARK-33299][SQL][DOCS] Don't mention schemas in JSON format in docs (commit: bdabf60) — dhyun / githubweb
  4. [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in (commit: 3959f0d) — gurwls223 / githubweb
  5. [SPARK-33324][K8S][BUILD] Upgrade kubernetes-client to 4.11.1 (commit: 27d8136) — dhyun / githubweb
  6. [SPARK-33257][PYTHON][SQL] Support Column inputs in PySpark ordering (commit: 4c8ee88) — gurwls223 / githubweb
  7. [SPARK-33284][WEB-UI] In the Storage UI page, clicking any field to sort (commit: 56c623e) — srowen / githubweb

#657 (Nov 2, 2020 3:48:24 AM)

  1. [SPARK-33310][PYTHON] Relax pyspark typing for sql str functions (commit: 56587f0) — gurwls223 / githubweb
  2. [SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop consuming (commit: b8a440f) — gurwls223 / githubweb
  3. [SPARK-20044][UI] Support Spark UI behind front-end reverse proxy using (commit: 2b6dfa5) — gengliang.wang / githubweb
  4. [SPARK-30663][SPARK-33313][TESTS][R] Drop testthat 1.x support and add (commit: d71b2fe) — gurwls223 / githubweb
  5. [SPARK-33095] Follow up, support alter table column rename (commit: 6226ccc) — wenchen / githubweb
  6. [SPARK-33027][SQL] Add DisableUnnecessaryBucketedScan rule to AQE (commit: e52b858) — wenchen / githubweb

#656 (Oct 31, 2020 5:22:39 PM)

  1. [SPARK-33306][SQL] Timezone is needed when cast date to string (commit: 69c27f4) — dhyun / githubweb

#655 (Oct 31, 2020 10:43:53 AM)

  1. [SPARK-33290][SQL] REFRESH TABLE should invalidate cache even though the (commit: 32b78d3) — dhyun / githubweb
  2. [SPARK-33293][SQL] Refactor WriteToDataSourceV2Exec and reduce code (commit: c51e5fc) — dhyun / githubweb

#654 (Oct 30, 2020 3:59:27 PM)

  1. [SPARK-33294][SQL] Add query resolved check before analyze InsertIntoDir (commit: d59f6a7) — wenchen / githubweb
  2. [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT (commit: 3af1651) — gurwls223 / githubweb
  3. [MINOR][CORE][DOCS] Fix typo in (commit: 7c897c1) — dhyun / githubweb
  4. [SPARK-33262][K8S][FOLLOWUP] Verify pod allocation does not stall (commit: 491a0fb) — dhyun / githubweb
  5. [SPARK-32037][CORE] Rename blacklisting feature (commit: 72ad9dc) — tgraves / githubweb

#653 (Oct 29, 2020 11:45:31 PM)

  1. [SPARK-33292][SQL] Make Literal ArrayBasedMapData string representation (commit: 838791b) — dhyun / githubweb
  2. [SPARK-33286][SQL] Improve the error message about schema parsing by (commit: 343e0bb) — gurwls223 / githubweb
  3. [SPARK-33248][SQL] Add a configuration to control the legacy behavior of (commit: 0c943cd) — gurwls223 / githubweb

#652 (Oct 29, 2020 10:37:22 AM)

  1. [SPARK-33008][SQL] Division by zero on divide-like operations returns (commit: cbd3fde) — wenchen / githubweb

#651 (Oct 29, 2020 9:01:33 AM)

  1. [SPARK-33283][CORE] Remove useless externalBlockStoreSize from RDDInfo (commit: fa63117) — dhyun / githubweb

#650 (Oct 29, 2020 7:47:16 AM)

  1. [SPARK-33281][SQL] Return SQL schema instead of Catalog string from the (commit: b409025) — gurwls223 / githubweb
  2. [SPARK-33263][SS] Configurable StateStore compression codec (commit: 056b622) — dhyun / githubweb

#649 (Oct 28, 2020 7:34:54 PM)

  1. [SPARK-33272][SQL] prune the attributes mapping in (commit: 2639ad4) — yamamuro / githubweb
  2. [SQL][MINOR] Update from_unixtime doc (commit: c592ae6) — gurwls223 / githubweb
  3. [SPARK-33270][SQL] Return SQL schema instead of Catalog string from the (commit: 9d5e48e) — gurwls223 / githubweb

#646 (Oct 28, 2020 10:25:58 AM)

  1. [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild (commit: 4b0e23e) — kabhwan.opensource / githubweb
  2. [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of (commit: 537a49f) — wenchen / githubweb
  3. [SPARK-33225][SQL] Extract AliasHelper trait (commit: 281f99c) — yamamuro / githubweb
  4. [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update (commit: f284218) — wenchen / githubweb
  5. [SPARK-33231][SPARK-33262][CORE] Make pod allocation executor timeouts (commit: 98f0a21) — dhyun / githubweb
  6. [SPARK-33260][SQL] Fix incorrect results from SortExec when sortOrder is (commit: 3f2a2b5) — dhyun / githubweb
  7. [SPARK-33246][SQL][DOCS] Correct documentation for null semantics of (commit: 7d11d97) — yamamuro / githubweb
  8. [SPARK-33258][R][SQL] Add asc_nulls_* and desc_nulls_* methods to SparkR (commit: ea709d6) — gurwls223 / githubweb
  9. [SPARK-33264][SQL][DOCS] Add a dedicated page for SQL-on-file in SQL (commit: c2bea04) — yamamuro / githubweb
  10. [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 (commit: fcf8aa5) — wenchen / githubweb
  11. [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to (commit: 528160f) — wenchen / githubweb
  12. [SPARK-33183][SQL] Fix Optimizer rule EliminateSorts and add a physical (commit: 9fb4536) — wenchen / githubweb
  13. [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the (commit: 3c3ad5f) — wenchen / githubweb
  14. [SPARK-33269][INFRA] Ignore ".bsp/" directory in Git (commit: 2b8fe6d) — gurwls223 / githubweb
  15. [SPARK-33208][SQL] Update the document of SparkSession#sql (commit: b26ae98) — wenchen / githubweb
  16. [SPARK-33268][SQL][PYTHON] Fix bugs for casting data from/to (commit: a6216e2) — dhyun / githubweb
  17. [SPARK-33267][SQL] Fix NPE issue on 'In' filter when one of values (commit: a744fea) — dhyun / githubweb

#645 (Oct 26, 2020 10:21:56 PM)

  1. [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same (commit: e43cd8c) — gurwls223 / githubweb
  2. [SPARK-32188][PYTHON][DOCS][FOLLOW-UP] Document Column APIs in API (commit: 7cdc921) — gurwls223 / githubweb
  3. [SPARK-32084][PYTHON][SQL] Expand dictionary functions (commit: 4e6a310) — gurwls223 / githubweb
  4. [SPARK-33243][PYTHON][BUILD] Add numpydoc into documentation dependency (commit: 9818f07) — gurwls223 / githubweb

#644 (Oct 26, 2020 4:20:50 PM)

  1. [SPARK-33237][K8S][TESTS] Use default Hadoop-3.2 profile from K8s IT (commit: afa6aee) — dhyun / githubweb

#643 (Oct 26, 2020 12:44:08 PM)

  1. [SPARK-33228][SQL] Don't uncache data when replacing a view having the (commit: 87b4984) — dhyun / githubweb
  2. [SPARK-33234][INFRA] Generates SHA-512 using shasum (commit: ce0ebf5) — dhyun / githubweb
  3. [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same (commit: 56ab60f) — gurwls223 / githubweb
  4. Revert "[SPARK-32388][SQL] TRANSFORM with schema-less mode should keep (commit: 369cc61) — gurwls223 / githubweb
  5. [SPARK-32862][SS] Left semi stream-stream join (commit: d87a0bb) — kabhwan.opensource / githubweb
  6. [SPARK-33197][SQL] Make changes to spark.sql.analyzer.maxIterations take (commit: a21945c) — yamamuro / githubweb
  7. [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job (commit: 850adeb) — dhyun / githubweb
  8. [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only (commit: 1042d49) — yamamuro / githubweb
  9. [SPARK-33204][UI] The 'Event Timeline' area cannot be opened when a (commit: 11bbb13) — gengliang.wang / githubweb
  10. [SPARK-33230][SQL] Hadoop committers to get unique job ID in (commit: 02fa19f) — dhyun / githubweb

#642 (Oct 25, 2020 9:46:41 AM)

  1. [SPARK-30821][K8S] Handle executor failure with multiple containers (commit: f659527) — hkarau / githubweb
  2. [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming (commit: 0c66a88) — viirya / githubweb

#641 (Oct 23, 2020 9:53:53 PM)

  1. [SPARK-32998][BUILD] Add ability to override default remote repos with (commit: 3819d39) — dhyun / githubweb
  2. [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document (commit: 87b32f6) — gurwls223 / githubweb
  3. [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission (commit: edeecad) — gurwls223 / githubweb
  4. [SPARK-32991][SQL] Use conf in shared state as the original configuraion (commit: e21bb71) — wenchen / githubweb
  5. [SPARK-33226][BUILD] Upgrade to SBT 1.4.1 (commit: 5e5b48d) — viirya / githubweb
  6. [SPARK-33104][BUILD] Exclude (commit: 10bd42c) — gurwls223 / githubweb
  7. [SPARK-33193][SQL][TEST] Hive ThriftServer JDBC Database MetaData API (commit: 82d500a) — dhyun / githubweb
  8. [SPARK-33003][PYTHON][DOCS] Add type hints guidelines to the (commit: d7f15b0) — gurwls223 / githubweb

#640 (Oct 22, 2020 9:32:14 AM)

  1. [SPARK-32785][SQL][DOCS][FOLLOWUP] Update migaration guide for (commit: dcb0820) — yamamuro / githubweb
  2. [SPARK-33111][ML][FOLLOW-UP] aft transform optimization - (commit: 618695b) — srowen / githubweb
  3. [SPARK-33205][BUILD] Bump snappy-java version to 1.1.8 (commit: 1b7367c) — viirya / githubweb
  4. [SPARK-33202][CORE] Fix BlockManagerDecommissioner to return the correct (commit: 7aed81d) — dhyun / githubweb
  5. [SPARK-31964][PYTHON][FOLLOW-UP] Use is_categorical_dtype instead of (commit: 66005a3) — cutlerb / githubweb
  6. [SPARK-33160][SQL][FOLLOWUP] Update benchmarks of INT96 type rebasing (commit: bbf2d6f) — gurwls223 / githubweb
  7. [SPARK-33203][PYTHON][TEST] Fix tests failing with rounding errors (commit: 4a33cd9) — dhyun / githubweb
  8. [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to (commit: ba13b94) — wenchen / githubweb
  9. [SPARK-33212][BUILD] Move to shaded clients for Hadoop 3.x profile (commit: cb3fa6c) — d_tsai / githubweb
  10. [SPARK-30796][SQL] Add parameter position for REGEXP_REPLACE (commit: eb33bcb) — wenchen / githubweb
  11. [SPARK-33218][CORE] Update misleading log messages for removed shuffle (commit: a908b67) — dhyun / githubweb
  12. [SPARK-26533][SQL] Support query auto timeout cancel on thriftserver (commit: d9ee33c) — yamamuro / githubweb
  13. [SPARK-33095][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: add, (commit: 8cae7f8) — wenchen / githubweb
  14. [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location (commit: a1629b4) — wenchen / githubweb
  15. [SPARK-32978][SQL] Make sure the number of dynamic part metric is (commit: b38f3a5) — wenchen / githubweb
  16. [SPARK-33160][SQL][FOLLOWUP] Replace the parquet metadata key (commit: a03d77d) — wenchen / githubweb

#639 (Oct 20, 2020 5:46:07 PM)

  1. Revert "[SPARK-33069][INFRA] Skip test result report if no JUnit XML (commit: a7a8dae) — gurwls223 / githubweb
  2. [SPARK-33169][SQL][TESTS] Check propagation of datasource options to (commit: 26b13c7) — gurwls223 / githubweb
  3. [SPARK-32941][SQL] Optimize UpdateFields expression chain and put the (commit: 66c5e01) — dhyun / githubweb
  4. [SPARK-17333][PYSPARK] Enable mypy (commit: 6ad75cd) — dhyun / githubweb
  5. [SPARK-33181][SQL][DOCS] Document Load Table Directly from File in SQL (commit: f65a244) — gurwls223 / githubweb
  6. [SPARK-32351][SQL] Show partially pushed down partition filters in (commit: 3513390) — gurwls223 / githubweb
  7. [SPARK-33160][SQL] Allow saving/loading INT96 in parquet w/o rebasing (commit: a44e008) — gurwls223 / githubweb
  8. [SPARK-32229][SQL] Fix PostgresConnectionProvider and (commit: fbb6843) — yamamuro / githubweb
  9. [SPARK-33190][INFRA][TESTS] Set upper bound of PyArrow version in GitHub (commit: eb9966b) — gurwls223 / githubweb
  10. [SPARK-33191][YARN][TESTS] Fix PySpark test cases in YarnClusterSuite (commit: 2cfd215) — gurwls223 / githubweb
  11. [MINOR][DOCS] Fix the description about to_avro and from_avro functions (commit: 46ad325) — gurwls223 / githubweb
  12. [MINOR][CORE] Improve log message during storage decommission (commit: c824db2) — dhyun / githubweb
  13. [SPARK-33198][CORE] getMigrationBlocks should not fail at missing files (commit: 385d5db) — dhyun / githubweb
  14. [SPARK-33189][PYTHON][TESTS] Add env var to tests for legacy nested (commit: 47a6568) — gurwls223 / githubweb

#638 (Oct 19, 2020 12:44:36 AM)

  1. [SPARK-33170][SQL] Add SQL config to control fast-fail behavior in (commit: 3010e90) — dhyun / githubweb
  2. [MINOR][DOCS][EXAMPLE] Fix the Python manual_load_options_csv example (commit: 7766a6f) — gurwls223 / githubweb
  3. [MINOR][DOCS] Fix the link to the pickle module page in RDD Programming (commit: d2f328a) — gurwls223 / githubweb
  4. [SPARK-33176][K8S] Use 11-jre-slim as default in K8s Dockerfile (commit: 20b7b92) — dhyun / githubweb
  5. [SPARK-33109][BUILD][FOLLOW-UP] Remove the obsolete comment about (commit: ad99f14) — dhyun / githubweb
  6. [SPARK-33175][K8S] Detect duplicated mountPaths and fail at Spark side (commit: 97605cd) — dhyun / githubweb
  7. [SPARK-33177][SQL] CollectList and CollectSet should not be nullable (commit: ce49894) — gurwls223 / githubweb
  8. [SPARK-32069][CORE][SQL] Improve error message on reading unexpected (commit: f8277d3) — dhyun / githubweb
  9. [SPARK-33123][INFRA] Ignore GitHub only changes in Amplab Jenkins build (commit: e6c53c2) — gurwls223 / githubweb
  10. [SPARK-33179][TESTS] Switch default Hadoop profile in run-tests.py (commit: 53783e7) — gurwls223 / githubweb
  11. [SPARK-33139][SQL][FOLLOW-UP] Avoid using reflect call on session.py (commit: 388e067) — gurwls223 / githubweb

#637 (Oct 17, 2020 7:40:08 AM)

  1. [MINOR][PYTHON] Fix the typo in the docstring of method agg() (commit: 81d3a8e) — dongjoon / githubweb
  2. [SPARK-33162][INFRA] Use pre-built image at GitHub Action PySpark jobs (commit: 9f5eff0) — dongjoon / githubweb
  3. [SPARK-33163][SQL][TESTS] Check the metadata key (commit: 38c05af) — gurwls223 / githubweb
  4. [SPARK-32402][SQL][FOLLOW-UP] Add case sensitivity tests for column (commit: bf594a9) — gurwls223 / githubweb
  5. [SPARK-33165][SQL][TEST] Remove dependencies(scalatest,scalactic) from (commit: a5c17de) — gurwls223 / githubweb
  6. [SPARK-33088][CORE] Enhance ExecutorPlugin API to include callbacks on (commit: 8f4fc22) — mridulatgmail.com / githubweb
  7. [SPARK-33165][SQL][TESTS][FOLLOW-UP] Use scala.Predef.assert instead (commit: bf52fa8) — gurwls223 / githubweb
  8. [SPARK-33139][SQL] protect setActionSession and clearActiveSession (commit: 306872e) — wenchen / githubweb
  9. [SPARK-33126][SQL] Simplify offset window function(Remove direction (commit: b69e065) — wenchen / githubweb
  10. [SPARK-33131][SQL] Fix grouping sets with having clause can not resolve (commit: 3ae1520) — wenchen / githubweb
  11. [SPARK-33145][WEBUI] Fix when `Succeeded Jobs` has many child url (commit: e029e89) — gengliang.wang / githubweb
  12. [SPARK-33159][SQL] Use hive-service-rpc as dependency instead of (commit: 2507301) — dongjoon / githubweb
  13. [SPARK-33171][INFRA] Mark (commit: ab0bad9) — dhyun / githubweb
  14. [MINOR][SQL] Re-use `binaryToSQLTimestamp()` in `ParquetRowConverter` (commit: acb79f5) — dhyun / githubweb
  15. [SPARK-33154][CORE][K8S] Handle cleaned shuffles during migration (commit: ce6180c) — dhyun / githubweb
  16. [SPARK-32376][SQL] Make unionByName null-filling behavior work with (commit: e574fcd) — viirya / githubweb
  17. [SPARK-33109][BUILD] Upgrade to sbt 1.4.0 (commit: 0411def) — dhyun / githubweb
  18. [SPARK-33173][CORE][TESTS] Use `eventually` to check `numOnTaskFailed` (commit: 911dcd3) — dhyun / githubweb
  19. [MINOR][SS][DOCS] Update Structured Streaming guide doc and update code (commit: 2c4599d) — dhyun / githubweb

#636 (Oct 15, 2020 2:21:28 PM)

  1. [SPARK-33118][SQL] CREATE TEMPORARY TABLE fails with location (commit: 819f12e) — dhyun / githubweb
  2. [SPARK-32455][ML][FOLLOW-UP] LogisticRegressionModel prediction (commit: 86d26b4) — ruifengz / githubweb
  3. [SPARK-33119][SQL] ScalarSubquery should returns the first two rows to (commit: e34f2d8) — gurwls223 / githubweb
  4. [SPARK-32295][SQL] Add not null and size > 0 filters before inner (commit: 17eebd7) — yamamuro / githubweb
  5. [SPARK-33115][BUILD][DOCS] Fix javadoc errors in `kvstore` and `unsafe` (commit: 1b0875b) — gurwls223 / githubweb
  6. [SPARK-32858][SQL] UnwrapCastInBinaryComparison: support other numeric (commit: feee8da) — wenchen / githubweb
  7. [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update (commit: af3e2f7) — wenchen / githubweb
  8. [SPARK-33125][SQL] Improve the error when Lead and Lag are not allowed (commit: 2b7239e) — wenchen / githubweb
  9. [SPARK-13860][SQL] Change statistical aggregate function to return null (commit: dc697a8) — wenchen / githubweb
  10. [SPARK-33129][BUILD][DOCS] Updating the build/sbt references to (commit: 304ca1e) — dhyun / githubweb
  11. [SPARK-33132][WEBUI] Make `formatBytes` return `0.0 B` for negative (commit: 1bfcb51) — dhyun / githubweb
  12. [SPARK-33134][SQL] Return partial results only for root JSON objects (commit: 05a62dc) — gurwls223 / githubweb
  13. [SPARK-33061][SQL] Expose inverse hyperbolic trig functions through (commit: d8c4a47) — srowen / githubweb
  14. [SPARK-33136][SQL] Fix mistakenly swapped parameter in (commit: 8e5cb1d) — dhyun / githubweb
  15. [SPARK-33026][SQL][FOLLOWUP] metrics name should be numOutputRows (commit: f3ad32f) — wenchen / githubweb
  16. [SPARK-33146][CORE] Check for non-fatal errors when loading new (commit: 9ab0ec4) — kabhwan.opensource / githubweb
  17. [SPARK-33153][SQL][TESTS] Ignore Spark 2.4 in (commit: ec34a00) — dhyun / githubweb
  18. [SPARK-32932][SQL] Do not use local shuffle reader at final stage on (commit: 77a8efb) — wenchen / githubweb
  19. [SPARK-33155][K8S] spark.kubernetes.pyspark.pythonVersion allows only (commit: 8e7c390) — dhyun / githubweb
  20. [SPARK-33156][INFRA] Upgrade GithubAction image from 18.04 to 20.04 (commit: e85ed8a) — dhyun / githubweb
  21. [SPARK-33079][TESTS] Replace the existing Maven job for Scala 2.13 in (commit: 513b6f5) — gurwls223 / githubweb
  22. [SPARK-32402][SQL][FOLLOW-UP] Use quoted column name for (commit: 31f7097) — wenchen / githubweb
  23. [SPARK-32247][INFRA] Install and test scipy with PyPy in GitHub Actions (commit: b089fe5) — dhyun / githubweb
  24. [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to (commit: 82eea13) — mridulatgmail.com / githubweb
  25. [SPARK-33078][SQL] Add config for json expression optimization (commit: 9e37464) — dongjoon / githubweb
  26. [SPARK-33080][BUILD] Replace fatal warnings snippet (commit: ba69d68) — srowen / githubweb

#635 (Oct 12, 2020 1:58:29 PM)

  1. [SPARK-33086][FOLLOW-UP] Remove unused Optional import from (commit: 83f8e13) — gurwls223 / githubweb
  2. [SPARK-33106][BUILD] Fix resolvers clash in SBT (commit: c78971b) — dhyun / githubweb
  3. [SPARK-21708][BUILD][FOLLOWUP] Rename hdpVersion to hadoopVersionValue (commit: 50b2a49) — dhyun / githubweb
  4. [SPARK-32047][SQL] Add JDBC connection provider disable possibility (commit: 4af1ac9) — gurwls223 / githubweb
  5. [SPARK-33107][BUILD][FOLLOW-UP] Remove (commit: 543d59d) — dhyun / githubweb
  6. [SPARK-33117][BUILD] Update zstd-jni to 1.4.5-6 (commit: 9896288) — dhyun / githubweb
  7. [SPARK-33092][SQL] Support subexpression elimination in ProjectExec (commit: 78c0967) — yamamuro / githubweb
  8. [SPARK-32704][SQL][FOLLOWUP] Corrects version values of plan logging (commit: a0e3244) — yamamuro / githubweb
  9. [SPARK-33111][ML] aft transform optimization (commit: ed2fe8d) — srowen / githubweb
  10. [SPARK-33016][SQL] Potential SQLMetrics missed which might cause WEB UI (commit: b27a287) — wenchen / githubweb

#634 (Oct 11, 2020 2:10:58 AM)

  1. [SPARK-33105][INFRA] Change default R arch from i386 to x64 and (commit: 018811f) — gurwls223 / githubweb
  2. [SPARK-33102][SQL] Use stringToSeq on SQL list typed parameters (commit: 1e63dcc) — gurwls223 / githubweb
  3. [SPARK-33108][BUILD] Remove sbt-dependency-graph SBT plugin (commit: dfb7790) — dhyun / githubweb
  4. [SPARK-32881][CORE] Catch some race condition errors and log them more (commit: 7696ca5) — dhyun / githubweb
  5. [SPARK-33107][SQL] Remove hive-2.3 workaround code (commit: 5e17014) — dhyun / githubweb

#633 (Oct 9, 2020 2:24:17 PM)

  1. [DOC][MINOR] pySpark usage - removed repeated keyword causing confusion (commit: 4a47b3e) — srowen / githubweb
  2. [SPARK-33096][K8S] Use LinkedHashMap instead of Map for (commit: 4987db8) — dhyun / githubweb
  3. [SPARK-33094][SQL] Make ORC format propagate Hadoop config from DS (commit: c5f6af9) — dhyun / githubweb
  4. [SPARK-32743][SQL] Add distinct info at UnresolvedFunction toString (commit: a907729) — yamamuro / githubweb
  5. [SPARK-32793][FOLLOW-UP] Minor corrections for PySpark annotations and (commit: 3beab8d) — gurwls223 / githubweb
  6. [SPARK-33101][ML] Make LibSVM format propagate Hadoop config from DS (commit: 1234c66) — dhyun / githubweb
  7. [SPARK-33099][K8S] Respect executor idle timeout conf in (commit: e1909c9) — dhyun / githubweb
  8. [SPARK-32896][SS] Add DataStreamWriter.table API (commit: edb140e) — dhyun / githubweb
  9. [SPARK-33082][SPARK-20202][BUILD][SQL][FOLLOW-UP] Remove Hive 1.2 (commit: 2e07ed3) — dhyun / githubweb

#632 (Oct 8, 2020 2:22:18 AM)

  1. [SPARK-32857][CORE] Fix flaky o.a.s.s.BarrierTaskContextSuite.throw (commit: 0b326d5) — dhyun / githubweb
  2. [SPARK-33007][SQL] Simplify named_struct + get struct field + from_json (commit: 57ed5a8) — dhyun / githubweb
  3. [SPARK-33067][SQL][TESTS][FOLLOWUP] Check error messages in (commit: 584f90c) — gurwls223 / githubweb
  4. [SPARK-33017][PYTHON][DOCS][FOLLOW-UP] Add getCheckpointDir into API (commit: 5ce321d) — gurwls223 / githubweb
  5. [SPARK-33034][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: add, (commit: aea78d2) — wenchen / githubweb
  6. [SPARK-33004][SQL] Migrate DESCRIBE column to use UnresolvedTableOrView (commit: 7e99fcd) — wenchen / githubweb
  7. [SPARK-32189][DOCS][PYTHON][FOLLOW-UP] Fixed broken link and typo in (commit: 4e1ded6) — gurwls223 / githubweb
  8. [SPARK-33002][PYTHON] Remove non-API annotations (commit: 72da6f8) — gurwls223 / githubweb
  9. [SPARK-33036][SQL] Refactor RewriteCorrelatedScalarSubquery code to (commit: 94d648d) — yamamuro / githubweb
  10. [SPARK-32067][K8S] Use unique ConfigMap name for executor pod template (commit: 3099fd9) — dhyun / githubweb
  11. [SPARK-33082][SQL] Remove hive-1.2 workaround code (commit: a127387) — dhyun / githubweb
  12. [SPARK-26499][SQL][FOLLOWUP] Print the loading provider exception (commit: 23afc93) — dhyun / githubweb
  13. [SPARK-21708][BUILD] Migrate build to sbt 1.x (commit: 6daa2ae) — dhyun / githubweb
  14. [SPARK-33086][PYTHON] Add static annotations for pyspark.resource (commit: 37e1b0c) — gurwls223 / githubweb
  15. [SPARK-32511][FOLLOW-UP][SQL][R][PYTHON] Add dropFields to SparkR and (commit: 473b3ba) — gurwls223 / githubweb
  16. [SPARK-32793][SQL] Add raise_error function, adds error message (commit: 39510b0) — gurwls223 / githubweb
  17. [SPARK-33089][SQL] make avro format propagate Hadoop config from DS (commit: bbc887b) — gurwls223 / githubweb
  18. [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle (commit: 1c781a4) — wenchen / githubweb
  19. [SPARK-33074][SQL] Classify dialect exceptions in JDBC v2 Table Catalog (commit: 7d6e3fb) — wenchen / githubweb
  20. [SPARK-33091][SQL] Avoid using map instead of foreach to avoid potential (commit: 5effa8e) — yamamuro / githubweb

#631 (Oct 6, 2020 2:13:24 PM)

  1. [SPARK-33042][SQL][TEST] Add a test case to ensure changes to (commit: 0fb2574) — gurwls223 / githubweb
  2. [SPARK-32914][SQL] Avoid constructing dataType multiple times (commit: 023eb48) — gurwls223 / githubweb
  3. [SPARK-33063][K8S] Improve error message for insufficient K8s volume (commit: a09747b) — dhyun / githubweb
  4. [SPARK-33038][SQL] Combine AQE initial and current plan string when two (commit: 14aeab3) — gatorsmile / githubweb
  5. [SPARK-20202][BUILD][SQL] Remove references to org.spark-project.hive (commit: 008a2ad) — dhyun / githubweb
  6. [SPARK-33069][INFRA] Skip test result report if no JUnit XML files are (commit: a0aa8f3) — gurwls223 / githubweb
  7. [SPARK-33067][SQL][TESTS] Add negative checks to JDBC v2 Table Catalog (commit: 9870cf9) — gurwls223 / githubweb
  8. [SPARK-33035][SQL] Updates the obsoleted entries of attribute mapping in (commit: 4adc282) — wenchen / githubweb
  9. [SPARK-32511][SQL] Add dropFields method to Column class (commit: 2793347) — wenchen / githubweb
  10. [SPARK-32243][SQL] HiveSessionCatalog call super.makeFunctionExpression (commit: ddc7012) — wenchen / githubweb
  11. [SPARK-33073][PYTHON] Improve error handling on Pandas to Arrow (commit: 0812d6c) — gurwls223 / githubweb
  12. [SPARK-27428][CORE][TEST] Increase receive buffer size used in (commit: b5e4b8c) — srowen / githubweb
  13. [SPARK-32243][SQL][FOLLOWUP] Fix compilation in HiveSessionCatalog (commit: ec6fccb) — wenchen / githubweb
  14. [SPARK-32963][SQL] empty string should be consistent for schema name in (commit: 17d309d) — wenchen / githubweb
  15. [SPARK-32511][SQL][FOLLOWUP] Fix the broken build for Scala 2.13 with (commit: 3b2a38d) — dhyun / githubweb

#630 (Oct 5, 2020 2:05:33 AM)

  1. [SPARK-32949][FOLLOW-UP][R][SQL] Reindent lines in SparkR (commit: 9b21fdd) — dhyun / githubweb
  2. [SPARK-32958][SQL] Prune unnecessary columns from JsonToStructs (commit: 37c806a) — dhyun / githubweb
  3. [SPARK-33049][CORE] Decommission shuffle block test is flaky (commit: db420f7) — dhyun / githubweb
  4. [SPARK-33065][TESTS] Expand the stack size of a thread in a test in (commit: fab5321) — dhyun / githubweb
  5. [SPARK-33017][PYTHON] Add getCheckpointDir method to PySpark Context (commit: 4ab9aa0) — gurwls223 / githubweb
  6. [SPARK-33040][R][ML] Add SparkR wrapper for vector_to_array (commit: e83d03c) — gurwls223 / githubweb
  7. [SPARK-33040][FOLLOW-UP][R] Reorder argument choices and add examples (commit: 24f890e) — gurwls223 / githubweb

#629 (Oct 3, 2020 12:44:04 PM)

  1. [SPARK-33047][BUILD] Upgrade hive-storage-api to 2.7.2 (commit: 9c618b3) — dhyun / githubweb
  2. [SPARK-32585][SQL] Support scala enumeration in ScalaReflection (commit: e62d247) — tathagata.das1565 / githubweb
  3. [SPARK-33046][DOCS] Update how to build doc for Scala 2.13 with sbt (commit: 0059997) — srowen / githubweb
  4. [SPARK-32996][WEB-UI][FOLLOWUP] Move ExecutorSummarySuite to proper path (commit: 8657742) — viirya / githubweb
  5. [SPARK-32859][SQL] Introduce physical rule to decide bucketing (commit: d6f3138) — yamamuro / githubweb
  6. [SPARK-32001][SQL] Create JDBC authentication provider developer API (commit: 991f7e8) — gurwls223 / githubweb
  7. [SPARK-33026][SQL] Add numRows to metric of BroadcastExchangeExec (commit: 9996e25) — dhyun / githubweb
  8. [SPARK-33051][INFRA][R] Uses setup-r to install R in GitHub Actions (commit: b205be5) — gurwls223 / githubweb
  9. [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings (commit: f7ba952) — gurwls223 / githubweb
  10. [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12 (commit: aa66579) — dhyun / githubweb
  11. [SPARK-33030][R] Add nth_value to SparkR (commit: 9b88aca) — dhyun / githubweb
  12. [SPARK-32741][SQL][FOLLOWUP] Run plan integrity check only for effective (commit: 82721ce) — yamamuro / githubweb
  13. [SPARK-33037][SHUFFLE] Remove knownManagers to support user's custom (commit: 1299c8a) — viirya / githubweb
  14. [SPARK-33052][SQL][TEST] Make all the database versions up-to-date for (commit: 5af62a2) — yamamuro / githubweb
  15. [SPARK-33043][ML] Handle spark.driver.maxResultSize=0 in RowMatrix (commit: f86171a) — srowen / githubweb

#628 (Oct 1, 2020 6:55:45 AM)

  1. [SPARK-32741][SQL] Check if the same ExprId refers to the unique (commit: 3a299aa) — yamamuro / githubweb
  2. [SPARK-33006][K8S][DOCS] Add dynamic PVC usage example into K8s doc (commit: ece8d8e) — dhyun / githubweb
  3. [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs (commit: 3bdbb55) — yamamuro / githubweb
  4. [SPARK-33012][BUILD][K8S] Upgrade fabric8 to 4.10.3 (commit: d75222d) — dhyun / githubweb
  5. [SPARK-33023][CORE] Judge  path of Windows need  add condition (commit: 0b5a379) — dhyun / githubweb
  6. [SPARK-32723][WEBUI] Upgrade to jQuery 3.5.1 (commit: 28ed3a5) — dhyun / githubweb
  7. [SPARK-32992][SQL] Map Oracle's ROWID type to StringType in read via (commit: 5651284) — yamamuro / githubweb
  8. [SQL][DOC][MINOR] Corrects input table names in the examples of CREATE (commit: d3dbe1a) — yamamuro / githubweb
  9. [SPARK-33024][SQL] Fix CodeGen fallback issue of UDFSuite in Scala 2.13 (commit: 0963fcd) — srowen / githubweb

#627 (Sep 29, 2020 2:05:24 PM)

  1. [SPARK-32927][SQL] Bitwise OR, AND and XOR should have similar (commit: f41ba2a) — gurwls223 / githubweb
  2. [SPARK-32187][PYTHON][DOCS] Doc on Python packaging (commit: a7f84a0) — gurwls223 / githubweb
  3. [SPARK-33011][ML] Promote the stability annotation to Evolving for (commit: d15f504) — gurwls223 / githubweb
  4. [SPARK-32996][WEB-UI] Handle empty ExecutorMetrics in (commit: 173da5b) — viirya / githubweb
  5. [SPARK-27951][SQL][FOLLOWUP] Improve the window function nth_value (commit: a53fc9b) — gurwls223 / githubweb
  6. [SPARK-33021][PYTHON][TESTS] Move functions related test cases into (commit: 376ede1) — dhyun / githubweb
  7. [SPARK-33015][SQL] Compute the current date only once (commit: 68cd567) — wenchen / githubweb
  8. [SPARK-33020][PYTHON] Add nth_value as a PySpark function (commit: 6868b40) — dhyun / githubweb
  9. [MINOR][DOCS] Document when `current_date` and `current_timestamp` are (commit: 1b60ff5) — wenchen / githubweb
  10. [SPARK-32948][SQL] Optimize to_json and from_json expression chain (commit: 202115e) — dhyun / githubweb
  11. [SPARK-32970][SPARK-32019][SQL][TEST] Reduce the runtime of an UT for (commit: 90e86f6) — gurwls223 / githubweb
  12. [SPARK-32901][CORE] Do not allocate memory while spilling (commit: f167002) — herman / githubweb
  13. [MINOR][DOCS] Fixing log message for better clarity (commit: 7766fd1) — srowen / githubweb
  14. [SPARK-33018][SQL] Fix estimate statistics issue if child has 0 bytes (commit: 711d8dd) — wenchen / githubweb
  15. [SPARK-33019][CORE] Use (commit: cc06266) — dhyun / githubweb

#626 (Sep 27, 2020 11:42:36 AM)

  1. [SPARK-21481][ML][FOLLOWUP][TRIVIAL] HashingTF use (commit: 934a91f) — srowen / githubweb
  2. [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed (commit: 9a155d4) — dhyun / githubweb
  3. [SPARK-32974][ML] FeatureHasher transform optimization (commit: 0c38765) — ruifengz / githubweb
  4. [SPARK-32714][FOLLOW-UP][PYTHON] Address pyspark.install typing errors (commit: c65b645) — gurwls223 / githubweb
  5. [SPARK-32973][ML][DOC] FeatureHasher does not check categoricalCols in (commit: bc77e5b) — srowen / githubweb
  6. [SPARK-32972][ML] Pass all UTs of  `mllib` module in Scala 2.13 (commit: bb6d5e7) — srowen / githubweb

#625 (Sep 25, 2020 9:46:47 PM)

  1. [SPARK-32381][CORE][SQL] Move and refactor parallel listing & (commit: 8ccfbc1) — hkarau / githubweb
  2. [SPARK-32889][SQL][TESTS][FOLLOWUP] Skip special column names test in (commit: d7aa3b5) — dhyun / githubweb
  3. [SPARK-32990][SQL] Migrate REFRESH TABLE to use UnresolvedTableOrView to (commit: e9c98c9) — wenchen / githubweb
  4. [SPARK-32877][SQL][TEST] Add test for Hive UDF complex decimal type (commit: f2fc966) — dhyun / githubweb
  5. [SPARK-32885][SS] Add DataStreamReader.table API (commit: 9e6882f) — wenchen / githubweb
  6. [SPARK-32931][SQL] Unevaluable Expressions are not Foldable (commit: e887c63) — wenchen / githubweb
  7. [SPARK-32997][K8S] Support dynamic PVC creation and deletion in K8s (commit: 6c80547) — dhyun / githubweb

#624 (Sep 24, 2020 8:39:40 AM)

  1. [SPARK-32977][SQL][DOCS] Fix JavaDoc on Default Save Mode (commit: b3f0087) — dhyun / githubweb
  2. [SPARK-32971][K8S][FOLLOWUP] Add `.toSeq` for Scala 2.13 compilation (commit: 0bc0e91) — dhyun / githubweb
  3. [SPARK-32714][PYTHON] Initial pyspark-stubs port (commit: 31a16fb) — gurwls223 / githubweb
  4. [SPARK-32982][BUILD] Remove hive-1.2 profiles in PIP installation option (commit: 688d016) — gurwls223 / githubweb
  5. [SPARK-32987][MESOS] Pass all `mesos` module UTs in Scala 2.13 (commit: fe6d38d) — dhyun / githubweb
  6. [SPARK-32954][YARN][TEST] Add jakarta.servlet-api test dependency to (commit: 4ae0f70) — dhyun / githubweb

#623 (Sep 23, 2020 5:27:41 PM)

  1. [SPARK-32659][SQL][FOLLOWUP] Broadcast Array instead of Set in (commit: 6145621) — dhyun / githubweb
  2. [SPARK-32964][DSTREAMS] Pass all `streaming` module UTs in Scala 2.13 (commit: dd80845) — dhyun / githubweb
  3. [SPARK-32757][SQL][FOLLOWUP] Preserve the attribute name as possible as (commit: fba5736) — dhyun / githubweb
  4. [SPARK-32306][SQL][DOCS] Clarify the result of `percentile_approx()` (commit: 7c14f17) — viirya / githubweb
  5. [SPARK-32933][PYTHON] Use keyword-only syntax for keyword_only methods (commit: 779f0a8) — gurwls223 / githubweb
  6. [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available (commit: 942f577) — gurwls223 / githubweb
  7. [MINOR][SQL] Improve examples for `percentile_approx()` (commit: b53da23) — gurwls223 / githubweb
  8. [SPARK-32870][DOCS][SQL] Make sure that all expressions have their (commit: acfee3c) — yamamuro / githubweb
  9. [SPARK-32959][SQL][TEST] Fix an invalid test in DataSourceV2SQLSuite (commit: 21b7479) — wenchen / githubweb
  10. [SPARK-32907][ML] adaptively blockify instances - revert blockify gmm (commit: 432afac) — ruifengz / githubweb
  11. [SPARK-32892][CORE][SQL] Fix hash functions on big-endian platforms (commit: 383bb4a) — srowen / githubweb
  12. [SPARK-32950][SQL] Remove unnecessary big-endian code paths (commit: faeb71b) — srowen / githubweb
  13. [SPARK-32981][BUILD] Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 (commit: 3c97665) — dongjoon / githubweb
  14. [SPARK-32937][SPARK-32980][K8S] Fix decom & launcher tests and add some (commit: 27f6b5a) — dhyun / githubweb
  15. [SPARK-32971][K8S] Support dynamic PVC creation/deletion for K8s (commit: 527cd3f) — dhyun / githubweb

#622 (Sep 22, 2020 7:26:31 AM)

  1. Revert "[SPARK-32850][CORE] Simplify the RPC message flow of (commit: 0c66813) — wenchen / githubweb
  2. [SPARK-32946][R][SQL] Add withColumn to SparkR (commit: 1ad1f71) — gurwls223 / githubweb
  3. [SPARK-32867][SQL] When explain, HiveTableRelation show limited message (commit: c336ddf) — wenchen / githubweb
  4. [SPARK-32886][WEBUI] fix 'undefined' link in event timeline view (commit: d01594e) — srowen / githubweb
  5. [SPARK-32312][DOC][FOLLOWUP] Fix the minimum version of PyArrow in the (commit: 5440ea8) — gurwls223 / githubweb
  6. [SPARK-32951][SQL] Foldable propagation from Aggregate (commit: f03c035) — dhyun / githubweb
  7. [SPARK-32949][R][SQL] Add timestamp_seconds to SparkR (commit: 3118c22) — dhyun / githubweb
  8. [SPARK-32955][DOCS] An item in the navigation bar in the WebUI has a (commit: 790d9ef) — gurwls223 / githubweb

#621 (Sep 20, 2020 9:43:13 PM)

  1. [SPARK-32180][PYTHON][DOCS][FOLLOW-UP] Rephrase and add some more (commit: f893a19) — gurwls223 / githubweb
  2. [SPARK-32799][R][SQL] Add allowMissingColumns to SparkR unionByName (commit: 7fb9f68) — gurwls223 / githubweb
  3. [SPARK-32189][DOCS][PYTHON] Development - Setting up IDEs (commit: 9c653c9) — gurwls223 / githubweb

#620 (Sep 19, 2020 12:04:11 PM)

  1. [SPARK-32930][CORE] Replace deprecated isFile/isDirectory methods (commit: 7892887) — gurwls223 / githubweb
  2. [SPARK-32911][CORE] Free memory in (commit: 105225d) — wenchen / githubweb
  3. [SPARK-32874][SQL][FOLLOWUP][TEST-HIVE1.2][TEST-HADOOP2.7] Fix (commit: e2a7401) — wenchen / githubweb
  4. [SPARK-32936][SQL] Pass all `external/avro` module UTs in Scala 2.13 (commit: 664a171) — gurwls223 / githubweb
  5. [SPARK-32808][SQL] Pass all test of sql/core module in Scala 2.13 (commit: 2128c4f) — srowen / githubweb
  6. [SPARK-32635][SQL][FOLLOW-UP] Add a new test case in catalyst module (commit: 3309a2b) — dhyun / githubweb
  7. [SPARK-32898][CORE] Fix wrong executorRunTime when task killed before (commit: f1dc479) — dhyun / githubweb

#619 (Sep 18, 2020 1:58:47 AM)

  1. [SPARK-26425][SS] Add more constraint checks to avoid checkpoint (commit: d936cb3) — kabhwan.opensource / githubweb
  2. [SPARK-32903][SQL] GeneratePredicate should be able to eliminate common (commit: bd38e0b) — wenchen / githubweb
  3. [SPARK-32508][SQL] Disallow empty part col values in partition spec (commit: 92b75dc) — wenchen / githubweb
  4. [SPARK-32900][CORE] Allow UnsafeExternalSorter to spill when there are (commit: e5e54a3) — herman / githubweb
  5. [SPARK-32287][CORE] Fix flaky o.a.s.ExecutorAllocationManagerSuite on (commit: a54a6a0) — wenchen / githubweb
  6. [SPARK-24994][SQL][FOLLOW-UP] Handle foldable, timezone and cleanup (commit: 482a79a) — dhyun / githubweb
  7. [SPARK-32887][DOC] Correct the typo for SHOW TABLE (commit: 88e87bc) — dhyun / githubweb
  8. [SPARK-32926][TESTS] Add Scala 2.13 build test in GitHub Action (commit: a8442c2) — dhyun / githubweb
  9. [SPARK-32909][SQL] Pass all `sql/hive-thriftserver` module UTs in Scala (commit: 5817c58) — dhyun / githubweb
  10. [SPARK-32889][SQL] orc table column name supports special characters (commit: ea3b979) — dhyun / githubweb
  11. [SPARK-32635][SQL] Fix foldable propagation (commit: 4ced588) — yamamuro / githubweb
  12. [SPARK-32902][SQL] Logging plan changes for AQE (commit: 68e0d5f) — yamamuro / githubweb
  13. [SPARK-18409][ML][FOLLOWUP] LSH approxNearestNeighbors optimization 2 (commit: 9d6221b) — ruifengz / githubweb
  14. [SPARK-32908][SQL] Fix target error calculation in `percentile_approx()` (commit: 75dd864) — gurwls223 / githubweb
  15. [SPARK-32906][SQL] Struct field names should not change after (commit: b49aaa3) — viirya / githubweb
  16. [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function (commit: 8b09536) — wenchen / githubweb
  17. [SPARK-32905][CORE][YARN] ApplicationMaster fails to receive (commit: 9e9d4b6) — wenchen / githubweb

#618 (Sep 16, 2020 4:00:19 PM)

  1. [SPARK-31448][PYTHON] Fix storage level used in persist() in (commit: 6f36db1) — srowen / githubweb
  2. [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config (commit: 888b343) — wenchen / githubweb
  3. [SPARK-32481][SQL][TESTS][FOLLOW-UP] Skip the test if trash directory (commit: 108c4c8) — gurwls223 / githubweb
  4. [SPARK-32704][SQL][TESTS][FOLLOW-UP] Check any physical rule instead of (commit: b46c730) — gurwls223 / githubweb
  5. [SPARK-32688][SQL][TEST] Add special values to LiteralGenerator for (commit: 6051755) — yamamuro / githubweb
  6. [SPARK-32861][SQL] GenerateExec should require column ordering (commit: 2e3aa2f) — wenchen / githubweb
  7. [SPARK-32888][DOCS] Add user document about header flag and RDD as path (commit: 550c1c9) — gurwls223 / githubweb
  8. [SPARK-32835][PYTHON] Add withField method to the pyspark Column class (commit: e884290) — gurwls223 / githubweb
  9. [SPARK-32814][PYTHON] Replace __metaclass__ field with metaclass keyword (commit: c918909) — gurwls223 / githubweb
  10. [SPARK-32706][SQL] Improve cast string to decimal type (commit: 3bc13e6) — wenchen / githubweb
  11. [SPARK-32804][LAUNCHER][FOLLOWUP] Fix SparkSubmitCommandBuilderSuite (commit: 355ab6a) — gurwls223 / githubweb
  12. [SPARK-32850][CORE] Simplify the RPC message flow of decommission (commit: 56ae950) — wenchen / githubweb
  13. [SPARK-32816][SQL] Fix analyzer bug when aggregating multiple distinct (commit: 40ef5c9) — wenchen / githubweb
  14. [SPARK-32897][PYTHON] Don't show a deprecation warning at (commit: 657e39a) — ueshin / githubweb
  15. [SPARK-32890][SQL] Pass all `sql/hive` module UTs in Scala 2.13 (commit: 7fdb571) — srowen / githubweb

#617 (Sep 15, 2020 6:20:36 AM)

  1. [SPARK-32839][WINDOWS] Make Spark scripts working with the spaces in (commit: 742fcff) — gurwls223 / githubweb
  2. [SPARK-32873][BUILD] Fix code which causes error when build with sbt and (commit: b121f0d) — gurwls223 / githubweb
  3. [SPARK-32854][SS] Minor code and doc improvement for stream-stream join (commit: 978f531) — wenchen / githubweb
  4. [SPARK-32844][SQL] Make `DataFrameReader.table` take the specified (commit: 5e82548) — wenchen / githubweb
  5. [SPARK-32868][SQL] Add more order irrelevant aggregates to (commit: 7a17158) — yamamuro / githubweb
  6. [SPARK-32876][SQL] Change default fallback versions to 3.0.1 and 2.4.7 (commit: 0696f04) — dongjoon / githubweb
  7. [SPARK-32872][CORE] Prevent BytesToBytesMap at MAX_CAPACITY from (commit: 72550c3) — dongjoon / githubweb
  8. [SPARK-32882][K8S] Remove python2 installation in K8s python image (commit: d58a4a3) — dongjoon / githubweb
  9. [SPARK-32871][BUILD] Append toMap to Map#filterKeys if the result of (commit: 4fac6d5) — gurwls223 / githubweb
  10. [SPARK-32715][CORE] Fix memory leak when failed to store pieces of (commit: 7a9b066) — dongjoon / githubweb
  11. [SPARK-32878][CORE] Avoid scheduling TaskSetManager which has no pending (commit: 0811666) — dongjoon / githubweb
  12. [SPARK-32884][TESTS] Mark TPCDSQuery*Suite as ExtendedSQLTest (commit: d8a0d85) — gurwls223 / githubweb
  13. [SPARK-32879][SQL] Refactor SparkSession initial options (commit: c8baab1) — wenchen / githubweb
  14. [SPARK-32738][CORE] Should reduce the number of active threads if fatal (commit: 99384d1) — wenchen / githubweb
  15. [SPARK-32874][SQL][TEST] Enhance result set meta data check for execute (commit: 316242b) — wenchen / githubweb

#616 (Sep 13, 2020 8:37:23 PM)

  1. [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code (commit: 2009f95) — dongjoon / githubweb
  2. [SPARK-32804][LAUNCHER] Fix run-example command builder bug (commit: bbbd907) — srowen / githubweb
  3. [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13 (commit: 3be552c) — srowen / githubweb
  4. [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to (commit: 3d08084) — dongjoon / githubweb
  5. [SPARK-32865][DOC] python section in quickstart page doesn't display (commit: 0549c20) — dongjoon / githubweb
  6. [SPARK-32802][SQL] Avoid using SpecificInternalRow in (commit: a6d6ea3) — dongjoon / githubweb
  7. [SPARK-32869][BUILD] Ignore deprecation warnings for build with Scala (commit: fbb0f37) — gurwls223 / githubweb
  8. [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework (commit: e558b8a) — gurwls223 / githubweb

#615 (Sep 12, 2020 11:07:17 AM)

  1. [MINOR][SQL] Fix a typo at 'spark.sql.sources.fileCompressionFactor' (commit: fe2ab25) — srowen / githubweb
  2. [SPARK-32853][SQL] Consecutive save/load calls in (commit: 9f4f49c) — dongjoon / githubweb
  3. [SPARK-32730][SQL][FOLLOW-UP] Improve LeftAnti SortMergeJoin right side (commit: 94cac59) — wenchen / githubweb
  4. [SPARK-32180][PYTHON][DOCS] Installation page of Getting Started in (commit: f6322d1) — srowen / githubweb
  5. [SPARK-32845][SS][TESTS] Add sinkParameter to check sink options (commit: b4be6a6) — dongjoon / githubweb
  6. [SPARK-32851][SQL][TEST] Tests should fail if errors happen when (commit: 4269c2c) — yamamuro / githubweb
  7. [SPARK-32180][FOLLOWUP] Fix .rst error in new Pyspark installation guide (commit: ce566be) — ueshin / githubweb

#614 (Sep 11, 2020 1:39:06 AM)

  1. [SPARK-32516][SQL][FOLLOWUP] Remove unnecessary check if path string is (commit: ab2fa88) — wenchen / githubweb
  2. [SPARK-32836][SS][TESTS] Fix DataStreamReaderWriterSuite to check writer (commit: 06a9945) — dongjoon / githubweb
  3. [SPARK-32819][SQL] ignoreNullability parameter should be effective (commit: add267c) — wenchen / githubweb
  4. [SPARK-32826][SQL] Set the right column size for the null type in (commit: 9ab8a2c) — wenchen / githubweb
  5. [SPARK-32312][SQL][PYTHON][TEST-JAVA11] Upgrade Apache Arrow to version (commit: e0538bd) — gurwls223 / githubweb
  6. Revert "[SPARK-32772][SQL][FOLLOWUP] Remove legacy silent support mode (commit: 4a09613) — gurwls223 / githubweb
  7. [SPARK-32831][SS] Refactor SupportsStreamingUpdate to represent actual (commit: db89b0e) — kabhwan.opensource / githubweb
  8. [SPARK-32832][SS] Use CaseInsensitiveMap for DataStreamReader/Writer (commit: 2f85f95) — dongjoon / githubweb
  9. [SPARK-32841][BUILD] Use Apache Hadoop 3.2.0 for PyPI and CRAN (commit: dbc4137) — dongjoon / githubweb
  10. [SPARK-32456][SS][FOLLOWUP] Update doc to note about using SQL statement (commit: 8f61005) — wenchen / githubweb
  11. [SPARK-32828][SQL] Cast from a derived user-defined type to a base type (commit: 7eb76d6) — yamamuro / githubweb
  12. [SPARK-32840][SQL] Invalid interval value can happen to be just adhesive (commit: 5669b21) — wenchen / githubweb
  13. [SPARK-32777][SQL] Aggregation support aggregate function with multiple (commit: a22871f) — wenchen / githubweb
  14. [SPARK-32822][SQL] Change the number of partitions to zero when a range (commit: 5f468cc) — yamamuro / githubweb
  15. [SPARK-32677][SQL][DOCS][MINOR] Improve code comment in (commit: 328d81a) — yamamuro / githubweb

#613 (Sep 9, 2020 3:57:25 PM)

  1. [SPARK-32748][SQL] Revert "Support local property propagation in (commit: 55d38a4) — yamamuro / githubweb
  2. [SPARK-31511][FOLLOW-UP][TEST][SQL] Make BytesToBytesMap iterators (commit: bd3dc2f) — wenchen / githubweb
  3. [SPARK-32817][SQL] DPP throws error when broadcast side is empty (commit: e7d9a24) — yamamuro / githubweb
  4. [SPARK-32815][ML] Fix LibSVM data source loading error on file paths (commit: aa87b0a) — wenchen / githubweb
  5. [SPARK-32753][SQL][FOLLOWUP] Fix indentation and clean up view in test (commit: 96ff87d) — gurwls223 / githubweb
  6. [SPARK-32824][CORE] Improve the error message when the user forgets the (commit: e8634d8) — gurwls223 / githubweb
  7. [SPARK-32810][SQL][TESTS][FOLLOWUP] Check path globbing in JSON/CSV (commit: adc8d68) — gurwls223 / githubweb
  8. [SPARK-32823][WEB UI] Fix the master ui resources reporting (commit: 514bf56) — gurwls223 / githubweb
  9. [SPARK-32813][SQL] Get default config of ParquetSource vectorized reader (commit: de0dc52) — gurwls223 / githubweb
  10. [SPARK-32204][SPARK-32182][DOCS][FOLLOW-UP] Use IPython instead of (commit: 794b48c) — gengliang.wang / githubweb
  11. [SPARK-32808][SQL] Fix some test cases of `sql/core` module in scala (commit: 513d51a) — srowen / githubweb
  12. [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have (commit: fc10511) — wenchen / githubweb
  13. [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine (commit: e4237bb) — tathagata.das1565 / githubweb
  14. Revert "[SPARK-32677][SQL] Load function resource before create" (commit: f7995c5) — wenchen / githubweb

#612 (Sep 8, 2020 3:22:05 AM)

  1. [SPARK-32785][SQL] Interval with dangling parts should not results null (commit: de44e9c) — wenchen / githubweb
  2. [SPARK-32677][SQL] Load function resource before create (commit: 05fcf26) — wenchen / githubweb
  3. [SPARK-32779][SQL] Avoid using synchronized API of SessionCatalog in (commit: b0322bf) — gurwls223 / githubweb
  4. [SPARK-32748][SQL] Support local property propagation in (commit: 04f7f6d) — wenchen / githubweb
  5. [SPARK-32753][SQL] Only copy tags to node with no tags (commit: c43460c) — wenchen / githubweb
  6. [SPARK-32798][PYTHON] Make unionByName optionally fill missing columns (commit: 8bd3770) — gurwls223 / githubweb
  7. [SPARK-32810][SQL] CSV/JSON data sources should avoid globbing paths (commit: 954cd9f) — gurwls223 / githubweb
  8. [SPARK-32638][SQL][FOLLOWUP] Move the plan rewriting methods to (commit: 117a6f1) — yamamuro / githubweb
  9. [SPARK-32186][DOCS][PYTHON] Development - Debugging (commit: c336ae3) — gurwls223 / githubweb
  10. [SPARK-32812][PYTHON][TESTS] Avoid initiating a process during the main (commit: c8c082c) — gurwls223 / githubweb
  11. [SPARK-32764][SQL] -0.0 should be equal to 0.0 (commit: 4144b6d) — dongjoon / githubweb
  12. [SPARK-32736][CORE] Avoid caching the removed decommissioned executors (commit: 125cbe3) — wenchen / githubweb

#611 (Sep 6, 2020 2:43:34 PM)

  1. [SPARK-32791][SQL] Non-partitioned table metric should not have dynamic (commit: 0b3bb45) — yumwang / githubweb
  2. [SPARK-32800][SQL] Remove ExpressionSet from the 2.13 branch (commit: f556946) — gurwls223 / githubweb
  3. [SPARK-32548][SQL] - Add Application attemptId support to SQL Rest API (commit: f5360e7) — gengliang.wang / githubweb

#610 (Sep 5, 2020 1:24:03 AM)

  1. [SPARK-32786][SQL][TEST] Improve performance for some slow DPP tests (commit: e693df2) — yamamuro / githubweb
  2. [SPARK-32772][SQL][FOLLOWUP] Remove legacy silent support mode for (commit: f1f7ae4) — yumwang / githubweb
  3. [SPARK-32762][SQL][TEST] Enhance the verification of (commit: 1de272f) — yamamuro / githubweb
  4. [SPARK-32783][DOCS][PYTHON] Development - Testing PySpark (commit: 32d87c2) — gurwls223 / githubweb

#609 (Sep 3, 2020 11:12:27 AM)

  1. [SPARK-32774][BUILD] Don't track docs/.jekyll-cache (commit: 31be672) — gurwls223 / githubweb
  2. [SPARK-32771][DOCS] The example of expressions.Aggregator in Javadoc / (commit: 812d091) — gurwls223 / githubweb
  3. [SPARK-32767][SQL] Bucket join should work if (commit: 54348db) — wenchen / githubweb
  4. [SPARK-32776][SS] Limit in streaming should not be optimized away by (commit: f0851e9) — gurwls223 / githubweb
  5. [SPARK-32400][SQL][TEST][FOLLOWUP][TEST-MAVEN] Fix resource loading (commit: 55ce49e) — gurwls223 / githubweb
  6. [SPARK-31831][SQL][FOLLOWUP] Make the GetCatalogsOperationMock for (commit: 3cde392) — yumwang / githubweb
  7. [SPARK-32756][SQL] Fix CaseInsensitiveMap usage for Scala 2.13 (commit: 7511e43) — srowen / githubweb
  8. [SPARK-32739][SQL] Support prune right for left semi join in DPP (commit: 03afbc8) — yumwang / githubweb
  9. [SPARK-31670][SQL] Trim unnecessary Struct field alias in (commit: 5e6173e) — wenchen / githubweb
  10. [MINOR] Fix usage print to guide pip3 to install jira-python library (commit: c8f56eb) — gurwls223 / githubweb
  11. [SPARK-32077][CORE] Support host-local shuffle data reading when (commit: e6fec33) — dongjoon / githubweb
  12. [SPARK-32772][SQL] Reduce log messages for spark-sql CLI (commit: ad6b887) — dongjoon / githubweb
  13. [SPARK-32781][SQL] Non-ASCII characters are mistakenly omitted in the (commit: 1fba286) — wenchen / githubweb
  14. [SPARK-32782][SS] Refactor StreamingRelationV2 and move it to catalyst (commit: 95f1e95) — gurwls223 / githubweb
  15. [SPARK-32755][SQL] Maintain the order of expressions in AttributeSet and (commit: 0a6043f) — herman / githubweb
  16. [SPARK-32730][SQL] Improve LeftSemi and Existence SortMergeJoin right (commit: ffd5227) — wenchen / githubweb
  17. [SPARK-32638][SQL] Corrects references when adding aliases in (commit: a6114d8) — wenchen / githubweb
  18. [SPARK-32788][SQL] non-partitioned table scan should not have partition (commit: 76330e0) — yumwang / githubweb

#608 (Sep 1, 2020 5:28:48 PM)

  1. [MINOR][DOCS] Fix the Binder link to point the quickstart notebook (commit: eaaf783) — gurwls223 / githubweb
  2. [SPARK-32592][SQL] Make DataFrameReader.table take the specified options (commit: 806140d) — wenchen / githubweb
  3. [SPARK-32721][SQL] Simplify if clauses with null and boolean (commit: 1453a09) — d_tsai / githubweb
  4. [MINOR][R] Fix a R style in try and finally at DataFrame.R (commit: 701e593) — gurwls223 / githubweb
  5. [SPARK-32190][PYTHON][DOCS] Development - Contribution Guide in PySpark (commit: 86ca90c) — gurwls223 / githubweb
  6. [SPARK-32659][SQL][FOLLOWUP] Improve test for pruning DPP on non-atomic (commit: a701bc7) — wenchen / githubweb
  7. [SPARK-32721][SQL][FOLLOWUP] Simplify if clauses with null and boolean (commit: 94d313b) — d_tsai / githubweb
  8. [SPARK-32191][FOLLOW-UP][PYTHON][DOCS] Indent the table and reword the (commit: d80c85c) — gurwls223 / githubweb
  9. [SPARK-32624][SQL][FOLLOWUP] Fix regression in (commit: 6e5bc39) — gurwls223 / githubweb
  10. [SPARK-32757][SQL] Physical InSubqueryExec should be consistent with (commit: d2a5dad) — wenchen / githubweb
  11. [SPARK-32579][SQL] Implement JDBCScan/ScanBuilder/WriteBuilder (commit: e1dbc85) — wenchen / githubweb
  12. [SPARK-32757][SQL][FOLLOW-UP] Use child's output for canonicalization in (commit: fea9360) — wenchen / githubweb
  13. [SPARK-32761][SQL] Allow aggregating multiple foldable distinct (commit: a410658) — wenchen / githubweb
  14. [SPARK-32754][SQL][TEST] Unify to `assertEqualJoinPlans` for join (commit: 2a88a20) — dongjoon / githubweb

#607 (Aug 31, 2020 5:42:37 AM)

  1. [SPARK-32481][CORE][SQL] Support truncate table to move data to trash (commit: 065f173) — dongjoon / githubweb
  2. [SPARK-32733][SQL] Add extended information - (commit: 6dacba7) — gurwls223 / githubweb
  3. [SPARK-32719][PYTHON] Add Flake8 check missing imports (commit: a1e459e) — gurwls223 / githubweb
  4. [SPARK-32740][SQL] Refactor common partitioning/distribution logic to (commit: ce473b2) — yamamuro / githubweb
  5. [SPARK-32138][FOLLOW-UP] Drop obsolete StringIO import branching (commit: 5574734) — gurwls223 / githubweb
  6. [SPARK-32747][R][TESTS] Deduplicate configuration set/unset in (commit: 2491cf1) — gurwls223 / githubweb

#606 (Aug 29, 2020 6:25:34 PM)

  1. [SPARK-32729][SQL][DOCS] Add missing since version for math functions (commit: 0626901) — gurwls223 / githubweb
  2. [SPARK-32704][SQL] Logging plan changes for execution (commit: 0cb91b8) — wenchen / githubweb
  3. [SPARK-32639][SQL] Support GroupType parquet mapkey field (commit: 58f87b3) — wenchen / githubweb
  4. [SPARK-32092][ML][PYSPARK][FOLLOWUP] Fixed CrossValidatorModel.copy() to (commit: a0bd273) — huaxing / githubweb
  5. [SPARK-32718][SQL] Remove unnecessary keywords for interval units (commit: ccc0250) — dongjoon / githubweb
  6. [SPARK-32629][SQL] Track metrics of BitSet/OpenHashSet in full outer SHJ (commit: cfe012a) — yamamuro / githubweb

#605 (Aug 28, 2020 7:25:49 AM)

  1. [SPARK-32516][SQL][FOLLOWUP] 'path' option cannot coexist with path (commit: baaa756) — wenchen / githubweb
  2. [SPARK-32705][SQL] Fix serialization issue for EmptyHashedRelation (commit: eb37976) — wenchen / githubweb
  3. [SPARK-32696][SQL][TEST-HIVE1.2][TEST-HADOOP2.7] Get columns operation (commit: f14f374) — wenchen / githubweb
  4. [SPARK-30654] Bootstrap4 docs upgrade (commit: ed51a7f) — srowen / githubweb
  5. [SPARK-32701][CORE][DOCS] (commit: 8749b2b) — srowen / githubweb
  6. [SPARK-32713][K8S] Support execId placeholder in executor PVC conf (commit: 182727d) — dongjoon / githubweb
  7. [SPARK-32693][SQL] Compare two dataframes with same schema except (commit: d6c095c) — yamamuro / githubweb
  8. [SPARK-32183][DOCS][PYTHON] User Guide - PySpark Usage Guide for Pandas (commit: c154629) — gurwls223 / githubweb
  9. [SPARK-28612][SQL][FOLLOWUP] Correct method doc of (commit: 73bfed3) — gurwls223 / githubweb
  10. [SPARK-32722][PYTHON][DOCS] Update document type conversion for Pandas (commit: 5775073) — gurwls223 / githubweb
  11. [SPARK-32717][SQL] Add a AQEOptimizer for AdaptiveSparkPlanExec (commit: c3b9404) — gurwls223 / githubweb

#604 (Aug 26, 2020 8:15:43 PM)

  1. [SPARK-32620][SQL] Reset the numPartitions metric when DPP is enabled (commit: 1354cf0) — wgyumg / githubweb
  2. [SPARK-32204][SPARK-32182][DOCS] Add a quickstart page with Binder (commit: b541030) — gurwls223 / githubweb
  3. [SPARK-32695][INFRA] Explicitly cache and hash 'build' directly in (commit: b07e742) — gurwls223 / githubweb
  4. [SPARK-32466][FOLLOW-UP][TEST][SQL] Regenerate the golden explain file (commit: f510d21) — gurwls223 / githubweb
  5. [SPARK-32481][CORE][SQL] Support truncate table to move data to trash (commit: 5c077f0) — dongjoon / githubweb
  6. [SPARK-32659][SQL] Fix the data issue when pruning DPP on non-atomic (commit: a8b5688) — wenchen / githubweb
  7. [MINOR][PYTHON] Fix typo in a docsting of RDD.toDF (commit: d330426) — dongjoon / githubweb
  8. Revert "[SPARK-32481][CORE][SQL] Support truncate table to move data to (commit: 2dee435) — dongjoon / githubweb
  9. [SPARK-32643][CORE][K8S] Consolidate state decommissioning in the (commit: b786f31) — hkarau / githubweb

#603 (Aug 25, 2020 9:07:59 AM)

  1. [SPARK-32352][SQL][FOLLOW-UP][TEST-HADOOP2.7][TEST-HIVE1.2] Exclude (commit: 11c6a23) — yamamuro / githubweb
  2. [SPARK-32649][SQL] Optimize BHJ/SHJ inner/semi join with empty hashed (commit: 08b951b) — wenchen / githubweb
  3. [SPARK-32588][CORE][TEST] Fix SizeEstimator initialization in tests (commit: bc23bb7) — srowen / githubweb
  4. [SPARK-32516][SQL] 'path' option cannot coexist with load()'s path (commit: e3a88a9) — wenchen / githubweb
  5. [SPARK-32686][PYTHON] Un-deprecate inferring DataFrame schema from list (commit: 41cf1d0) — cutlerb / githubweb
  6. [SPARK-32550][SQL][FOLLOWUP] Eliminate negative impact on (commit: a30bb0c) — gurwls223 / githubweb
  7. [MINOR][SQL] Add missing documentation for LongType mapping (commit: 3eee915) — gurwls223 / githubweb
  8. [SPARK-31608][CORE][WEBUI][TEST] Add test suites for HybridStore and (commit: 9151a58) — kabhwan.opensource / githubweb
  9. [SPARK-31000][PYTHON][SQL] Add ability to set table description via (commit: f540031) — gurwls223 / githubweb
  10. [SPARK-32646][SQL][TEST-HADOOP2.7][TEST-HIVE1.2] ORC predicate pushdown (commit: cee48a9) — gurwls223 / githubweb
  11. [SPARK-32641][SQL] withField + getField should return null if original (commit: 3f1e56d) — wenchen / githubweb
  12. Revert "[SPARK-32412][SQL] Unify error handling for spark thrift serv… (commit: c26a976) — wenchen / githubweb
  13. [SPARK-32466][SQL][FOLLOW-UP] Normalize Location info in explain plan (commit: b78b776) — gurwls223 / githubweb
  14. [SPARK-32683][DOCS][SQL] Fix doc error and add migration guide for (commit: 1f3bb51) — wenchen / githubweb
  15. [SPARK-32664][CORE] Switch the log level from info to debug at (commit: a3179a7) — gurwls223 / githubweb
  16. [SPARK-32287][TESTS][FOLLOWUP] Add debugging for flaky (commit: 2feab4e) — gurwls223 / githubweb
  17. [SPARK-32614][SQL] Don't apply comment processing if 'comment' unset for (commit: a9d4e60) — gurwls223 / githubweb

#602 (Aug 23, 2020 9:53:05 PM)

  1. [MINOR] Typo in ShuffleMapStage.scala (commit: a4d785d) — srowen / githubweb
  2. [SPARK-32678][SQL] Rename EmptyHashedRelationWithAllNullKeys and (commit: f258718) — viirya / githubweb
  3. Revert "[SPARK-32646][SQL] ORC predicate pushdown should work with (commit: aa0b0b8) — viirya / githubweb
  4. [SPARK-32608][SQL][FOLLOW-UP][TEST-HADOOP2.7][TEST-HIVE1.2] Script (commit: 9808c15) — viirya / githubweb
  5. [SPARK-32594][SQL][FOLLOWUP][TEST-HADOOP2.7][TEST-HIVE1.2] Override (commit: 1c798f9) — viirya / githubweb
  6. [SPARK-32676][3.0][ML] Fix double caching in KMeans/BiKMeans (commit: ac520d4) — srowen / githubweb
  7. [SPARK-32648][SS] Remove unused DELETE_ACTION in FileStreamSinkLog (commit: 772c706) — dongjoon / githubweb
  8. [SPARK-32675][MESOS] --py-files option is appended without passing value (commit: 8749f2e) — dongjoon / githubweb
  9. [SPARK-32609][TEST] Add Tests for Incorrect exchange reuse with (commit: b9585cd) — dongjoon / githubweb
  10. [SPARK-32552][SQL][DOCS] Complete the documentation for Table-valued (commit: db74fd0) — yamamuro / githubweb

#601 (Aug 22, 2020 10:50:58 AM)

  1. [SPARK-32667][SQL] Script transform 'default-serde' mode should pad null (commit: c75a827) — wenchen / githubweb
  2. [SPARK-32674][DOC] Add suggestion for parallel directory listing in (commit: bf221de) — gurwls223 / githubweb
  3. [SPARK-32646][SQL] ORC predicate pushdown should work with (commit: e277ef1) — wenchen / githubweb
  4. [SPARK-32682][INFRA] Use workflow_dispatch to enable manual test (commit: 6dd37cb) — yamamuro / githubweb
  5. [SPARK-32669][SQL][TEST] Expression unit tests should explore all cases (commit: 3dca81e) — yamamuro / githubweb
  6. [MINOR][DOCS] fix typo for docs,log message and comments (commit: 1450b5e) — yamamuro / githubweb
  7. [SPARK-32662][ML] CountVectorizerModel: Remove requirement for minimum (commit: 1fd54f4) — huaxing / githubweb
  8. [SPARK-32672][SQL] Fix data corruption in boolean bit set compression (commit: 12f4331) — gurwls223 / githubweb
  9. [SPARK-31792][SS][DOC][FOLLOW-UP] Rephrase the description for some (commit: 8b26c69) — kabhwan.opensource / githubweb
  10. [SPARK-32526][SQL] Pass all test of sql/catalyst module in Scala 2.13 (commit: 25c7d0f) — srowen / githubweb
  11. [SPARK-32092][ML][PYSPARK] Fix parameters not being copied in (commit: d9eb06e) — srowen / githubweb

#600 (Aug 20, 2020 11:20:31 PM)

  1. [SPARK-32657][K8S] Update the log strings we check for & imports in (commit: 059fb65) — dongjoon / githubweb
  2. [SPARK-31999][SQL][FOLLOWUP] Adds negative test cases with typos (commit: 7048fff) — wenchen / githubweb
  3. [SPARK-32658][CORE] Fix `PartitionWriterStream` partition length (commit: f793977) — wenchen / githubweb
  4. [SPARK-30462][SS] Streamline the logic on file stream source and sink (commit: e6795cd) — dongjoon / githubweb
  5. [SPARK-32653][CORE] Decommissioned host/executor should be considered as (commit: 44a288f) — wenchen / githubweb
  6. [SPARK-32607][SQL] Script Transformation ROW FORMAT DELIMITED (commit: 6dae11d) — wenchen / githubweb
  7. [SPARK-32665][SQL][TEST] Deletes orphan directories under a warehouse (commit: d80d0ce) — dongjoon / githubweb
  8. [SPARK-28863][SQL][FOLLOWUP] Do not reuse the physical plan (commit: d378dc5) — wenchen / githubweb
  9. [SPARK-32640][SQL] Downgrade Janino to fix a correctness bug (commit: 8b119f1) — dongjoon / githubweb
  10. [SPARK-32660][SQL][DOC] Show Avro related API in documentation (commit: de141a3) — gengliang.wang / githubweb
  11. [SPARK-32663][CORE] Avoid individual closing of pooled TransportClients (commit: 79b4dea) — mridulatgmail.com / githubweb

#599 (Aug 19, 2020 1:18:14 PM)

  1. [SPARK-21040][CORE][FOLLOW-UP] Only calculate executorKillTime when (commit: 70964e7) — wenchen / githubweb
  2. [SPARK-32645][INFRA] Upload unit-tests.log as an artifact (commit: bfd8c34) — gurwls223 / githubweb
  3. [SPARK-32018][FOLLOWUP][DOC] Add migration guide for decimal value (commit: 1b39215) — gengliang.wang / githubweb
  4. [SPARK-32652][SQL] ObjectSerializerPruning fails for RowEncoder (commit: f33b64a) — gurwls223 / githubweb
  5. [MINOR][DOCS] Add KMeansSummary and InheritableThread to documentation (commit: 891c5e6) — gurwls223 / githubweb
  6. [SPARK-32550][SQL] Make SpecificInternalRow constructors faster by using (commit: e15ae60) — gurwls223 / githubweb
  7. [SPARK-32651][CORE] Decommission switch configuration should have the (commit: 3092527) — wenchen / githubweb
  8. [SPARK-32608][SQL] Script Transform ROW FORMAT DELIMIT value should (commit: 03e2de9) — wenchen / githubweb
  9. [SPARK-32600][CORE] Unify task name in some logs between driver and (commit: a1a32d2) — wenchen / githubweb
  10. [SPARK-32624][SQL] Use getCanonicalName to fix byte[] compile issue (commit: 409fea3) — wgyumg / githubweb
  11. [SPARK-32621][SQL] 'path' option can cause issues while inferring schema (commit: 3d1dce7) — wenchen / githubweb
  12. [SPARK-28863][SQL] Introduce AlreadyPlanned to prevent reanalysis of (commit: 278d0dd) — wenchen / githubweb
  13. [SPARK-32655][K8S] Support appId/execId placeholder in K8s (commit: 3722ed4) — dongjoon / githubweb

#598 (Aug 18, 2020 4:02:11 AM)

  1. Revert "[SPARK-32511][SQL] Add dropFields method to Column class" (commit: b94c67b) — wenchen / githubweb
  2. [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan (commit: 9f2893c) — wenchen / githubweb
  3. [SPARK-32615][SQL] Fix AQE aggregateMetrics (commit: 108b1dc) — wenchen / githubweb
  4. [SPARK-32606][SPARK-32605][INFRA] Remove the forks of (commit: 86852c5) — dongjoon / githubweb
  5. [SPARK-32622][SQL][TEST] Add case-sensitivity test for ORC predicate (commit: b33066f) — dongjoon / githubweb
  6. [SPARK-32613][CORE] Fix regressions in DecommissionWorkerSuite (commit: 1ac23de) — wenchen / githubweb
  7. [SPARK-32119][FOLLOWUP][DOC] Update monitoring doc following the (commit: 21e0dd0) — sarutak / githubweb
  8. [MINOR][INFRA] Rename master.yml to build_and_test.yml (commit: d0dfe49) — gengliang.wang / githubweb
  9. [SPARK-32647][INFRA] Report SparkR test results with JUnit reporter (commit: babb654) — gurwls223 / githubweb

#597 (Aug 16, 2020 7:03:18 PM)

  1. [SPARK-32625][SQL] Log error message when falling back to interpreter (commit: c280c7f) — dongjoon / githubweb
  2. [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in (commit: 9a79bbc) — srowen / githubweb
  3. [SPARK-32399][SQL] Full outer shuffled hash join (commit: 8f0fef1) — yamamuro / githubweb

#596 (Aug 15, 2020 10:09:57 AM)

  1. [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub (commit: 5debde9) — dongjoon / githubweb
  2. [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl (commit: 339eec5) — wenchen / githubweb
  3. [SPARK-32590][SQL] Remove fullOutput from RowDataSourceScanExec (commit: 14003d4) — wenchen / githubweb
  4. [MINOR][SQL] Fixed approx_count_distinct rsd param description (commit: 10edeaf) — yamamuro / githubweb
  5. [SPARK-32616][SQL] Window operators should be added determinedly (commit: c6be207) — wenchen / githubweb
  6. [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster (commit: 1a4c8f7) — mridulatgmail.com / githubweb

#595 (Aug 13, 2020 10:17:32 AM)

  1. [SPARK-31703][SQL] Parquet RLE float/double are read incorrectly on big (commit: a418548) — wenchen / githubweb
  2. [SPARK-32599][SQL][TESTS] Check the TEXTFILE file format in (commit: f664aaa) — gurwls223 / githubweb
  3. [SPARK-32250][SPARK-27510][CORE][TEST] Fix flaky MasterSuite.test(...) (commit: c6ea983) — gurwls223 / githubweb
  4. [SPARK-32352][SQL] Partially push down support data filter if it mixed (commit: 643cd87) — wenchen / githubweb
  5. [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2 (commit: 60fa8e3) — wenchen / githubweb
  6. [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic (commit: 548ac7c) — hkarau / githubweb
  7. [MINOR] Update URL of the parquet project in code comment (commit: 08d86eb) — gurwls223 / githubweb
  8. [SPARK-32511][SQL] Add dropFields method to Column class (commit: 0c850c7) — wenchen / githubweb
  9. [SPARK-32526][SQL] Fix some test cases of `sql/catalyst` module in scala (commit: 6ae2cb2) — srowen / githubweb

#594 (Aug 11, 2020 11:26:07 PM)

  1. [SPARK-32216][SQL] Remove redundant ProjectExec (commit: 1b7443b) — wenchen / githubweb
  2. [SPARK-32584][PYTHON][DOCS] Exclude _images and _sources that are (commit: 9dec677) — gurwls223 / githubweb
  3. [SPARK-32573][SQL] Anti Join Improvement with EmptyHashedRelation and (commit: c37357a) — wenchen / githubweb
  4. [SPARK-32470][CORE] Remove task result size check for shuffle map stage (commit: 9587277) — wenchen / githubweb
  5. [SPARK-32540][SQL] Eliminate the filter clause in aggregate (commit: e7c1204) — wenchen / githubweb
  6. [SPARK-32586][SQL] Fix NumberFormatException error message when ansi is (commit: 5d130f0) — gurwls223 / githubweb
  7. [SPARK-32594][SQL] Fix serialization of dates inserted to Hive tables (commit: 0477d23) — gurwls223 / githubweb
  8. [SPARK-32596][CORE] Clear Ivy resolution files as part of finally block (commit: 2d6eb00) — mridulatgmail.com / githubweb
  9. [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec (commit: 4cf8c1d) — wenchen / githubweb

#593 (Aug 10, 2020 10:26:44 AM)

  1. [SPARK-32462][WEBUI] Reset previous search text for datatable (commit: 34d9f1c) — dongjoon / githubweb
  2. [SPARK-32557][CORE] Logging and swallowing the exception per entry in (commit: cf37cd5) — dongjoon / githubweb
  3. [SPARK-32393][SQL][TEST] Add tests for all the character types in (commit: b2c45f7) — dongjoon / githubweb
  4. [SPARK-32576][SQL] Support PostgreSQL `bpchar` type and array of char (commit: 0ae94ad) — dongjoon / githubweb
  5. [SPARK-32575][CORE][TESTS] Bump up timeouts in (commit: 34c61b9) — dongjoon / githubweb
  6. [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond (commit: d08e73d) — dongjoon / githubweb
  7. [SPARK-32337][SQL] Show initial plan in AQE plan tree string (commit: 924c161) — wenchen / githubweb
  8. [SPARK-32456][SS] Check the Distinct by assuming it as Aggregate for (commit: b03761e) — gurwls223 / githubweb
  9. [SPARK-32191][PYTHON][DOCS] Port migration guide for PySpark docs (commit: f9f992e) — gurwls223 / githubweb
  10. [MINOR] add test_createDataFrame_empty_partition in pyspark arrow tests (commit: fc62d72) — gurwls223 / githubweb
  11. [SPARK-32576][SQL][TEST][FOLLOWUP] Add tests for all the character array (commit: 7990ea1) — yamamuro / githubweb
  12. [SPARK-32554][K8S][DOCS] Remove the words "experimental" in the k8s (commit: bf4ac3b) — dongjoon / githubweb
  13. [SPARK-32537][SQL][TEST] Add a CTEHintSuite for test coverage (commit: f80a480) — wenchen / githubweb
  14. [SPARK-32517][CORE] Add StorageLevel.DISK_ONLY_3 (commit: b421bf0) — dongjoon / githubweb
  15. [SPARK-32409][DOC] Document dependency between (commit: 99f50c6) — dongjoon / githubweb
  16. [SPARK-32403][SQL] Refactor current ScriptTransformationExec (commit: d251443) — wenchen / githubweb
  17. [SPARK-32469][SQL] ApplyColumnarRulesAndInsertTransitions should be (commit: 8659ec5) — wenchen / githubweb

#592 (Aug 8, 2020 8:28:17 PM)

  1. [SPARK-25557][SQL] Nested column predicate pushdown for ORC (commit: 7b6e1d5) — dongjoon / githubweb
  2. [SPARK-32564][SQL][TEST] Inject data statistics to simulate plan (commit: 5b8444a) — dongjoon / githubweb
  3. [SPARK-32568][BUILD][SS] Upgrade Kafka to 2.6.0 (commit: eb74d55) — gurwls223 / githubweb
  4. [SPARK-32319][PYSPARK] Disallow the use of unused imports (commit: 9fcf0ea) — dongjoon / githubweb
  5. [MINOR][DOCS] Fix typos at ExecutorAllocationManager.scala (commit: dc3fac8) — dongjoon / githubweb
  6. [SPARK-32555][SQL] Add unique ID on query execution (commit: 8062c1f) — dongjoon / githubweb
  7. [SPARK-32564][SQL][TEST][FOLLOWUP] Re-enable TPCDSQuerySuite with empty (commit: 1df855b) — dongjoon / githubweb

#591 (Aug 7, 2020 7:31:26 AM)

  1. [SPARK-32518][CORE] CoarseGrainedSchedulerBackend.maxNumConcurrentTasks (commit: 7f275ee) — wenchen / githubweb
  2. [SPARK-32539][INFRA] Disallow `FileSystem.get(Configuration conf)` in (commit: e93b8f0) — wenchen / githubweb
  3. [SPARK-32546][SQL] Get table names directly from Hive tables (commit: dc96f2f) — wenchen / githubweb
  4. [SPARK-32546][SQL][FOLLOWUP] Add `.toSeq` to `tableNames` in (commit: 6664e28) — wenchen / githubweb
  5. [SPARK-32506][TESTS] Flaky test: StreamingLinearRegressionWithTests (commit: 75c2c53) — huaxing / githubweb
  6. [SPARK-32538][CORE][TEST] Use local time zone for the timestamp logged (commit: 4e267f3) — yamamuro / githubweb
  7. [SPARK-32549][PYSPARK] Add column name in _infer_schema error message (commit: 2cb48ea) — gurwls223 / githubweb
  8. [SPARK-32559][SQL] Fix the trim logic in UTF8String.toInt/toLong did't (commit: 9a35b93) — wenchen / githubweb
  9. [SPARK-32560][SQL] Improve exception message at (commit: aa4d3c1) — gurwls223 / githubweb
  10. [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is (commit: d5682c1) — wenchen / githubweb
  11. [SPARK-32556][INFRA] Fix release script to have urlencoded passwords (commit: 6c3d0a4) — prashant / githubweb

#590 (Aug 5, 2020 6:17:48 PM)

  1. [SPARK-32507][DOCS][PYTHON] Add main page for PySpark documentation (commit: 15b7333) — gurwls223 / githubweb
  2. [SPARK-32402][SQL] Implement ALTER TABLE in JDBC Table Catalog (commit: b14a1e2) — wenchen / githubweb
  3. [SPARK-32501][SQL] Convert null to "null" in structs, maps and arrays (commit: 3a437ed) — wenchen / githubweb
  4. [SPARK-32492][SQL][FOLLOWUP][TEST-MAVEN] Fix jenkins maven jobs (commit: 1b6f482) — wenchen / githubweb
  5. [SPARK-32485][SQL][TEST] Fix endianness issues in tests in (commit: 4a0427c) — wenchen / githubweb
  6. [SPARK-32543][R] Remove arrow::as_tibble usage in SparkR (commit: 42219af) — dongjoon / githubweb
  7. [SPARK-32529][CORE] Fix Historyserver log scan aborted by application (commit: c1d17df) — dongjoon / githubweb
  8. [SPARK-31197][CORE] Shutdown executor once we are done decommissioning (commit: 375d348) — hkarau / githubweb

#589 (Aug 4, 2020 3:22:37 PM)

  1. [SPARK-23431][CORE] Expose stage level peak executor metrics via REST (commit: 171b7d5) — gengliang.wang / githubweb
  2. [SPARK-32499][SQL] Use `{}` in conversions maps and structs to strings (commit: 7eb6f45) — wenchen / githubweb
  3. [SPARK-32525][DOCS] The layout of monitoring.html is broken (commit: 0660a05) — gengliang.wang / githubweb

#588 (Aug 4, 2020 5:36:26 AM)

  1. [SPARK-32490][BUILD] Upgrade netty-all to 4.1.51.Final (commit: 0693d8b) — dongjoon / githubweb
  2. [SPARK-32274][SQL] Make SQL cache serialization pluggable (commit: 713124d) — wenchen / githubweb
  3. [SPARK-32510][SQL] Check duplicate nested columns in read from JDBC (commit: fda397d) — wenchen / githubweb
  4. [SPARK-32509][SQL] Ignore unused DPP True Filter in Canonicalization (commit: 7a09e71) — wenchen / githubweb
  5. [SPARK-24884][SQL] Support regexp function regexp_extract_all (commit: 42f9ee4) — wenchen / githubweb
  6. [SPARK-31709][SQL] Proper base path for database/table location when it (commit: 3deb59d) — wenchen / githubweb
  7. [SPARK-32492][SQL] Fulfill missing column meta information COLUMN_SIZE (commit: 7f5326c) — wenchen / githubweb
  8. [SPARK-32257][SQL] Reports explicit errors for invalid usage of (commit: c6109ba) — wenchen / githubweb
  9. [SPARK-32310][ML][PYSPARK] ML params default value parity in feature and (commit: bc78859) — huaxing / githubweb
  10. [SPARK-32290][SQL][FOLLOWUP] Add version for the SQL config (commit: f3b10f5) — wenchen / githubweb
  11. [MINOR][SQL] Fix versions in the SQL migration guide for Spark 3.1 (commit: 9bbe8c7) — gurwls223 / githubweb
  12. [SPARK-32160][CORE][PYSPARK][FOLLOWUP] Change the config name to switch (commit: 7deb67c) — gurwls223 / githubweb
  13. [SPARK-30276][SQL] Support Filter expression allows simultaneous use of (commit: 1597d8f) — wenchen / githubweb
  14. [SPARK-32468][SS][TESTS][FOLLOWUP] Provide "default.api.timeout.ms" as (commit: 005ef3a) — gurwls223 / githubweb
  15. [SPARK-32524][SQL][TESTS] CachedBatchSerializerSuite should clean up (commit: 7fec6e0) — gurwls223 / githubweb
  16. [SPARK-32521][SQL] Bug-fix: WithFields Expression should not be foldable (commit: 6d69068) — wenchen / githubweb

#587 (Aug 2, 2020 9:14:36 AM)

  1. [SPARK-32467][UI] Avoid encoding URL twice on https redirect (commit: 71aea02) — gengliang.wang / githubweb

#586 (Jul 31, 2020 2:10:20 PM)

  1. Revert "[SPARK-31525][SQL] Return an empty list for df.head() when df is (commit: 5491c08) — gurwls223 / githubweb
  2. [SPARK-32471][SQL][DOCS][TESTS][PYTHON][SS] Describe JSON option (commit: b2180c0) — gurwls223 / githubweb
  3. [SPARK-32401][SQL] Migrate function related commands to use (commit: 45b7212) — wenchen / githubweb
  4. [SPARK-32283][CORE] Kryo should support multiple user registrators (commit: 26e6574) — wenchen / githubweb
  5. [SPARK-32473][CORE][TESTS] Use === instead IndexSeqView (commit: 77987a2) — dongjoon / githubweb
  6. [SPARK-32175][CORE] Fix the order between initialization for (commit: 9be0883) — tgraves / githubweb
  7. [SPARK-32477][CORE] JsonProtocol.accumulablesToJson should be (commit: 5eab8d2) — dongjoon / githubweb
  8. [SPARK-32449][ML][PYSPARK] Add summary to (commit: 40e6a5b) — srowen / githubweb
  9. [SPARK-32346][SQL] Support filters pushdown in Avro datasource (commit: d897825) — gengliang.wang / githubweb
  10. [SPARK-32476][CORE] ResourceAllocator.availableAddrs should be (commit: 9dc0237) — dongjoon / githubweb
  11. [SPARK-30322][DOCS] Add stage level scheduling docs (commit: e926d41) — tgraves / githubweb
  12. [SPARK-32332][SQL] Support columnar exchanges (commit: a025a89) — tgraves / githubweb
  13. [SPARK-32397][BUILD] Allow specifying of time for build to keep time (commit: 50911df) — d_tsai / githubweb
  14. [SPARK-32487][CORE] Remove j.w.r.NotFoundException from `import` in (commit: 1638674) — dongjoon / githubweb
  15. [SPARK-32248][BUILD] Recover Java 11 build in Github Actions (commit: 08a66f8) — dongjoon / githubweb
  16. [SPARK-32010][PYTHON][CORE] Add InheritableThread for local properties (commit: 89d9b7c) — gurwls223 / githubweb
  17. [SPARK-32455][ML] LogisticRegressionModel prediction optimization (commit: 81b0785) — huaxing / githubweb
  18. [SPARK-32431][SQL] Check duplicate nested columns in read from in-built (commit: 99a8555) — wenchen / githubweb
  19. [SPARK-32478][R][SQL] Error message to show the schema mismatch in (commit: e1d7321) — gurwls223 / githubweb
  20. [SPARK-32412][SQL] Unify error handling for spark thrift server (commit: 510a165) — wenchen / githubweb
  21. [SPARK-32488][SQL] Use @parser::members and @lexer::members to avoid (commit: 30e3042) — wenchen / githubweb
  22. [SPARK-32491][INFRA] Do not install SparkR in test-only mode in testing (commit: 1f7fe54) — gurwls223 / githubweb
  23. [SPARK-32493][INFRA] Manually install R instead of using setup-r in (commit: e0c8bd0) — gurwls223 / githubweb
  24. [SPARK-32496][INFRA] Include GitHub Action file as the changes in (commit: 12f443c) — gurwls223 / githubweb
  25. [SPARK-32227] Fix regression bug in load-spark-env.cmd with Spark 3.0.0 (commit: 7437720) — gurwls223 / githubweb
  26. [SPARK-32497][INFRA] Installs qpdf package for CRAN check in GitHub (commit: 32f4ef0) — gurwls223 / githubweb
  27. [SPARK-32489][CORE] Pass `core` module UTs in Scala 2.13 (commit: 7cf3b54) — dongjoon / githubweb
  28. [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning (commit: 366a178) — hkarau / githubweb
  29. [SPARK-32417] Fix flakyness of BlockManagerDecommissionIntegrationSuite (commit: 6032c5b) — hkarau / githubweb
  30. [SPARK-32175][SPARK-32175][FOLLOWUP] Remove flaky test added in (commit: 9d7b1d9) — sarutak / githubweb
  31. [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to (commit: f602782) — kabhwan.opensource / githubweb
  32. [SPARK-32421][SQL] Add code-gen for shuffled hash join (commit: ae82768) — wenchen / githubweb
  33. [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector (commit: 813532d) — kabhwan.opensource / githubweb
  34. [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to (commit: 8014b0b) — gurwls223 / githubweb
  35. [SPARK-32406][SQL][FOLLOWUP] Make RESET fail against static and core (commit: f480040) — gurwls223 / githubweb
  36. [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id (commit: 4eaf3a0) — gurwls223 / githubweb
  37. [SPARK-31894][SS][FOLLOW-UP] Rephrase the config doc (commit: 354313b) — wenchen / githubweb
  38. [SPARK-32083][SQL] AQE coalesce should at least return one partition (commit: 1c6dff7) — wenchen / githubweb

#583 (Jul 28, 2020 3:42:11 PM)

  1. [SPARK-32434][CORE][FOLLOW-UP] Fix load-spark-env.cmd to be able to run (commit: ea58e52) — gurwls223 / githubweb
  2. [SPARK-32420][SQL] Add handling for unique key in non-codegen hash join (commit: 548b7db) — wenchen / githubweb
  3. [SPARK-32424][SQL] Fix silent data change for timestamp parsing if (commit: d315ebf) — wenchen / githubweb
  4. [SPARK-32443][CORE] Use POSIX-compatible `command -v` in (commit: c114066) — dongjoon / githubweb
  5. [SPARK-32457][ML] logParam thresholds in DT/GBT/FM/LR/MLP (commit: f7542d3) — huaxing / githubweb
  6. [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs (commit: 8de4333) — yamamuro / githubweb
  7. [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans (commit: 8323c8e) — yamamuro / githubweb
  8. [MINOR][PYTHON] Fix spacing in error message (commit: 77f2ca6) — gurwls223 / githubweb
  9. [SPARK-31525][SQL] Return an empty list for df.head() when df is empty (commit: 44a5258) — gurwls223 / githubweb
  10. [SPARK-32290][SQL] SingleColumn Null Aware Anti Join Optimize (commit: 12b9787) — wenchen / githubweb
  11. [SPARK-32459][SQL] Support WrappedArray as customCollectionCls in (commit: ca1ecf7) — wenchen / githubweb
  12. [SPARK-32382][SQL] Override table renaming in JDBC dialects (commit: c28da67) — wenchen / githubweb
  13. [SPARK-32339][ML][DOC] Improve MLlib BLAS native acceleration docs (commit: 44c868b) — huaxing / githubweb
  14. [SPARK-32458][SQL][TESTS] Fix incorrectly sized row value reads (commit: a3d8056) — dongjoon / githubweb

#582 (Jul 27, 2020 6:16:46 AM)

  1. [SPARK-32441][BUILD][CORE] Update json4s to 3.7.0-M5 for Scala 2.13 (commit: 83ffef7) — dongjoon / githubweb
  2. [SPARK-32428][EXAMPLES] Make BinaryClassificationMetricsExample cons… (commit: 86ead04) — srowen / githubweb
  3. [SPARK-32442][CORE][TESTS] Fix TaskSetManagerSuite by hiding (commit: 7e0c5b3) — dongjoon / githubweb
  4. [SPARK-32447][CORE] Use python3 by default in pyspark and (commit: 4f79b9f) — dongjoon / githubweb
  5. [SPARK-32450][PYTHON] Upgrade pycodestyle to v2.6.0 (commit: 70ac594) — gurwls223 / githubweb
  6. [SPARK-32451][R] Support Apache Arrow 1.0.0 (commit: 8153f56) — dongjoon / githubweb
  7. [SPARK-32448][K8S][TESTS] Use single version for (commit: 13c64c2) — dongjoon / githubweb
  8. [SPARK-32383][SQL] Preserve hash join (BHJ and SHJ) stream side ordering (commit: 01cf8a4) — wenchen / githubweb
  9. [SPARK-32452][R][SQL] Bump up the minimum Arrow version as 1.0.0 in (commit: bfa5d57) — gurwls223 / githubweb
  10. [SPARK-32234][FOLLOWUP][SQL] Update the description of utility method (commit: 99f33ec) — wenchen / githubweb
  11. [SPARK-32179][SPARK-32188][PYTHON][DOCS] Replace and redesign the (commit: 6ab29b3) — gurwls223 / githubweb
  12. [SPARK-32435][PYTHON] Remove heapq3 port from Python 3 (commit: a82aee0) — gurwls223 / githubweb
  13. [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap (commit: 998086c) — tgraves / githubweb

#581 (Jul 25, 2020 6:10:30 PM)

  1. [SPARK-32375][SQL] Basic functionality of table catalog v2 for JDBC (commit: 8bc799f) — wenchen / githubweb
  2. [SPARK-32408][BUILD] Enable crossPaths back to prevent side effects (commit: fa184c3) — dongjoon / githubweb
  3. [SPARK-32406][SQL] Make RESET syntax support single configuration reset (commit: d3596c0) — dongjoon / githubweb
  4. [SPARK-32430][SQL] Extend SparkSessionExtensions to inject rules into (commit: 64a01c0) — dongjoon / githubweb
  5. [SPARK-32287][TESTS] Flaky Test: ExecutorAllocationManagerSuite.add (commit: e6ef27b) — dongjoon / githubweb
  6. [SPARK-32387][SS] Extract UninterruptibleThread runner logic from (commit: b890fdc) — dongjoon / githubweb
  7. [SPARK-32419][PYTHON][BUILD] Avoid using subshell for Conda env (commit: 8e36a8f) — gurwls223 / githubweb
  8. [SPARK-32422][SQL][TESTS] Use python3 executable instead of python3.6 in (commit: 277a406) — dongjoon / githubweb
  9. [SPARK-32426][SQL] ui shows sql after variable substitution (commit: be9f03d) — dongjoon / githubweb
  10. [SPARK-32437][CORE] Improve MapStatus deserialization speed with (commit: f642234) — dongjoon / githubweb
  11. [SPARK-32434][CORE] Support Scala 2.13 in AbstractCommandBuilder and (commit: aab1e09) — dongjoon / githubweb
  12. [SPARK-32436][CORE] Initialize numNonEmptyBlocks in (commit: f9f1867) — dongjoon / githubweb
  13. [SPARK-32438][CORE][TESTS] Use HashMap.withDefaultValue in RDDSuite (commit: 80e8898) — dongjoon / githubweb
  14. [SPARK-32437][CORE][FOLLOWUP] Update dependency manifest for (commit: d1301af) — dongjoon / githubweb
  15. [SPARK-32440][CORE][TESTS] Make BlockManagerSuite robust from Scala (commit: 147022a) — dongjoon / githubweb

#580 (Jul 24, 2020 5:57:05 AM)

  1. [SPARK-32392][SQL] Reduce duplicate error log for executing sql (commit: b151194) — yamamuro / githubweb
  2. [SPARK-30616][SQL][FOLLOW-UP] Use only config key name in the config doc (commit: 4616982) — wenchen / githubweb
  3. [SPARK-32237][SQL] Resolve hint in CTE (commit: 182566b) — wenchen / githubweb
  4. [SPARK-32217] Plumb whether a worker would also be decommissioned along (commit: f8d29d3) — hkarau / githubweb
  5. [SPARK-32338][SQL][PYSPARK][FOLLOW-UP] Update slice to accept Column for (commit: 7b66882) — gurwls223 / githubweb
  6. [SPARK-32389][TESTS] Add all hive.execution suite in the parallel test (commit: a71233f) — gurwls223 / githubweb
  7. [SPARK-32364][SQL][FOLLOWUP] Add toMap to return originalMap and (commit: aed8dba) — dongjoon / githubweb
  8. [SPARK-32251][SQL][TESTS][FOLLOWUP] improve SQL keyword test (commit: aa54dcf) — wenchen / githubweb
  9. [SPARK-32280][SPARK-32372][SQL] ResolveReferences.dedupRight should only (commit: a8e3de3) — wenchen / githubweb
  10. [SPARK-32374][SQL] Disallow setting properties when creating temporary (commit: 35345e3) — wenchen / githubweb
  11. [SPARK-31418][SCHEDULER] Request more executors in case of dynamic (commit: e7fb67c) — tgraves / githubweb
  12. [SPARK-32398][TESTS][CORE][STREAMING][SQL][ML] Update to scalatest 3.2.0 (commit: be2eca2) — dongjoon / githubweb
  13. [SPARK-30648][SQL][FOLLOWUP] Refactoring of JsonFilters: move config (commit: 658e874) — gurwls223 / githubweb
  14. [SPARK-32415][SQL][TESTS] Enable tests for JSON option: (commit: 19e3ed7) — gurwls223 / githubweb
  15. [SPARK-32308][SQL] Move by-name resolution logic of unionByName from API (commit: 84efa04) — wenchen / githubweb
  16. Revert "[SPARK-32253][INFRA] Show errors only for the sbt tests of (commit: 8896f4a) — gengliang.wang / githubweb

#579 (Jul 22, 2020 5:29:27 PM)

  1. [SPARK-24266][K8S] Restart the watcher when we receive a version changed (commit: 0432379) — hkarau / githubweb
  2. [SPARK-32286][SQL] Coalesce bucketed table for shuffled hash join if (commit: 39181ff) — yamamuro / githubweb
  3. [SPARK-32350][CORE] Add batch-write on LevelDB to improve performance of (commit: 7b9d755) — kabhwan.opensource / githubweb
  4. [SPARK-31922][CORE] logDebug "RpcEnv already stopped" error on (commit: b4a9606) — dongjoon / githubweb
  5. [MINOR][SQL] Fix warning message for ThriftCLIService.GetCrossReference (commit: 29b7eaa) — wenchen / githubweb
  6. [MINOR][SQL][TESTS] Create tables once in JDBC tests (commit: feca9ed) — wenchen / githubweb
  7. [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket (commit: 04bf351) — dongjoon / githubweb
  8. [SPARK-32003][CORE] When external shuffle service is used, unregister (commit: e8c06af) — irashid / githubweb
  9. [SPARK-32364][SQL] Use CaseInsensitiveMap for DataFrameReader/Writer (commit: cd16a10) — dongjoon / githubweb
  10. [SPARK-31999][SQL] Add REFRESH FUNCTION command (commit: 184074d) — wenchen / githubweb

#578 (Jul 21, 2020 11:09:29 AM)

  1. [SPARK-32363][PYTHON][BUILD] Fix flakiness in pip package testing in (commit: 4da93b0) — gurwls223 / githubweb

#577 (Jul 21, 2020 4:44:18 AM)

  1. [SPARK-32367][K8S][TESTS] Correct the spelling of parameter in (commit: ffdca82) — dongjoon / githubweb
  2. [SPARK-32368][SQL] pathGlobFilter, recursiveFileLookup and basePath (commit: 133c5ed) — dongjoon / githubweb
  3. [SPARK-32338][SQL] Overload slice to accept Column for start and length (commit: 7d65cae) — ueshin / githubweb
  4. [SPARK-32365][SQL] Add a boundary condition for negative index in (commit: 02114f9) — dongjoon / githubweb
  5. [SPARK-32362][SQL][TEST] AdaptiveQueryExecSuite misses verifying AE (commit: 8a1c24b) — gurwls223 / githubweb
  6. [MINOR][DOCS] add link for Debugging your Application in (commit: 1267d80) — gurwls223 / githubweb
  7. [SPARK-32377][SQL] CaseInsensitiveMap should be deterministic for (commit: 8c7d6f9) — dongjoon / githubweb

#576 (Jul 20, 2020 11:19:06 AM)

  1. [SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API (commit: ef3cad1) — gurwls223 / githubweb
  2. [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown (commit: a4ca355) — hkarau / githubweb
  3. [SPARK-32366][DOC] Fix doc link of datetime pattern in 3.0 migration (commit: c2afe1c) — gurwls223 / githubweb
  4. [SPARK-32302][SQL] Partially push down disjunctive predicates through (commit: d0c83f3) — wenchen / githubweb
  5. [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for (commit: e0ecb66) — wenchen / githubweb
  6. [SPARK-32330][SQL] Preserve shuffled hash join build side partitioning (commit: fe07521) — wenchen / githubweb

#575 (Jul 19, 2020 2:55:43 PM)

  1. [SPARK-31579][SQL] replaced floorDiv to Div (commit: f9f9309) — srowen / githubweb
  2. [SPARK-29292][YARN][K8S][MESOS] Fix Scala 2.13 compilation for remaining (commit: ee62482) — dongjoon / githubweb
  3. [SPARK-29802][BUILD] Use python3 in build scripts (commit: 40ef012) — gurwls223 / githubweb
  4. [SPARK-32344][SQL] Unevaluable expr is set to FIRST/LAST ignoreNullsExpr (commit: c7a68a9) — gurwls223 / githubweb
  5. [SPARK-32253][INFRA] Show errors only for the sbt tests of github (commit: 026b0b9) — gurwls223 / githubweb
  6. [SPARK-32276][SQL] Remove redundant sorts before repartition nodes (commit: 0aca1a6) — dongjoon / githubweb
  7. [MINOR][DOCS] Fix links to Cloud Storage connectors docs (commit: 32a0451) — dongjoon / githubweb

#574 (Jul 18, 2020 2:22:48 AM)

  1. [SPARK-21040][CORE] Speculate tasks which are running on decommission (commit: 0678afe) — hkarau / githubweb

#573 (Jul 17, 2020 1:10:36 PM)

  1. [SPARK-31831][SQL][TESTS][FOLLOWUP] Put mocks for HiveSessionImplSuite (commit: 9747e8f) — kabhwan.opensource / githubweb
  2. [SPARK-32094][PYTHON] Update cloudpickle to v1.5.0 (commit: ea9e8f3) — gurwls223 / githubweb
  3. [SPARK-32145][SQL][FOLLOWUP] Fix type in the error log of SparkOperation (commit: efa70b8) — wenchen / githubweb
  4. [SPARK-32215] Expose a (protected) /workers/kill endpoint on the (commit: ffdbbae) — wenchen / githubweb
  5. [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache (commit: 34baed8) — wenchen / githubweb
  6. [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to (commit: 5daf244) — srowen / githubweb
  7. [SPARK-32298][ML] tree models prediction optimization (commit: 3a60b41) — srowen / githubweb
  8. [SPARK-32353][TEST] Update docker/spark-test and clean up unused stuff (commit: 7dc1d89) — dongjoon / githubweb

#572 (Jul 16, 2020 1:43:53 PM)

  1. [SPARK-32004][ALL] Drop references to slave (commit: 90ac9f9) — hkarau / githubweb
  2. [SPARK-32138] Drop Python 2.7, 3.4 and 3.5 (commit: 4ad9bfd) — gurwls223 / githubweb
  3. [SPARK-32241][SQL] Remove empty children of union (commit: 24be816) — wenchen / githubweb
  4. [SPARK-32258][SQL] Not duplicate normalization on children for (commit: cc9371d) — wenchen / githubweb
  5. [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql (commit: d6a68e0) — dongjoon / githubweb
  6. [SPARK-32307][SQL] ScalaUDF's canonicalized expression should exclude (commit: a47b69a) — dongjoon / githubweb
  7. [SPARK-32309][PYSPARK] Import missing sys import (commit: 2a0faca) — dongjoon / githubweb
  8. [SPARK-32305][BUILD] Make `mvn clean` remove `metastore_db` and (commit: 5e0cb3e) — dongjoon / githubweb
  9. [SPARK-32311][PYSPARK][TESTS] Remove duplicate import (commit: c602d79) — dongjoon / githubweb
  10. [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI (commit: 90b0c26) — kabhwan.opensource / githubweb
  11. [SPARK-32303][PYTHON][TESTS] Remove leftover from editable mode (commit: 902e134) — dongjoon / githubweb
  12. [SPARK-32301][PYTHON][TESTS] Add a test case for toPandas to work with (commit: 676d92e) — gurwls223 / githubweb
  13. [MINOR][R] Match collectAsArrowToR with non-streaming (commit: 03b5707) — gurwls223 / githubweb
  14. [SPARK-32316][TESTS][INFRA] Test PySpark with Python 3.8 in Github (commit: 6bdd710) — dongjoon / githubweb
  15. [SPARK-32276][SQL] Remove redundant sorts before repartition nodes (commit: af8e65f) — dongjoon / githubweb
  16. [SPARK-31985][SS] Remove incomplete/undocumented stateful aggregation in (commit: 542aefb) — kabhwan.opensource / githubweb
  17. Revert "[SPARK-32276][SQL] Remove redundant sorts before repartition (commit: 2527fbc) — dongjoon / githubweb
  18. [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's (commit: e449993) — dkbiswal / githubweb
  19. [SPARK-32318][SQL][TESTS] Add a test case to EliminateSortsSuite for (commit: 8950dcb) — dongjoon / githubweb
  20. [SPARK-32036] Replace references to blacklist/whitelist language with (commit: cf22d94) — tgraves / githubweb
  21. [SPARK-32140][ML][PYSPARK] Add training summary to FMClassificationModel (commit: b05f309) — huaxing / githubweb
  22. [SPARK-29292][SQL][ML] Update rest of default modules (Hive, ML, etc) (commit: c28a6fa) — dongjoon / githubweb
  23. [SPARK-32125][UI] Support get taskList by status in Web UI and SHS Rest (commit: db47c6e) — gengliang.wang / githubweb
  24. [SPARK-32272][SQL] Add  SQL standard command SET TIME ZONE (commit: bdeb626) — wenchen / githubweb
  25. [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc (commit: 6be8b93) — wenchen / githubweb
  26. [SPARK-30648][SQL] Support filters pushdown in JSON datasource (commit: c1f160e) — gurwls223 / githubweb
  27. [SPARK-32315][ML] Provide an explanation error message when calling (commit: d5c672a) — huaxing / githubweb
  28. [SPARK-32310][ML][PYSPARK] ML params default value parity in (commit: 383f5e9) — huaxing / githubweb
  29. [SPARK-32335][K8S][TESTS] Remove Python2 test from K8s IT (commit: fb51925) — dongjoon / githubweb

#571 (Jul 13, 2020 10:27:56 AM)

  1. [MINOR][SQL][DOCS] consistency in argument naming for time functions (commit: 6ae400c) — srowen / githubweb
  2. [MINOR][DOCS] Fix typo in PySpark example in ml-datasource.md (commit: c56c84a) — dongjoon / githubweb
  3. [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a (commit: c4b0639) — dongjoon / githubweb
  4. [SPARK-31831][SQL][TESTS] Use subclasses for mock in (commit: ad90cbf) — kabhwan.opensource / githubweb
  5. [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit (commit: bc3d4ba) — dongjoon / githubweb
  6. [SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes (commit: b6229df) — dongjoon / githubweb
  7. [SPARK-32105][SQL] Refactor current ScriptTransformationExec code (commit: 6d49964) — wenchen / githubweb
  8. [SPARK-32220][SQL][FOLLOW-UP] SHUFFLE_REPLICATE_NL Hint should not (commit: 5521afb) — dongjoon / githubweb
  9. [SPARK-32292][SPARK-32252][INFRA] Run the relevant tests only in GitHub (commit: 27ef362) — dongjoon / githubweb

#570 (Jul 11, 2020 10:59:47 PM)

  1. [SPARK-32103][CORE] Support IPv6 host/port in core module (commit: d7d5bdf) — dongjoon / githubweb
  2. [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document (commit: 84db660) — dongjoon / githubweb
  3. [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed (commit: 0c9196e) — dongjoon / githubweb
  4. [SPARK-32149][SHUFFLE] Improve file path name normalisation at block (commit: 1b3fc9a) — kabhwan.opensource / githubweb
  5. [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and (commit: 22f9dfb) — gurwls223 / githubweb
  6. [SPARK-32232][ML][PYSPARK] Make sure ML has the same default solver (commit: 99b4b06) — srowen / githubweb
  7. [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4 (commit: 10a65ee) — gurwls223 / githubweb
  8. [SPARK-32245][INFRA] Run Spark tests in Github Actions (commit: b84ed41) — dongjoon / githubweb
  9. [SPARK-32200][WEBUI] Redirect to the history page when accessed to (commit: ceaa392) — dongjoon / githubweb
  10. [SPARK-29292][SPARK-30010][CORE] Let core compile for Scala 2.13 (commit: 3ad4863) — dongjoon / githubweb
  11. [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition (commit: 09789ff) — dongjoon / githubweb
  12. [SPARK-29358][SQL] Make unionByName optionally fill missing columns with (commit: 98504e9) — dongjoon / githubweb
  13. [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF (commit: 004aea8) — yamamuro / githubweb

#569 (Jul 10, 2020 11:42:47 AM)

  1. [SPARK-31831][SQL] HiveSessionImplSuite flakiness fix via mocking (commit: ac6406e) — dongjoon / githubweb
  2. [SPARK-31875][SQL] Provide a option to disable user supplied Hints (commit: 18aae21) — dongjoon / githubweb
  3. [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from (commit: 01e9dd9) — dongjoon / githubweb
  4. [SPARK-32207][SQL] Support 'F'-suffixed Float Literals (commit: 4609f1f) — dongjoon / githubweb
  5. [SPARK-32242][SQL] CliSuite flakiness fix via differentiating cli driver (commit: e6e43cb) — kabhwan.opensource / githubweb
  6. [SPARK-32256][SQL][TEST-HADOOP2.7] Force to initialize Hadoop (commit: c8779d9) — gurwls223 / githubweb
  7. [SPARK-32091][CORE] Ignore timeout error when remove blocks on the lost (commit: 578b90c) — wenchen / githubweb
  8. [SPARK-32220][SQL] SHUFFLE_REPLICATE_NL Hint should not change (commit: 560fe1f) — dongjoon / githubweb
  9. [SPARK-32133][SQL] Forbid time field steps for date start/end in (commit: 500877e) — dongjoon / githubweb

#568 (Jul 9, 2020 10:47:03 AM)

  1. [SPARK-32214][SQL] The type conversion function generated in (commit: 371b35d) — gurwls223 / githubweb
  2. [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during (commit: 8e7fc04) — kabhwan.opensource / githubweb
  3. [MINOR][INFRA][R] Show the installed packages in R in a prettier way (commit: f60b3b7) — dongjoon / githubweb
  4. [SPARK-32233][TESTS] Disable SBT unidoc generation testing in Jenkins (commit: 17997a5) — dongjoon / githubweb
  5. [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL (commit: 3bb1ac5) — dongjoon / githubweb
  6. [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite (commit: d1d16d1) — dongjoon / githubweb
  7. [SPARK-32024][WEBUI][FOLLOWUP] Quick fix on test failure on missing when (commit: 161cf2a) — gurwls223 / githubweb
  8. [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in (commit: cfecc20) — gurwls223 / githubweb
  9. [SPARK-28067][SPARK-32018] Fix decimal overflow issues (commit: 8c5bee5) — gurwls223 / githubweb
  10. [SPARK-32193][SQL][DOCS] Update regexp usage in SQL docs (commit: 09cc6c5) — yamamuro / githubweb
  11. [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused (commit: 526cb2d) — wenchen / githubweb
  12. [SPARK-32231][R][INFRA] Use Hadoop 3.2 winutils in AppVeyor build (commit: c5bd073) — gurwls223 / githubweb
  13. [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] (commit: 1cb5bfc) — wenchen / githubweb
  14. [SPARK-32192][SQL] Print column name when throws ClassCastException (commit: 523e238) — srowen / githubweb
  15. [SPARK-32035][DOCS][EXAMPLES] Fixed typos involving AWS Access, Secret, (commit: 9331a5c) — dongjoon / githubweb

#567 (Jul 7, 2020 9:58:36 PM)

  1. [SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's (commit: 5d296ed) — dongjoon / githubweb
  2. [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used (commit: 2e23da2) — wenchen / githubweb
  3. [SPARK-32209][SQL] Re-use GetTimestamp in ParseToDate (commit: 75d3428) — dongjoon / githubweb
  4. [SPARK-32164][ML] GeneralizedLinearRegressionSummary optimization (commit: 8d5c094) — huaxing / githubweb
  5. [SPARK-31317][SQL] Add withField method to Column (commit: 4bbc343) — wenchen / githubweb
  6. [SPARK-32211][SQL] Pin mariadb-plugin-gssapi-server version to fix (commit: eb8eda7) — dongjoon / githubweb
  7. [SPARK-32163][SQL] Nested pruning should work even with cosmetic (commit: 90b9099) — dongjoon / githubweb
  8. [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default (commit: 1261fac) — dongjoon / githubweb
  9. [SPARK-32057][SQL][TEST-HIVE1.2][TEST-HADOOP2.7] ExecuteStatement: (commit: 8b0a54e) — gurwls223 / githubweb
  10. [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to (commit: 3659611) — kabhwan.opensource / githubweb
  11. [SPARK-20680][SQL] Spark-sql do not support for creating table with void (commit: b5297c4) — dongjoon / githubweb
  12. [SPARK-30703][SQL][FOLLOWUP] Update SqlBase.g4 invalid comment (commit: 65286ae) — yamamuro / githubweb

#566 (Jul 6, 2020 10:51:34 AM)

  1. [SPARK-31935][SQL][FOLLOWUP] Hadoop file system config should be (commit: 6edb20d) — gengliang.wang / githubweb
  2. [SPARK-32130][SQL] Disable the JSON option `inferTimestamp` by default (commit: bcf2330) — dongjoon / githubweb
  3. [SPARK-32056][SQL][FOLLOW-UP] Coalesce partitions for repartiotion hint (commit: 2a52a1b) — dongjoon / githubweb
  4. [SPARK-29465][YARN][WEBUI] Adding Check to not to set UI port (commit: ced8e0e) — dongjoon / githubweb
  5. [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct (commit: 3f7780d) — gurwls223 / githubweb
  6. [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils (commit: 7fda184) — gurwls223 / githubweb
  7. [MINOR][DOCS] Pyspark getActiveSession docstring (commit: 45fe6b6) — gurwls223 / githubweb
  8. [MINOR][TEST][SQL] Make in-limit.sql more robust (commit: f834156) — gurwls223 / githubweb
  9. [SPARK-31100][SQL] Check namespace existens when setting namespace (commit: f082a79) — wenchen / githubweb
  10. [SPARK-32156][SPARK-31061][TESTS][SQL] Refactor two similar test cases (commit: 0acad58) — dongjoon / githubweb
  11. [SPARK-32130][SQL][FOLLOWUP] Enable timestamps inference in (commit: 42f01e3) — dongjoon / githubweb
  12. [SPARK-32171][SQL][DOCS] Change file locations for use db and refresh (commit: 492d5d1) — huaxing / githubweb
  13. [SPARK-32177][WEBUI] Remove the weird line from near the Spark logo on (commit: 3726aab) — dongjoon / githubweb
  14. [SPARK-32178][TESTS] Disable test-dependencies.sh from Jenkins jobs (commit: 0e33b5e) — gurwls223 / githubweb
  15. [SPARK-32100][CORE][TESTS][FOLLOWUP] Reduce the required test resources (commit: dea7bc4) — dongjoon / githubweb
  16. [SPARK-32145][SQL][TEST-HIVE1.2][TEST-HADOOP2.7] (commit: 59a7087) — wenchen / githubweb
  17. [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map (commit: 1d18096) — gurwls223 / githubweb
  18. [SPARK-32172][CORE] Use createDirectory instead of mkdir (commit: 3fe3365) — dongjoon / githubweb

#565 (Jul 1, 2020 1:37:01 PM)

  1. [SPARK-32071][SQL][TESTS] Add `make_interval` benchmark (commit: 8c44d74) — dongjoon / githubweb
  2. [SPARK-32115][SQL] Fix SUBSTRING to handle integer overflows (commit: 6484c14) — dongjoon / githubweb
  3. [SPARK-32124][CORE][SHS] Fix taskEndReasonFromJson to handle event logs (commit: 197ac3b) — dongjoon / githubweb
  4. [SPARK-32126][SS] Scope Session.active in IncrementalExecution (commit: f944603) — dongjoon / githubweb
  5. [SPARK-32090][SQL] Improve UserDefinedType.equal() to make it be (commit: 0ec17c9) — dongjoon / githubweb
  6. [SPARK-32038][SQL][FOLLOWUP] Make the alias name pretty after (commit: 835ef42) — dongjoon / githubweb
  7. [SPARK-32056][SQL] Coalesce partitions for repartition by expressions (commit: 4204a63) — wenchen / githubweb
  8. [SPARK-32055][CORE][SQL] Unify getReader and getReaderForRange in (commit: 6fcb70e) — wenchen / githubweb
  9. [MINOR] update dev/create-release/known_translations (commit: a6b6a1f) — wenchen / githubweb
  10. [SPARK-32030][SQL] Support unlimited MATCHED and NOT MATCHED clauses in (commit: 20cd47e) — wenchen / githubweb
  11. [SPARK-29999][SS][FOLLOWUP] Fix test to check the actual metadata log (commit: 5472170) — wenchen / githubweb
  12. [SPARK-32068][WEBUI] Correct task lauchtime show issue due to timezone (commit: 165c948) — tgraves / githubweb
  13. [MINOR][DOCS] Fix a typo for a configuration property of resources (commit: 5176707) — dongjoon / githubweb
  14. [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector (commit: 67cb7ea) — dongjoon / githubweb
  15. [MINOR][SQL] Fix spaces in JDBC connection providers (commit: bbd0275) — dongjoon / githubweb
  16. [SPARK-32088][PYTHON][FOLLOWUP] Replace `collect()` by `show()` in the (commit: dd03c31) — gurwls223 / githubweb
  17. [SPARK-32142][SQL][TESTS] Keep the original tests and codes to avoid (commit: 8194d9e) — gurwls223 / githubweb
  18. [SPARK-32131][SQL] Fix AnalysisException messages at UNION/EXCEPT/MINUS (commit: 02f3b80) — dongjoon / githubweb
  19. [SPARK-32095][SQL] Update documentation to reflect usage of updated (commit: a4ba344) — wenchen / githubweb
  20. [SPARK-28169][SQL] Convert scan predicate condition to CNF (commit: 15fb5d7) — wenchen / githubweb
  21. [SPARK-23631][ML][PYSPARK] Add summary to (commit: f7d9e3d) — srowen / githubweb
  22. [SPARK-31797][SQL][FOLLOWUP] TIMESTAMP_SECONDS supports fractional input (commit: 7dbd90b) — dongjoon / githubweb
  23. [SPARK-32026][CORE][TEST] Add PrometheusServletSuite (commit: f843a5b) — dongjoon / githubweb

#564 (Jun 27, 2020 3:22:28 PM)

  1. [SPARK-19939][ML] Add support for association rules in ML (commit: d125529) — srowen / githubweb
  2. [SPARK-20249][ML][PYSPARK] Add training summary for LinearSVCModel (commit: 8795133) — srowen / githubweb
  3. [SPARK-32088][PYTHON] Pin the timezone in timestamp_seconds doctest (commit: ac3a055) — dongjoon / githubweb
  4. [SPARK-32099][DOCS] Remove broken link in cloud integration (commit: 44aecaa) — dongjoon / githubweb
  5. [SPARK-31845][CORE][TESTS] Refactor DAGSchedulerSuite by introducing (commit: 7445c75) — dongjoon / githubweb
  6. [SPARK-32058][BUILD] Use Apache Hadoop 3.2.0 dependency by default (commit: 9c134b5) — dongjoon / githubweb

#563 (Jun 26, 2020 3:32:58 AM)

  1. [SPARK-32098][PYTHON] Use iloc for positional slicing instead of direct (commit: 1af19a7) — cutlerb / githubweb
  2. [SPARK-32100][CORE][TESTS] Add WorkerDecommissionExtendedSuite (commit: 594cb56) — dongjoon / githubweb
  3. [SPARK-32025][SQL] Csv schema inference problems with different types in (commit: bbb2cba) — gurwls223 / githubweb

#562 (Jun 24, 2020 3:23:14 PM)

  1. [SPARK-31918][R] Ignore S4 generic methods under SparkR namespace in (commit: 11d2b07) — gurwls223 / githubweb
  2. [SPARK-32073][R] Drop R < 3.5 support (commit: b62e253) — gurwls223 / githubweb
  3. [SPARK-32028][WEBUI] fix app id link for multi attempts app in history (commit: eedc6cc) — srowen / githubweb
  4. [SPARK-32075][DOCS] Fix a few issues in parameters table (commit: 986fa01) — gurwls223 / githubweb
  5. [SPARK-32072][CORE][TESTS] Fix table formatting with benchmark results (commit: 045106e) — wenchen / githubweb
  6. [SPARK-32062][SQL] Reset listenerRegistered in SparkSession (commit: 9f540fa) — wenchen / githubweb
  7. [SPARK-32074][BUILD][R] Update AppVeyor R version to 4.0.2 (commit: e29ec42) — gurwls223 / githubweb
  8. [SPARK-32080][SPARK-31998][SQL] Simplify ArrowColumnVector ListArray (commit: df04107) — gurwls223 / githubweb
  9. [SPARK-32087][SQL] Allow UserDefinedType to use encoder to deserialize (commit: 47fb9d6) — wenchen / githubweb
  10. [SPARK-32089][R][BUILD] Upgrade R version to 4.0.2 in the release (commit: 71b6d46) — wenchen / githubweb
  11. [SPARK-32078][DOC] Add a redirect to sql-ref from sql-reference (commit: d06604f) — dongjoon / githubweb

#561 (Jun 23, 2020 5:04:00 AM)

  1. [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom (commit: aa4c100) — dongjoon / githubweb
  2. [SPARK-31905][SS] Add compatibility tests for streaming state store (commit: 6fdea63) — wenchen / githubweb
  3. [SPARK-32038][SQL] NormalizeFloatingNumbers should also work on distinct (commit: 2e4557f) — dongjoon / githubweb
  4. [MINOR][SQL] Add `IS [NOT] NULL` examples to ArrayFilter/ArrayExists (commit: 6293c38) — gurwls223 / githubweb
  5. [SPARK-32031][SQL] Fix the wrong references of the PartialMerge/Final (commit: 338efee) — wenchen / githubweb
  6. [MINOR][SQL] Simplify DateTimeUtils.cleanLegacyTimestampStr (commit: 979a8eb) — wenchen / githubweb
  7. [SPARK-32052][SQL] Extract common code from date-time field expressions (commit: fcf9768) — wenchen / githubweb
  8. [SPARK-32045][BUILD] Upgrade to Apache Commons Lang 3.10 (commit: 2bcbe3d) — gurwls223 / githubweb
  9. [SPARK-32049][SQL][TESTS] Upgrade Oracle JDBC Driver 8 (commit: 2dbfae8) — dongjoon / githubweb
  10. [SPARK-32043][SQL] Replace Decimal by Int op in `make_interval` and (commit: e00f43c) — wenchen / githubweb

#560 (Jun 21, 2020 6:49:58 PM)

  1. [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config (commit: 9784934) — dongjoon / githubweb
  2. [SPARK-27702][K8S] Allow using some alternatives for service accounts (commit: d2a656c) — dongjoon / githubweb
  3. [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager (commit: 9f8e15b) — dongjoon / githubweb

#559 (Jun 20, 2020 9:05:21 AM)

  1. [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming (commit: 86b54f3) — wenchen / githubweb
  2. [SPARK-31926][SQL][TESTS][FOLLOWUP][TEST-HIVE1.2][TEST-MAVEN] Fix (commit: abc8ccc) — wenchen / githubweb
  3. [SPARK-31993][SQL] Build arrays for passing variables generated from (commit: 6fe3bf6) — wenchen / githubweb
  4. [SPARK-31826][SQL] Support composed type of case class for typed Scala (commit: 5ee5cfd) — wenchen / githubweb
  5. [SPARK-31029] Avoid using global execution context in driver main thread (commit: 3c34e45) — tgraves / githubweb
  6. [SPARK-32033][SS][DSTEAMS] Use new poll API in Kafka connector executor (commit: a9247c3) — dongjoon / githubweb
  7. [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if (commit: 7b86838) — yamamuro / githubweb
  8. [SPARK-31980][SQL] Function sequence() fails if start and end of range (commit: 177a380) — dongjoon / githubweb
  9. [SPARK-32021][SQL] Increase precision of seconds and fractions of (commit: 66ba356) — dongjoon / githubweb
  10. [SPARK-31957][SQL] Cleanup hive scratch dir for the developer api (commit: 93529a8) — dongjoon / githubweb
  11. [SPARK-31893][ML] Add a generic ClassificationSummary trait (commit: 297016e) — srowen / githubweb

#558 (Jun 18, 2020 10:48:11 PM)

  1. [SPARK-31960][YARN][BUILD] Only populate Hadoop classpath for no-hadoop (commit: 9b79251) — d_tsai / githubweb
  2. [SPARK-32020][SQL] Better error message when SPARK_HOME or (commit: e4f5036) — gurwls223 / githubweb
  3. [MINOR] update dev/create-release/known_translations (commit: 8a9ae01) — wenchen / githubweb
  4. [MINOR][DOCS] Update running-on-kubernetes.md (commit: ac98a9a) — dongjoon / githubweb
  5. [MINOR][DOCS] Emphasize the Streaming tab is for DStream API (commit: 8750363) — gurwls223 / githubweb
  6. [SPARK-30865][SQL][SS] Refactor DateTimeUtils (commit: 17a5007) — wenchen / githubweb

#557 (Jun 17, 2020 12:15:08 PM)

  1. [SPARK-31710][SQL] Fail casting numeric to timestamp by default (commit: f0e6d0e) — wenchen / githubweb
  2. [SPARK-31997][SQL][TESTS] Drop test_udtf table when SingleSessionSuite (commit: d24d27f) — gurwls223 / githubweb
  3. [SPARK-31984][SQL] Make micros rebasing functions via local timestamps (commit: 6e9ff72) — wenchen / githubweb
  4. [SPARK-31710][SQL][FOLLOWUP] Replace CAST by TIMESTAMP_SECONDS in (commit: 3643565) — wenchen / githubweb
  5. [SPARK-31705][SQL][FOLLOWUP] Avoid the unnecessary CNF computation for (commit: 8d57709) — wgyumg / githubweb
  6. [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close (commit: 2ec9b86) — srowen / githubweb
  7. [SPARK-31777][ML][PYSPARK] Add user-specified fold column to (commit: 7f6a8ab) — liangchi / githubweb
  8. [SPARK-31337][SQL] Support MS SQL Kerberos login in JDBC connector (commit: eeb8120) — vanzin / githubweb
  9. [SPARK-31989][SQL] Generate JSON rebasing files w/ 30 minutes step (commit: afd8a8b) — gurwls223 / githubweb
  10. [SPARK-32011][PYTHON][CORE] Remove warnings about pin-thread modes and (commit: feeca63) — gurwls223 / githubweb
  11. [SPARK-29148][CORE][FOLLOWUP] Fix warning message to show a correct (commit: 93bb70f) — dongjoon / githubweb
  12. [SPARK-32006][SQL] Create date/timestamp formatters once before collect (commit: 350aa85) — wenchen / githubweb
  13. [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched (commit: 4badef3) — wenchen / githubweb

#556 (Jun 16, 2020 1:28:18 AM)

  1. [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing (commit: 8282bbf) — gurwls223 / githubweb
  2. [SPARK-31926][SQL][TEST-HIVE1.2][TEST-MAVEN] Fix concurrency issue for (commit: a0187cd) — wenchen / githubweb
  3. [SPARK-31992][SQL] Benchmark the EXCEPTION rebase mode (commit: 9d95f1b) — wenchen / githubweb
  4. [SPARK-31925][ML] Summary.totalIterations greater than maxIters (commit: f83cb3c) — srowen / githubweb
  5. [SPARK-31990][SS] Use toSet.toSeq in Dataset.dropDuplicates (commit: 7f7b4dd) — dongjoon / githubweb
  6. [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> (commit: eae1747) — dongjoon / githubweb
  7. [SPARK-26905][SQL] Follow the SQL:2016 reserved keywords (commit: 3698a14) — yamamuro / githubweb
  8. [SPARK-31994][K8S] Docker image should use `https` urls for only (commit: a7d0d35) — dongjoon / githubweb
  9. [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse (commit: 5e89fbe) — xingbo.jiang / githubweb
  10. Revert "[SPARK-31926][SQL][TEST-HIVE1.2][TEST-MAVEN] Fix concurrency (commit: 75afd88) — dongjoon / githubweb
  11. [SPARK-31986][SQL] Fix Julian-Gregorian micros rebasing of overlapping (commit: e9145d4) — wenchen / githubweb
  12. [SPARK-24634][SS][FOLLOWUP] Rename the variable from "numLateInputs" to (commit: fe68e95) — gurwls223 / githubweb

#555 (Jun 14, 2020 2:50:22 PM)

  1. [SPARK-31944] Add instance weight support in LinearRegressionSummary (commit: 89c98a4) — srowen / githubweb
  2. [SPARK-31644][BUILD][FOLLOWUP] Make Spark's guava version configurable (commit: 610acb2) — dongjoon / githubweb
  3. [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when (commit: c2e5012) — gurwls223 / githubweb
  4. [SPARK-31968][SQL] Duplicate partition columns check when writing data (commit: a4ea599) — dongjoon / githubweb
  5. [SPARK-24634][SS] Add a new metric regarding number of inputs later than (commit: 84815d0) — gurwls223 / githubweb
  6. [SPARK-31593][SS] Remove unnecessary streaming query progress update (commit: 1e40bcc) — gurwls223 / githubweb
  7. [SPARK-31970][CORE] Make MDC configuration step be consistent between (commit: 54e702c) — dongjoon / githubweb
  8. [SPARK-31642][FOLLOWUP] Fix Sorting for duration column and make Status (commit: f5f6eee) — srowen / githubweb

#554 (Jun 13, 2020 5:00:36 AM)

  1. [SPARK-31912][SQL][TESTS] Normalize all binary comparison expressions (commit: 78f9043) — wgyumg / githubweb
  2. [SPARK-31959][SQL][TEST-JAVA11] Fix Gregorian-Julian micros rebasing (commit: c259844) — wenchen / githubweb
  3. [SPARK-31736][SQL] Nested column aliasing for (commit: ff89b11) — gurwls223 / githubweb
  4. Revert "[SPARK-31860][BUILD] only push release tags on succes" (commit: d3a5e29) — wenchen / githubweb
  5. [SPARK-30119][WEBUI] Support pagination for streaming tab (commit: 9b098f1) — srowen / githubweb
  6. [SPARK-31979] Release script should not fail when remove non-existing (commit: 28f131f) — dongjoon / githubweb
  7. [SPARK-31950][SQL][TESTS] Extract SQL keywords from the SqlBase.g4 file (commit: 78d08a8) — yamamuro / githubweb
  8. [SPARK-31977][SQL] Returns the plan directly from NestedColumnAliasing (commit: a620a2a) — yamamuro / githubweb
  9. [SPARK-31967][UI] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time (commit: f535004) — gengliang.wang / githubweb

#553 (Jun 11, 2020 6:20:28 PM)

  1. [SPARK-31956][SQL] Do not fail if there is no ambiguous self join (commit: c400519) — dongjoon / githubweb
  2. [SPARK-31963][PYSPARK][SQL] Support both pandas 0.23 and 1.0 in (commit: 2ab82fa) — dongjoon / githubweb
  3. [SPARK-31915][SQL][PYTHON] Resolve the grouping column properly per the (commit: 00d06ca) — cutlerb / githubweb
  4. Revert "[SPARK-31926][SQL][TEST-HIVE1.2] Fix concurrency issue for (commit: 4a25200) — dongjoon / githubweb
  5. [SPARK-31935][SQL][TESTS][FOLLOWUP] Fix the test case for Hadoop2/3 (commit: c7d45c0) — dongjoon / githubweb
  6. [SPARK-31964][PYTHON] Use Pandas is_categorical on Arrow category type (commit: b7ef529) — gurwls223 / githubweb
  7. [SPARK-31939][SQL][TEST-JAVA11] Fix Parsing day of year when year field (commit: 22dda6e) — wenchen / githubweb
  8. [SPARK-31942] Revert "[SPARK-31864][SQL] Adjust AQE skew join trigger (commit: 5d78537) — wenchen / githubweb
  9. [SPARK-31935][SQL][TESTS][FOLLOWUP] Fix the test case for Hadoop2/3 (commit: 76b5ed4) — dongjoon / githubweb
  10. [SPARK-31965][TESTS][PYTHON] Move doctests related to Java function (commit: 56264fb) — dongjoon / githubweb
  11. [SPARK-28199][SS][FOLLOWUP] Remove package private in class/object in (commit: 4afe2b1) — dongjoon / githubweb
  12. [SPARK-31966][ML][TESTS][PYTHON] Increase the timeout for (commit: 56d4f27) — dongjoon / githubweb
  13. [SPARK-31958][SQL] normalize special floating numbers in subquery (commit: 6fb9c80) — wenchen / githubweb
  14. [SPARK-31954][SQL] Delete duplicate testcase in HiveQuerySuite (commit: 912d45d) — gurwls223 / githubweb
  15. [SPARK-8981][CORE][FOLLOW-UP] Clean up MDC properties after running a (commit: 91cd06b) — wenchen / githubweb
  16. [SPARK-31705][SQL] Push more possible predicates through Join via CNF (commit: 11d3a74) — gengliang.wang / githubweb
  17. [SPARK-21117][SQL] Built-in SQL Function Support - WIDTH_BUCKET (commit: b1adc3d) — dongjoon / githubweb
  18. [SPARK-31765][WEBUI][TEST-MAVEN] Upgrade HtmlUnit >= 2.37.0 (commit: 88a4e55) — srowen / githubweb
  19. [SPARK-31916][SQL] StringConcat can lead to (commit: b87a342) — yamamuro / githubweb

#552 (Jun 10, 2020 7:11:33 AM)

  1. [SPARK-28199][SPARK-28199][SS][FOLLOWUP] Mention the change of into the (commit: 8305b77) — wenchen / githubweb
  2. [SPARK-31932][SQL][TESTS] Add date/timestamp benchmarks for (commit: ddd8d5f) — wenchen / githubweb
  3. [SPARK-31906][SQL][DOCS] Enhance comments in NamedExpression.qualifier (commit: ca2cfd4) — wenchen / githubweb
  4. [SPARK-31486][CORE] spark.submit.waitAppCompletion flag to control (commit: 6befb2d) — srowen / githubweb
  5. [SPARK-31940][SQL][DOCS] Document the default JVM time zone in (commit: de91915) — wenchen / githubweb
  6. [SPARK-29295][SQL][FOLLOWUP] Dynamic partition map parsed from partition (commit: 717ec5e) — wenchen / githubweb
  7. [SPARK-31220][SQL] repartition obeys initialPartitionNum when (commit: 1d1eacd) — wenchen / githubweb
  8. [SPARK-31921][CORE] Fix the wrong warning: "App app-xxx requires more (commit: 38873d5) — dongjoon / githubweb
  9. [SPARK-31926][SQL][TEST-HIVE1.2] Fix concurrency issue for (commit: 02f32cf) — wenchen / githubweb
  10. [SPARK-31830][SQL] Consistent error handling for datetime formatting and (commit: 6a424b9) — wenchen / githubweb
  11. [SPARK-31935][SQL] Hadoop file system config should be effective in data (commit: f3771c6) — gengliang.wang / githubweb
  12. [SPARK-26905][SQL] Add `TYPE` in the ANSI non-reserved list (commit: e14029b) — yamamuro / githubweb
  13. [SPARK-31945][SQL][PYSPARK] Enable cache for the same Python function (commit: 032d179) — gurwls223 / githubweb
  14. [SPARK-31486][CORE][FOLLOW-UP] Use ConfigEntry for config (commit: 8490eab) — gurwls223 / githubweb
  15. [SPARK-31941][CORE] Replace SparkException to NoSuchElementException for (commit: 82ff29b) — sarutak / githubweb
  16. [SPARK-27217][SQL] Nested column aliasing for more operators which can (commit: 43063e2) — gurwls223 / githubweb

#551 (Jun 8, 2020 8:17:49 PM)

  1. Revert "[SPARK-30119][WEBUI] Add Pagination Support to Streaming Page" (commit: f7501dd) — sarutak / githubweb
  2. [SPARK-31849][PYTHON][SQL][FOLLOW-UP] Deduplicate and reuse (commit: a42af81) — gurwls223 / githubweb
  3. [SPARK-31923][CORE] Ignore internal accumulators that use unrecognized (commit: b333ed0) — zsxwing / githubweb
  4. [SPARK-30845] Do not upload local pyspark archives for spark-submit on (commit: 37b7d32) — tgraves / githubweb
  5. [SPARK-31934][BUILD] Remove set -x from docker image tool (commit: 06959eb) — hkarau / githubweb
  6. [SPARK-31849][PYTHON][SQL][FOLLOW-UP] More correct error message in (commit: e289140) — gurwls223 / githubweb

#550 (Jun 7, 2020 9:55:32 AM)

  1. [MINOR][SS][DOCS] fileNameOnly parameter description re-unite (commit: 04f66bf) — gurwls223 / githubweb
  2. [SPARK-30119][WEBUI] Add Pagination Support to Streaming Page (commit: e9337f5) — sarutak / githubweb

#549 (Jun 5, 2020 11:47:32 PM)

  1. [SPARK-31903][SQL][PYSPARK][R] Fix toPandas with Arrow enabled to show (commit: 632b5bc) — gurwls223 / githubweb
  2. [MINOR][PYTHON] Add one more newline between JVM and Python tracebacks (commit: 53ce58d) — gurwls223 / githubweb
  3. Revert "[SPARK-28624][SQL][TESTS] Run date.sql via Thrift Server" (commit: a8266e4) — gurwls223 / githubweb
  4. [SPARK-31879][SQL][TEST-JAVA11] Make week-based pattern invalid for (commit: 9d5b5d0) — wenchen / githubweb
  5. [SPARK-31859][SPARK-31861][FOLLOWUP] Fix typo in tests (commit: ea01013) — wenchen / githubweb
  6. [SPARK-31910][SQL] Enable Java 8 time API in Thrift server (commit: 2c9988e) — wenchen / githubweb
  7. [SPARK-31867][SQL][FOLLOWUP] Check result differences for datetime (commit: fc6af9d) — wenchen / githubweb
  8. [SPARK-31904][SQL] Fix case sensitive problem of char and varchar (commit: 5079831) — yamamuro / githubweb

#548 (Jun 4, 2020 1:03:11 PM)

  1. [SPARK-31878][SQL] Create date formatter only once in `HiveResult` (commit: 125a89c) — wenchen / githubweb
  2. fix compilation (commit: 349015d) — wenchen / githubweb
  3. [SPARK-31896][SQL] Handle am-pm timestamp parsing when hour is missing (commit: afcc14c) — wenchen / githubweb
  4. Revert "[SPARK-31879][SQL] Using GB as default Locale for datetime (commit: e61d0de) — wenchen / githubweb
  5. [SPARK-29947][SQL][FOLLOWUP] ResolveRelations should return relations (commit: dc0709f) — wenchen / githubweb
  6. [SPARK-31853][DOCS] Mention removal of params mixins setter in migration (commit: 4bbe3c2) — srowen / githubweb
  7. [SPARK-28624][SQL][TESTS] Run date.sql via Thrift Server (commit: a4195d2) — gurwls223 / githubweb

#547 (Jun 3, 2020 2:32:01 AM)

  1. [SPARK-28344][SQL][FOLLOW-UP] Check the ambiguous self-join only if (commit: ea45fc5) — dongjoon / githubweb
  2. [SPARK-31870][SQL][TESTS] Fix "Do not optimize skew join if additional (commit: 283814a) — wenchen / githubweb
  3. [SPARK-29150][CORE] Update RDD API for Stage level scheduling to be (commit: ff4a97d) — gurwls223 / githubweb
  4. [SPARK-29137][ML][PYTHON][TESTS] Increase the timeout for (commit: 64cb6f7) — dongjoon / githubweb
  5. [SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by (commit: 4161c62) — wenchen / githubweb
  6. [SPARK-31888][SQL] Support `java.time.Instant` in Parquet filter (commit: 00b355b) — wenchen / githubweb
  7. [SPARK-31834][SQL] Improve error message for incompatible data types (commit: d79a8a8) — gurwls223 / githubweb
  8. [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0 (commit: e5c3463) — srowen / githubweb
  9. [SPARK-31860][BUILD] only push release tags on succes (commit: 69ba9b6) — hkarau / githubweb
  10. [SPARK-31778][K8S][BUILD] Support cross-building docker images (commit: 2570228) — hkarau / githubweb
  11. [SPARK-31566][SQL][DOCS] Add SQL Rest API Documentation (commit: 979593d) — gengliang.wang / githubweb
  12. [SPARK-31876][BUILD] Upgrade to Zstd 1.4.5 (commit: 367d94a) — d_tsai / githubweb
  13. [SPARK-31882][WEBUI] DAG-viz is not rendered correctly with pagination (commit: 271eb26) — gengliang.wang / githubweb
  14. [SPARK-29431][WEBUI] Improve Web UI / Sql tab visualization with cached (commit: e4db3b5) — gengliang.wang / githubweb
  15. [SPARK-31895][PYTHON][SQL] Support DataFrame.explain(extended: str) case (commit: e1d5201) — gurwls223 / githubweb
  16. Revert "[SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0" (commit: baafd43) — gurwls223 / githubweb
  17. [SPARK-31879][SQL] Using GB as default Locale for datetime formatters (commit: c59f51b) — wenchen / githubweb
  18. [SPARK-31892][SQL] Disable week-based date filed for parsing (commit: afe95bd) — wenchen / githubweb
  19. [SPARK-31886][WEBUI] Fix the wrong coloring of nodes in DAG-viz (commit: 8ed93c9) — gengliang.wang / githubweb
  20. [SPARK-31881][K8S][TESTS][FOLLOWUP] Activate hadoop-2.7 by default in (commit: e5b9b86) — dongjoon / githubweb

#546 (Jun 1, 2020 4:03:29 PM)

  1. [SPARK-31874][SQL] Use `FastDateFormat` as the legacy fractional (commit: 47dc332) — wenchen / githubweb
  2. [SPARK-31840][ML] Add instance weight support in (commit: 45cf5e9) — srowen / githubweb
  3. [SPARK-31788][CORE][DSTREAM][PYTHON] Recover the support of union for (commit: 29c51d6) — gurwls223 / githubweb
  4. [SPARK-31849][PYTHON][SQL] Make PySpark SQL exceptions more Pythonic (commit: e694660) — gurwls223 / githubweb
  5. [SPARK-31854][SQL] Invoke in MapElementsExec should not propagate null (commit: b806fc4) — wenchen / githubweb
  6. [SPARK-31837][CORE] Shift to the new highest locality level if there is (commit: bc24c99) — wenchen / githubweb
  7. [SPARK-29683][YARN] False report isAllNodeBlacklisted when RM is having (commit: e70df2c) — srowen / githubweb
  8. [SPARK-31804][WEBUI] Add real headless browser support for HistoryServer (commit: 6a895d0) — srowen / githubweb
  9. [SPARK-31885][SQL] Fix filter push down for old millis timestamps to (commit: 9c0dc28) — wenchen / githubweb
  10. [SPARK-31881][K8S][TESTS] Support Hadoop 3.2 K8s integration tests (commit: 17586f9) — dongjoon / githubweb
  11. [SPARK-31889][BUILD] Docker release script does not allocate enough (commit: ab9e5a2) — hkarau / githubweb

#545 (May 31, 2020 5:38:36 AM)

  1. [SPARK-31859][SPARK-31861][SPARK-31863] Fix Thriftserver session (commit: af35691) — wenchen / githubweb
  2. [SPARK-31864][SQL] Adjust AQE skew join trigger condition (commit: b9737c3) — wenchen / githubweb
  3. [SPARK-31866][SQL][DOCS] Add COALESCE/REPARTITION/REPARTITION_BY_RANGE (commit: 1b780f3) — srowen /