WDescription%
Build stability: 3 out of the last 5 builds failed.40
Build History
x

Changes

#1838 (Sep 24, 2021, 3:52:19 AM)

  1. [SPARK-33832][SQL] Force skew join code simplification and improvement — wenchen / githubweb
  2. [SPARK-36825][SQL] Read/write dataframes with ANSI intervals from/to — max.gekk / githubweb
  3. [SPARK-36792][SQL] InSet should handle NaN — wenchen / githubweb
  4. [SPARK-36656][SQL][TEST] CollapseProject should not collapse correlated — wenchen / githubweb
  5. [SPARK-36827][CORE] Improve the perf and memory usage of cleaning up — gengliang / githubweb

#1837 (Sep 23, 2021, 7:52:16 PM)

  1. [SPARK-36835][BUILD] Enable createDependencyReducedPom for Maven shaded — gengliang / githubweb

#1836 (Sep 23, 2021, 7:05:52 PM)

  1. Revert "[SPARK-35672][CORE][YARN] Pass user classpath entries to — gurwls223 / githubweb

#1835 (Sep 23, 2021, 5:34:41 PM)

  1. [SPARK-36642][SQL] Add df.withMetadata pyspark API — weichen.xu / githubweb

#1834 (Sep 23, 2021, 10:25:44 AM)

  1. [SPARK-36760][DOCS][FOLLOWUP] Fix wrong JavaDoc style — sarutak / githubweb

#1833 (Sep 23, 2021, 9:07:59 AM)

  1. [SPARK-36760][SQL][FOLLOWUP] Add interface SupportsPushDownV2Filters — wenchen / githubweb

#1832 (Sep 23, 2021, 1:32:47 AM)

  1. [SPARK-36782][CORE][FOLLOW-UP] Only handle shuffle block in separate — gengliang / githubweb

#1831 (Sep 23, 2021, 12:14:37 AM)

  1. [MINOR][SQL][DOCS] Correct the 'options' description on — huaxin_gao / githubweb
  2. [SPARK-36795][SQL] Explain Formatted has Duplicate Node IDs — gurwls223 / githubweb

#1830 (Sep 22, 2021, 11:00:11 PM)

  1. [SPARK-36506][PYTHON] Improve test coverage for series.py and — gurwls223 / githubweb
  2. [SPARK-36405][SQL][TESTS] Check that SQLSTATEs are valid — gurwls223 / githubweb

#1829 (Sep 22, 2021, 10:03:53 PM)

  1. [SPARK-36747][SQL] Do not collapse Project with Aggregate when — wenchen / githubweb
  2. [SPARK-36782][CORE] Avoid blocking dispatcher-BlockManagerMaster during — gengliang / githubweb

#1828 (Sep 22, 2021, 9:04:54 PM)

  1. [SPARK-36791][DOCS] Fix spelling mistakes in running-on-yarn.md file — gurwls223 / githubweb

#1827 (Sep 22, 2021, 7:06:19 PM)

  1. [SPARK-36708][PYTHON] Support numpy.typing for annotating ArrayType in — gurwls223 / githubweb
  2. [SPARK-36824][R] Add sec and csc as R functions — gurwls223 / githubweb

#1826 (Sep 22, 2021, 1:07:32 PM)

  1. [SPARK-36818][PYTHON] Fix filtering a Series by a boolean Series — ueshin / githubweb

#1825 (Sep 22, 2021, 9:07:52 AM)

  1. [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and — wenchen / githubweb

#1824 (Sep 22, 2021, 2:56:50 AM)

  1. [SPARK-36822][SQL] BroadcastNestedLoopJoinExec should use all condition — wenchen / githubweb
  2. [SPARK-36803][SQL] Fix ArrayType conversion when reading Parquet files — wenchen / githubweb

#1823 (Sep 22, 2021, 2:07:25 AM)

  1. [SPARK-36760][SQL] Add interface SupportsPushDownV2Filters — wenchen / githubweb

#1822 (Sep 22, 2021, 12:16:10 AM)

  1. [SPARK-36820][SQL] Disable tests related to LZ4 for Hadoop 2.7 profile — viirya / githubweb

#1821 (Sep 21, 2021, 2:18:07 PM)

  1. [SPARK-36771][PYTHON] Fix `pop` of Categorical Series — ueshin / githubweb

#1820 (Sep 21, 2021, 11:53:42 AM)

  1. [SPARK-36615][CORE] Register shutdown hook earlier when start SC — mridulatgmail.com / githubweb

#1819 (Sep 21, 2021, 11:05:44 AM)

  1. [SPARK-36670][FOLLOWUP][TEST] Remove brotli-codec dependency — dongjoon / githubweb

#1818 (Sep 21, 2021, 10:21:01 AM)

  1. [SPARK-36769][PYTHON] Improve `filter` of single-indexed DataFrame — ueshin / githubweb

#1817 (Sep 21, 2021, 8:28:56 AM)

  1. [SPARK-36814][SQL] Make class ColumnarBatch extendable — d_tsai / githubweb

#1816 (Sep 21, 2021, 12:22:44 AM)

  1. [SPARK-36807][SQL] Merge ANSI interval types to a tightest common type — max.gekk / githubweb

#1815 (Sep 20, 2021, 6:02:42 PM)

  1. [SPARK-36785][PYTHON] Fix DataFrame.isin when DataFrame has NaN value — ueshin / githubweb

#1814 (Sep 20, 2021, 3:03:26 PM)

  1. [SPARK-36618][PYTHON] Support dropping rows of a single-indexed — ueshin / githubweb
  2. [SPARK-36746][PYTHON] Refactor `_select_rows_by_iterable` in — ueshin / githubweb

#1813 (Sep 20, 2021, 11:07:52 AM)

  1. [SPARK-36806][K8S][R] Use R 4.0.4 in K8s R image — dongjoon / githubweb

#1812 (Sep 20, 2021, 10:16:40 AM)

  1. [SPARK-36808][BUILD] Upgrade Kafka to 2.8.1 — dongjoon / githubweb

#1811 (Sep 20, 2021, 9:21:50 AM)

  1. [SPARK-36805][BUILD][K8S] Upgrade kubernetes-client to 5.7.3 — dongjoon / githubweb

#1810 (Sep 20, 2021, 7:04:09 AM)

  1. [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC — sarutak / githubweb

#1809 (Sep 20, 2021, 2:52:41 AM)

  1. [SPARK-36101][CORE] Grouping exception in core/api — wenchen / githubweb

#1808 (Sep 20, 2021, 2:03:41 AM)

  1. [SPARK-36754][SQL] ArrayIntersect handle duplicated Double.NaN and — wenchen / githubweb

#1807 (Sep 20, 2021, 1:11:16 AM)

  1. [SPARK-34112][BUILD] Upgrade ORC to 1.7.0 — dongjoon / githubweb

#1806 (Sep 19, 2021, 6:57:01 PM)

  1. [SPARK-36107][SQL] Refactor first set of 20 query execution errors to — gurwls223 / githubweb
  2. [SPARK-36710][PYTHON] Support new typing syntax in function apply APIs — gurwls223 / githubweb

#1805 (Sep 18, 2021, 12:54:37 AM)

  1. [SPARK-36772] FinalizeShuffleMerge fails with an exception due to — gengliang / githubweb

#1804 (Sep 17, 2021, 5:58:15 PM)

  1. [SPARK-36762][PYTHON] Fix Series.isin when Series has NaN values — ueshin / githubweb

#1803 (Sep 17, 2021, 11:53:12 AM)

  1. [SPARK-36673][SQL][FOLLOWUP] Remove duplicate test in — viirya / githubweb

#1802 (Sep 17, 2021, 8:58:55 AM)

  1. [SPARK-36780][BUILD] Make `dev/mima` runs on Java 17 — dongjoon / githubweb

#1801 (Sep 17, 2021, 6:55:24 AM)

  1. [SPARK-36764][SS][TEST] Fix race-condition on "ensure continuous stream — wenchen / githubweb
  2. [SPARK-36718][SQL] Only collapse projects if we don't duplicate — wenchen / githubweb
  3. [SPARK-36673][SQL] Fix incorrect schema of nested types of union — wenchen / githubweb
  4. [SPARK-36767][SQL] ArrayMin/ArrayMax/SortArray/ArraySort add comment and — wenchen / githubweb
  5. [SPARK-36663][SQL] Support number-only column names in ORC data sources — wenchen / githubweb

#1800 (Sep 17, 2021, 5:56:14 AM)

  1. [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and — wenchen / githubweb

#1799 (Sep 17, 2021, 4:52:03 AM)

  1. [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe) — max.gekk / githubweb

#1798 (Sep 17, 2021, 12:51:22 AM)

  1. [SPARK-36789][SQL] Use the correct constant type as the null value — gurwls223 / githubweb

#1797 (Sep 16, 2021, 11:52:06 PM)

  1. [SPARK-32709][SQL] Support writing Hive bucketed table (Parquet/ORC — wenchen / githubweb

#1796 (Sep 16, 2021, 8:57:52 PM)

  1. [SPARK-36788][SQL] Change log level of AQE for non-supported plans from — gurwls223 / githubweb

#1795 (Sep 16, 2021, 7:55:18 PM)

  1. [SPARK-36773][SQL][TEST] Fixed unit test to check the compression for — gurwls223 / githubweb
  2. [SPARK-36783][SQL] ScanOperation should not push Filter through — wenchen / githubweb

#1794 (Sep 16, 2021, 5:51:17 PM)

  1. [SPARK-36779][PYTHON] Fix when list of data type tuples has len = 1 — gurwls223 / githubweb

#1793 (Sep 16, 2021, 2:53:05 PM)

  1. [SPARK-36774][CORE][TESTS] Move SparkSubmitTestUtils to core module and — joshrosen / githubweb

#1792 (Sep 16, 2021, 8:49:13 AM)

  1. [SPARK-36735][SQL][FOLLOWUP] Fix indentation of — dongjoon / githubweb

#1791 (Sep 16, 2021, 5:45:18 AM)

  1. [SPARK-36759][BUILD][FOLLOWUP] Update version in scala-2.12 profile and — dongjoon / githubweb

#1790 (Sep 16, 2021, 4:59:10 AM)

  1. [SPARK-36587][SQL][FOLLOWUP] Remove unused CreateNamespaceStatement — gengliang / githubweb

#1789 (Sep 16, 2021, 3:38:21 AM)

  1. [SPARK-36777][INFRA] Move Java 17 on GitHub Actions from EA to LTS — yumwang / githubweb

#1788 (Sep 16, 2021, 2:49:55 AM)

  1. [SPARK-36433][WEBUI] Fix log message in WebUI — gengliang / githubweb

#1787 (Sep 16, 2021, 12:56:19 AM)

  1. [SPARK-36775][DOCS] Add documentation for ANSI store assignment rules — wenchen / githubweb

#1786 (Sep 15, 2021, 11:52:39 PM)

  1. [SPARK-36732][SQL][BUILD] Upgrade ORC to 1.6.11 — dongjoon / githubweb

#1785 (Sep 15, 2021, 10:17:42 PM)

  1. [SPARK-36745][SQL] ExtractEquiJoinKeys should return the original — wenchen / githubweb

#1784 (Sep 15, 2021, 2:33:41 PM)

  1. [SPARK-36735][SQL] Adjust overhead of cached relation for DPP — viirya / githubweb

#1783 (Sep 15, 2021, 1:48:15 PM)

  1. [SPARK-36759][BUILD] Upgrade Scala to 2.12.15 — dongjoon / githubweb

#1782 (Sep 15, 2021, 12:50:04 PM)

  1. [SPARK-36726] Upgrade Parquet to 1.12.1 — d_tsai / githubweb

#1781 (Sep 15, 2021, 11:14:04 AM)

  1. [SPARK-36722][PYTHON] Fix Series.update with another in same frame — ueshin / githubweb

#1780 (Sep 15, 2021, 7:56:53 AM)

  1. [SPARK-36755][SQL] ArraysOverlap should handle duplicated Double.NaN and — wenchen / githubweb

#1779 (Sep 15, 2021, 7:10:27 AM)

  1. [SPARK-36702][SQL][FOLLOWUP] ArrayUnion handle duplicated Double.NaN and — wenchen / githubweb

#1778 (Sep 15, 2021, 12:51:00 AM)

  1. [SPARK-36751][SQL][PYTHON][R] Add bit/octet_length APIs to Scala, Python — sarutak / githubweb

#1777 (Sep 14, 2021, 9:07:24 PM)

  1. [SPARK-36660][SQL][FOLLOW-UP] Add cot to pyspark.sql.rst — gurwls223 / githubweb

#1776 (Sep 14, 2021, 6:46:58 PM)

  1. [SPARK-36709][PYTHON] Support new syntax for specifying index type and — gurwls223 / githubweb
  2. [SPARK-36733][SQL] Fix a perf issue in SchemaPruning when a struct has — gurwls223 / githubweb

#1775 (Sep 14, 2021, 5:48:27 PM)

  1. [SPARK-34943][BUILD] Upgrade flake8 to 3.8.0 or above in Jenkins — gurwls223 / githubweb

#1774 (Sep 14, 2021, 4:49:12 PM)

  1. [SPARK-36712][BUILD][FOLLOWUP] Improve the regex to avoid breaking — dongjoon / githubweb

#1773 (Sep 14, 2021, 5:43:58 AM)

  1. [SPARK-36737][BUILD][CORE][SQL][SS] Upgrade Apache commons-io to 2.11.0 — kabhwan.opensource / githubweb

#1772 (Sep 14, 2021, 3:45:58 AM)

  1. [SPARK-36702][SQL] ArrayUnion handle duplicated Double.NaN and Float.Nan — wenchen / githubweb

#1771 (Sep 13, 2021, 9:48:11 PM)

  1. [SPARK-36705][FOLLOW-UP] Fix unnecessary logWarning when — mridulatgmail.com / githubweb

#1770 (Sep 13, 2021, 7:45:36 PM)

  1. [SPARK-36748][PYTHON] Introduce the 'compute.isin_limit' option — gurwls223 / githubweb

#1769 (Sep 13, 2021, 5:43:30 PM)

  1. [SPARK-36739][DOCS][PYTHON] Add apache license headers to makefiles — gurwls223 / githubweb
  2. [SPARK-36715][SQL] InferFiltersFromGenerate should not infer filter for — gurwls223 / githubweb

#1768 (Sep 13, 2021, 3:45:04 PM)

  1. [SPARK-36653][PYTHON] Implement Series.__xor__ and Series.__rxor__ — ueshin / githubweb

#1767 (Sep 13, 2021, 2:42:04 PM)

  1. [SPARK-36705][SHUFFLE] Disable push based shuffle when IO encryption is — mridulatgmail.com / githubweb

#1766 (Sep 13, 2021, 9:08:03 AM)

  1. [SPARK-36712][BUILD] Make scala-parallel-collections in 2.13 POM a — srowen / githubweb

#1765 (Sep 13, 2021, 7:56:32 AM)

  1. [SPARK-36736][SQL] Support ILIKE (ALL | ANY | SOME) - case insensitive — wenchen / githubweb

#1764 (Sep 13, 2021, 6:55:08 AM)

  1. [SPARK-36724][SQL] Support timestamp_ntz as a type of time column for — gengliang / githubweb

#1763 (Sep 13, 2021, 5:55:17 AM)

  1. [SPARK-36738][SQL][DOC] Fixed the wrong documentation on Cot API — gurwls223 / githubweb

#1762 (Sep 13, 2021, 2:41:41 AM)

  1. [SPARK-33832][SQL] Support optimize skewed join even if introduce extra — wenchen / githubweb

#1761 (Sep 12, 2021, 10:42:06 AM)

  1. [SPARK-36729][BUILD] Upgrade Netty from 4.1.63 to 4.1.68 — dongjoon / githubweb

#1760 (Sep 12, 2021, 8:03:18 AM)

  1. [SPARK-36636][CORE][TEST] LocalSparkCluster change to use tmp workdir in — srowen / githubweb

#1759 (Sep 11, 2021, 4:39:07 PM)

  1. [SPARK-35822][UI] Spark UI-Executor tab is empty in IE11 — dongjoon / githubweb
  2. [SPARK-36719][CORE] Supporting Netty Logging at the network layer — dongjoon / githubweb

#1758 (Sep 11, 2021, 3:55:37 PM)

  1. [SPARK-36725][SQL][TESTS] Ensure HiveThriftServer2Suites to stop Thrift — dongjoon / githubweb

#1757 (Sep 11, 2021, 2:44:53 PM)

  1. [SPARK-36685][ML][MLLIB] Fix wrong assert messages — dongjoon / githubweb

#1756 (Sep 11, 2021, 11:40:21 AM)

  1. [SPARK-36704][CORE] Expand exception handling to more Java 9 cases where — srowen / githubweb

#1755 (Sep 11, 2021, 10:40:25 AM)

  1. [SPARK-36556][SQL] Add DSV2 filters — viirya / githubweb

#1604 (Aug 10, 2021, 12:27:16 AM)

  1. [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check — wenchen / githubweb