FailedChanges

Summary

  1. [SPARK-25566][SPARK-25567][WEBUI][SQL] Support pagination for SQL tab to (details)
  2. [SPARK-25670][TEST] Reduce number of tested timezones in (details)
Commit 3494b122814ed991b40dc4b80703c0ef55493d36 by sean.owen
[SPARK-25566][SPARK-25567][WEBUI][SQL] Support pagination for SQL tab to
avoid OOM
## What changes were proposed in this pull request? Currently SQL tab in
the WEBUI doesn't support pagination. Because of that following issues
are happening. 1) For large number of executions, SQL page is throwing
OOM exception (around 40,000) 2) For large number of executions, loading
SQL page is taking time. 3) Difficult to analyse the execution table for
large number of execution.
[Note: spark.sql.ui.retainedExecutions = 50000]
All the tabs, Jobs, Stages etc. supports pagination. So, to make it
consistent with other tabs SQL tab also should support pagination.
I have followed the similar flow of the pagination code in the Jobs and
Stages page for SQL page. Also, this patch doesn't make any behavior
change for the SQL tab except the pagination support.
## How was this patch tested? bin/spark-shell --conf
spark.sql.ui.retainedExecutions=50000 Run 50,000 sql queries.
**Before this PR**
![screenshot from 2018-10-05
23-48-27](https://user-images.githubusercontent.com/23054875/46552750-4ed82480-c8f9-11e8-8b05-d60bedddd1b8.png)
![screenshot from 2018-10-05
22-58-11](https://user-images.githubusercontent.com/23054875/46550276-33b5e680-c8f2-11e8-9e32-9ae9c5b181e0.png)
**After this PR**
Loading of the page is faster, and OOM issue doesn't happen.
![screenshot from 2018-10-05
23-50-32](https://user-images.githubusercontent.com/23054875/46552814-8050f000-c8f9-11e8-96e9-42502d2cfaea.png)
Closes #22645 from shahidki31/SPARK-25566.
Authored-by: Shahid <shahidki31@gmail.com> Signed-off-by: Sean Owen
<sean.owen@databricks.com>
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/ui/AllExecutionsPage.scala (diff)
The file was modifiedcore/src/main/scala/org/apache/spark/ui/PagedTable.scala (diff)
Commit d47a25f681abd761fb16b6a861d892f1b399daf2 by sean.owen
[SPARK-25670][TEST] Reduce number of tested timezones in
JsonExpressionsSuite
## What changes were proposed in this pull request?
After the changes, total execution time of `JsonExpressionsSuite.scala`
dropped from 12.5 seconds to 3 seconds.
Closes #22657 from MaxGekk/json-timezone-test.
Authored-by: Maxim Gekk <maxim.gekk@databricks.com> Signed-off-by: Sean
Owen <sean.owen@databricks.com>
The file was modifiedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/JsonExpressionsSuite.scala (diff)
The file was modifiedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeTestUtils.scala (diff)